2026-03-27 16:45:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-27 16:45:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-27 16:45:05 [ayvens.fr] INFO: Starting spider ayvens.fr
2026-03-27 16:45:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-27 16:45:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-27 16:45:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-27 16:45:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-27 16:45:05 [scrapy.extensions.telnet] INFO: Telnet Password: 87359c91fd56d8cb
2026-03-27 16:45:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-27 16:45:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.fr/task_44_2026-03-27T16_45_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-27 16:45:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 16:45:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 16:45:05 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-27 16:45:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-27 16:45:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-27 16:45:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-27 16:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 16:45:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-27 16:45:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-27 16:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-27 16:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-03-27 16:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-03-27 16:45:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-27 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-27 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-27 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-27 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-27 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-27 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-27 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-27 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-27 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-27 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-27 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-27 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-27 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-27 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-27 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-27 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-27 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-27 16:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-27 16:45:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-27 16:45:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-27 16:45:06 [scrapy.core.engine] INFO: Spider opened
2026-03-27 16:45:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-27 16:45:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-27 16:45:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-27 16:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 16:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 16:45:11 [scrapy-playwright] INFO: Launching browser firefox
2026-03-27 16:45:11 [scrapy-playwright] INFO: Browser firefox launched
2026-03-27 16:45:11 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-27 16:45:12 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-03-27 16:45:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-27 16:45:13 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-03-27 16:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R5GGQAWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-YI6GGZZZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NAGGRITV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BBQ7R2BV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPL7GXW6.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ADG3G2OJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7JYRLYWD.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K7GQAXGO.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PMQRMPGY.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-NKPAFEH2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-03-27 16:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-03-27 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-03-27 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-03-27 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-03-27 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-03-27 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-27 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-27 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-27 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R5GGQAWE.js>
2026-03-27 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-YI6GGZZZ.js>
2026-03-27 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QV3UPEBS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-27 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-27 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EIXBRKXP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-27 16:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5567JMUS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NAGGRITV.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BBQ7R2BV.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ADG3G2OJ.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QZ2M64VL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HQZHDCQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CQOH37XC.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPL7GXW6.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7JYRLYWD.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PMQRMPGY.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K7GQAXGO.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EVZDJ3YH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AHM2LY2L.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SUQC6PCL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6BXXUPPN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SALCXTDR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-K7GQAXGO.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-NKPAFEH2.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y6LYHJ33.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ELPOVYM7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VBU7AOHF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-N2FZW7V7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPLHK2CL.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KLKMSQPH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2FANG3NP.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NPJHDJ36.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5D4JF6DX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7IEPAGTW.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ZYL3EWWF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WWYAPULQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XXARMH2T.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XGLUMAK5.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EHSUL3RU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7UDVUMWJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WRLSZEDX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QV3UPEBS.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EIXBRKXP.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5567JMUS.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QZ2M64VL.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EVZDJ3YH.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CQOH37XC.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HQZHDCQG.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AHM2LY2L.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SUQC6PCL.js>
2026-03-27 16:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6BXXUPPN.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SALCXTDR.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y6LYHJ33.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ELPOVYM7.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VBU7AOHF.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-N2FZW7V7.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPLHK2CL.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2FANG3NP.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KLKMSQPH.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NPJHDJ36.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7IEPAGTW.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5D4JF6DX.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ZYL3EWWF.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WWYAPULQ.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XXARMH2T.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XGLUMAK5.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EHSUL3RU.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7UDVUMWJ.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WRLSZEDX.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7HVTDVUE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7HVTDVUE.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPZ5PCFV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7HVTDVUE.js)
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPZ5PCFV.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R57BLUBZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R57BLUBZ.js>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json>
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XI7MA6UU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-253AOQV4.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y26P6NOT.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XI7MA6UU.js>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-E2QM5VHP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QVU7EFJH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y26P6NOT.js>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PU5AH4GE.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6AWK7DQQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JMKQRIJX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OXIZJZO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-253AOQV4.js>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-E2QM5VHP.js>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QVU7EFJH.js>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PU5AH4GE.js>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OXIZJZO4.js>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JMKQRIJX.js>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6AWK7DQQ.js>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BQLC5RJD.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGLYMGTS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-PU5AH4GE.js)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VNA57F7Z.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EXKYPD3J.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-27 16:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BQLC5RJD.js>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VNA57F7Z.js>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EXKYPD3J.js>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGLYMGTS.js>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AZBPSD4I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2NCM5KDW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/bell.svg>
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:18 [ayvens.fr] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': '7mf1pEld2HrcqfPcmsxaUg|2026-03-27T16:45:17.175Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1806165917, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': 'ThTG9lytmanygTY3hNfPFW|1774629918458|1774629918458', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1774631718, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-03-27 16:45:18 [ayvens.fr] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': '7mf1pEld2HrcqfPcmsxaUg|2026-03-27T16:45:17.175Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': 'ThTG9lytmanygTY3hNfPFW|1774629918458|1774629918458', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-03-27 16:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-03-27 16:45:18 [ayvens.fr] INFO: Intercepting token...
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg>
2026-03-27 16:45:18 [ayvens.fr] INFO: Scrolling element to trigger lazy load...
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:45:18 [ayvens.fr] INFO: GraphQL headers: {'host': 'api-carmarket.ayvens.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'same-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9XQjdOUi1jYy1HQjozY35+YWdLUmM2MlZaQUw=', 'connection': 'keep-alive'}
2026-03-27 16:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VUZVFPNF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AZBPSD4I.js>
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2NCM5KDW.js>
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VUZVFPNF.js>
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FX6676C7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VUZVFPNF.js)
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FX6676C7.js>
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BK6NFD4R.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/lu.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-75KGV5DF.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-OXIZJZO4.js)
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BK6NFD4R.js>
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/lu.svg>
2026-03-27 16:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-75KGV5DF.js>
2026-03-27 16:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-03-27 16:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json>
2026-03-27 16:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 16:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js>
2026-03-27 16:45:20 [ayvens.fr] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-03-27 16:45:20 [ayvens.fr] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-03-27 16:45:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 16:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 16:45:24 [ayvens.fr] INFO: Found listing with ID: 1988198
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988198%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [ayvens.fr] INFO: Scrape type for 1988198: 1
2026-03-27 16:45:24 [ayvens.fr] INFO: Extracting data for car ID: 1988198
2026-03-27 16:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1253ecca-c1c1-581f-932b-449542b88e9a with identifier: 1988198
2026-03-27 16:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1253ecca-c1c1-581f-932b-449542b88e9a with scrape type 1
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1253ecca-c1c1-581f-932b-449542b88e9a
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a90403d416548ac8c63d2cb3b74b744%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/1.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a90403d416548ac8c63d2cb3b74b744%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/2.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a90403d416548ac8c63d2cb3b74b744%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/3.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a90403d416548ac8c63d2cb3b74b744%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/4.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a90403d416548ac8c63d2cb3b74b744%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/5.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a90403d416548ac8c63d2cb3b74b744%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/6.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a90403d416548ac8c63d2cb3b74b744%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/7.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a90403d416548ac8c63d2cb3b74b744%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/8.jpg not downloaded yet
2026-03-27 16:45:24 [ayvens.fr] INFO: Found listing with ID: 1988199
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988199%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [ayvens.fr] INFO: Scrape type for 1988199: 1
2026-03-27 16:45:24 [ayvens.fr] INFO: Extracting data for car ID: 1988199
2026-03-27 16:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3c38141-79b2-5015-89b9-49e55ab0ea3a with identifier: 1988199
2026-03-27 16:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3c38141-79b2-5015-89b9-49e55ab0ea3a with scrape type 1
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c3c38141-79b2-5015-89b9-49e55ab0ea3a
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F20998a02896a451786deca3a1cb89cfb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/1.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F20998a02896a451786deca3a1cb89cfb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/2.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F20998a02896a451786deca3a1cb89cfb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/3.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F20998a02896a451786deca3a1cb89cfb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/4.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F20998a02896a451786deca3a1cb89cfb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/5.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F20998a02896a451786deca3a1cb89cfb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/6.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F20998a02896a451786deca3a1cb89cfb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/7.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F20998a02896a451786deca3a1cb89cfb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/8.jpg not downloaded yet
2026-03-27 16:45:24 [ayvens.fr] INFO: Found listing with ID: 1988200
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988200%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [ayvens.fr] INFO: Scrape type for 1988200: 1
2026-03-27 16:45:24 [ayvens.fr] INFO: Extracting data for car ID: 1988200
2026-03-27 16:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8c7449d-e0dd-5316-b46f-593d0b459bea with identifier: 1988200
2026-03-27 16:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8c7449d-e0dd-5316-b46f-593d0b459bea with scrape type 1
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c8c7449d-e0dd-5316-b46f-593d0b459bea
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6149278d460f4a95ab0e31ebfe268553%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/1.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6149278d460f4a95ab0e31ebfe268553%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/2.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6149278d460f4a95ab0e31ebfe268553%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/3.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6149278d460f4a95ab0e31ebfe268553%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/4.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6149278d460f4a95ab0e31ebfe268553%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/5.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6149278d460f4a95ab0e31ebfe268553%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/6.jpg not downloaded yet
2026-03-27 16:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6149278d460f4a95ab0e31ebfe268553%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/7.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6149278d460f4a95ab0e31ebfe268553%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/8.jpg not downloaded yet
2026-03-27 16:45:24 [ayvens.fr] INFO: Found listing with ID: 1988201
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988201%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [ayvens.fr] INFO: Scrape type for 1988201: 1
2026-03-27 16:45:24 [ayvens.fr] INFO: Extracting data for car ID: 1988201
2026-03-27 16:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a6765c5-7b97-5771-9d50-bc1741932bbf with identifier: 1988201
2026-03-27 16:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a6765c5-7b97-5771-9d50-bc1741932bbf with scrape type 1
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4a6765c5-7b97-5771-9d50-bc1741932bbf
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3bbb89c45dc44daf94a794fe64d2d404%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/1.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3bbb89c45dc44daf94a794fe64d2d404%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/2.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3bbb89c45dc44daf94a794fe64d2d404%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/3.jpg not downloaded yet
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3bbb89c45dc44daf94a794fe64d2d404%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/4.jpg not downloaded yet
2026-03-27 16:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-27 16:45:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-27 16:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59057fb90>
2026-03-27 16:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2123
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1253ecca-c1c1-581f-932b-449542b88e9a/1253ecca-c1c1-581f-932b-449542b88e9a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a90403d416548ac8c63d2cb3b74b744%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/3.jpg saved to cache
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1253ecca-c1c1-581f-932b-449542b88e9a
2026-03-27 16:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3bbb89c45dc44daf94a794fe64d2d404%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/5.jpg not downloaded yet
2026-03-27 16:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3bbb89c45dc44daf94a794fe64d2d404%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/6.jpg not downloaded yet
2026-03-27 16:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3bbb89c45dc44daf94a794fe64d2d404%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/7.jpg not downloaded yet
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590597790>
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c38141-79b2-5015-89b9-49e55ab0ea3a/c3c38141-79b2-5015-89b9-49e55ab0ea3a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F20998a02896a451786deca3a1cb89cfb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/1.jpg saved to cache
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3c38141-79b2-5015-89b9-49e55ab0ea3a
2026-03-27 16:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3bbb89c45dc44daf94a794fe64d2d404%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/8.jpg not downloaded yet
2026-03-27 16:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:25 [ayvens.fr] INFO: Found listing with ID: 1988202
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988202%27 HTTP/1.1" 200 None
2026-03-27 16:45:25 [ayvens.fr] INFO: Scrape type for 1988202: 1
2026-03-27 16:45:25 [ayvens.fr] INFO: Extracting data for car ID: 1988202
2026-03-27 16:45:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47ee5ded-787b-5355-8883-f3d9d3768629 with identifier: 1988202
2026-03-27 16:45:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47ee5ded-787b-5355-8883-f3d9d3768629 with scrape type 1
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 47ee5ded-787b-5355-8883-f3d9d3768629
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff53db0ecf4aa45dabcefb8faf530cc81%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/1.jpg not downloaded yet
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590522710>
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1253ecca-c1c1-581f-932b-449542b88e9a/1253ecca-c1c1-581f-932b-449542b88e9a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a90403d416548ac8c63d2cb3b74b744%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/1.jpg saved to cache
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1253ecca-c1c1-581f-932b-449542b88e9a
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ddb0d0>
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1253ecca-c1c1-581f-932b-449542b88e9a/1253ecca-c1c1-581f-932b-449542b88e9a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a90403d416548ac8c63d2cb3b74b744%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/2.jpg saved to cache
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1253ecca-c1c1-581f-932b-449542b88e9a
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592c40410>
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1253ecca-c1c1-581f-932b-449542b88e9a/1253ecca-c1c1-581f-932b-449542b88e9a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a90403d416548ac8c63d2cb3b74b744%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/6.jpg saved to cache
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1253ecca-c1c1-581f-932b-449542b88e9a
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d6d790>
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1253ecca-c1c1-581f-932b-449542b88e9a/1253ecca-c1c1-581f-932b-449542b88e9a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a90403d416548ac8c63d2cb3b74b744%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/5.jpg saved to cache
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1253ecca-c1c1-581f-932b-449542b88e9a
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d74810>
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1253ecca-c1c1-581f-932b-449542b88e9a/1253ecca-c1c1-581f-932b-449542b88e9a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a90403d416548ac8c63d2cb3b74b744%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/7.jpg saved to cache
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1253ecca-c1c1-581f-932b-449542b88e9a
2026-03-27 16:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff53db0ecf4aa45dabcefb8faf530cc81%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/2.jpg not downloaded yet
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911c8f90>
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1253ecca-c1c1-581f-932b-449542b88e9a/1253ecca-c1c1-581f-932b-449542b88e9a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a90403d416548ac8c63d2cb3b74b744%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/8.jpg saved to cache
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1253ecca-c1c1-581f-932b-449542b88e9a
2026-03-27 16:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff53db0ecf4aa45dabcefb8faf530cc81%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/3.jpg not downloaded yet
2026-03-27 16:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff53db0ecf4aa45dabcefb8faf530cc81%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/4.jpg not downloaded yet
2026-03-27 16:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abdf50>
2026-03-27 16:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1253ecca-c1c1-581f-932b-449542b88e9a/1253ecca-c1c1-581f-932b-449542b88e9a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a90403d416548ac8c63d2cb3b74b744%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/4.jpg saved to cache
2026-03-27 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1253ecca-c1c1-581f-932b-449542b88e9a
2026-03-27 16:45:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1253ecca-c1c1-581f-932b-449542b88e9a, skipping ID generation
2026-03-27 16:45:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1253ecca-c1c1-581f-932b-449542b88e9a with scrape type 1
2026-03-27 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1253ecca-c1c1-581f-932b-449542b88e9a sending to next pipeline
2026-03-27 16:45:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1253ecca-c1c1-581f-932b-449542b88e9a, identifier: 1988198
2026-03-27 16:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1253ecca-c1c1-581f-932b-449542b88e9a with identifier: 1988198
2026-03-27 16:45:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:45:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1253ecca-c1c1-581f-932b-449542b88e9a with identifier: 1988198
2026-03-27 16:45:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1253ecca-c1c1-581f-932b-449542b88e9a with identifier: 1988198 to the API
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 23,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '1253ecca-c1c1-581f-932b-449542b88e9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC60',
'odometer': 69700,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1253ecca-c1c1-581f-932b-449542b88e9a/1253ecca-c1c1-581f-932b-449542b88e9a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387669,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1253ecca-c1c1-581f-932b-449542b88e9a/1253ecca-c1c1-581f-932b-449542b88e9a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387669,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1253ecca-c1c1-581f-932b-449542b88e9a/1253ecca-c1c1-581f-932b-449542b88e9a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326944,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1253ecca-c1c1-581f-932b-449542b88e9a/1253ecca-c1c1-581f-932b-449542b88e9a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312793,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1253ecca-c1c1-581f-932b-449542b88e9a/1253ecca-c1c1-581f-932b-449542b88e9a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359504,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1253ecca-c1c1-581f-932b-449542b88e9a/1253ecca-c1c1-581f-932b-449542b88e9a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239801,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1253ecca-c1c1-581f-932b-449542b88e9a/1253ecca-c1c1-581f-932b-449542b88e9a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167165,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1253ecca-c1c1-581f-932b-449542b88e9a/1253ecca-c1c1-581f-932b-449542b88e9a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195383,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/3a90403d416548ac8c63d2cb3b74b744/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-23',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC60 XC60 T6 AWD 253 + 145ch Inscription Business Geartronic',
'transmission': 'automatic',
'trim': 'XC60 T6 AWD 253 + 145ch Inscription Business Geartronic',
'vin': None,
'year': 2022}
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988198%27 HTTP/1.1" 200 None
2026-03-27 16:45:26 [ayvens.fr] INFO: Saving data for 1988198: {'created_time': 1774629926.684754, 'last_price_update_time': 1774629926.684767, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988198') HTTP/1.1" 204 0
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff53db0ecf4aa45dabcefb8faf530cc81%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/5.jpg not downloaded yet
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff53db0ecf4aa45dabcefb8faf530cc81%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/6.jpg not downloaded yet
2026-03-27 16:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911cbf50>
2026-03-27 16:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c38141-79b2-5015-89b9-49e55ab0ea3a/c3c38141-79b2-5015-89b9-49e55ab0ea3a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F20998a02896a451786deca3a1cb89cfb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/4.jpg saved to cache
2026-03-27 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3c38141-79b2-5015-89b9-49e55ab0ea3a
2026-03-27 16:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e8d390>
2026-03-27 16:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c38141-79b2-5015-89b9-49e55ab0ea3a/c3c38141-79b2-5015-89b9-49e55ab0ea3a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F20998a02896a451786deca3a1cb89cfb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/5.jpg saved to cache
2026-03-27 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3c38141-79b2-5015-89b9-49e55ab0ea3a
2026-03-27 16:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fc8790>
2026-03-27 16:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c38141-79b2-5015-89b9-49e55ab0ea3a/c3c38141-79b2-5015-89b9-49e55ab0ea3a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F20998a02896a451786deca3a1cb89cfb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/3.jpg saved to cache
2026-03-27 16:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3c38141-79b2-5015-89b9-49e55ab0ea3a
2026-03-27 16:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591001d50>
2026-03-27 16:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c38141-79b2-5015-89b9-49e55ab0ea3a/c3c38141-79b2-5015-89b9-49e55ab0ea3a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F20998a02896a451786deca3a1cb89cfb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/2.jpg saved to cache
2026-03-27 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3c38141-79b2-5015-89b9-49e55ab0ea3a
2026-03-27 16:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e8d790>
2026-03-27 16:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c38141-79b2-5015-89b9-49e55ab0ea3a/c3c38141-79b2-5015-89b9-49e55ab0ea3a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F20998a02896a451786deca3a1cb89cfb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/8.jpg saved to cache
2026-03-27 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3c38141-79b2-5015-89b9-49e55ab0ea3a
2026-03-27 16:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efead0>
2026-03-27 16:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c38141-79b2-5015-89b9-49e55ab0ea3a/c3c38141-79b2-5015-89b9-49e55ab0ea3a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F20998a02896a451786deca3a1cb89cfb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/6.jpg saved to cache
2026-03-27 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3c38141-79b2-5015-89b9-49e55ab0ea3a
2026-03-27 16:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fc9650>
2026-03-27 16:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c38141-79b2-5015-89b9-49e55ab0ea3a/c3c38141-79b2-5015-89b9-49e55ab0ea3a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F20998a02896a451786deca3a1cb89cfb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/7.jpg saved to cache
2026-03-27 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3c38141-79b2-5015-89b9-49e55ab0ea3a
2026-03-27 16:45:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3c38141-79b2-5015-89b9-49e55ab0ea3a, skipping ID generation
2026-03-27 16:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3c38141-79b2-5015-89b9-49e55ab0ea3a with scrape type 1
2026-03-27 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3c38141-79b2-5015-89b9-49e55ab0ea3a sending to next pipeline
2026-03-27 16:45:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c3c38141-79b2-5015-89b9-49e55ab0ea3a, identifier: 1988199
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff53db0ecf4aa45dabcefb8faf530cc81%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/7.jpg not downloaded yet
2026-03-27 16:45:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c3c38141-79b2-5015-89b9-49e55ab0ea3a with identifier: 1988199
2026-03-27 16:45:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c3c38141-79b2-5015-89b9-49e55ab0ea3a with identifier: 1988199
2026-03-27 16:45:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c3c38141-79b2-5015-89b9-49e55ab0ea3a with identifier: 1988199 to the API
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 55,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'c3c38141-79b2-5015-89b9-49e55ab0ea3a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC60',
'odometer': 100929,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c38141-79b2-5015-89b9-49e55ab0ea3a/c3c38141-79b2-5015-89b9-49e55ab0ea3a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379780,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c38141-79b2-5015-89b9-49e55ab0ea3a/c3c38141-79b2-5015-89b9-49e55ab0ea3a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379780,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c38141-79b2-5015-89b9-49e55ab0ea3a/c3c38141-79b2-5015-89b9-49e55ab0ea3a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349466,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c38141-79b2-5015-89b9-49e55ab0ea3a/c3c38141-79b2-5015-89b9-49e55ab0ea3a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295780,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c38141-79b2-5015-89b9-49e55ab0ea3a/c3c38141-79b2-5015-89b9-49e55ab0ea3a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343253,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c38141-79b2-5015-89b9-49e55ab0ea3a/c3c38141-79b2-5015-89b9-49e55ab0ea3a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261621,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c38141-79b2-5015-89b9-49e55ab0ea3a/c3c38141-79b2-5015-89b9-49e55ab0ea3a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382090,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c38141-79b2-5015-89b9-49e55ab0ea3a/c3c38141-79b2-5015-89b9-49e55ab0ea3a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292668,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/20998a02896a451786deca3a1cb89cfb/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-21',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC60 XC60 T6 AWD 253 + 87ch Business Executive Geartronic',
'transmission': 'automatic',
'trim': 'XC60 T6 AWD 253 + 87ch Business Executive Geartronic',
'vin': None,
'year': 2021}
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988199%27 HTTP/1.1" 200 None
2026-03-27 16:45:27 [ayvens.fr] INFO: Saving data for 1988199: {'created_time': 1774629927.748512, 'last_price_update_time': 1774629927.748524, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988199') HTTP/1.1" 204 0
2026-03-27 16:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff53db0ecf4aa45dabcefb8faf530cc81%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/8.jpg not downloaded yet
2026-03-27 16:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f80610>
2026-03-27 16:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c7449d-e0dd-5316-b46f-593d0b459bea/c8c7449d-e0dd-5316-b46f-593d0b459bea_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6149278d460f4a95ab0e31ebfe268553%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/5.jpg saved to cache
2026-03-27 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8c7449d-e0dd-5316-b46f-593d0b459bea
2026-03-27 16:45:27 [ayvens.fr] INFO: Found listing with ID: 1988203
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988203%27 HTTP/1.1" 200 None
2026-03-27 16:45:27 [ayvens.fr] INFO: Scrape type for 1988203: 1
2026-03-27 16:45:27 [ayvens.fr] INFO: Extracting data for car ID: 1988203
2026-03-27 16:45:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d78772d-19b4-5c9b-842f-333996e37bb7 with identifier: 1988203
2026-03-27 16:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d78772d-19b4-5c9b-842f-333996e37bb7 with scrape type 1
2026-03-27 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 8d78772d-19b4-5c9b-842f-333996e37bb7
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F84af49bd270949e79f48062344bf841c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/1.jpg not downloaded yet
2026-03-27 16:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F84af49bd270949e79f48062344bf841c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/2.jpg not downloaded yet
2026-03-27 16:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc4190>
2026-03-27 16:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6765c5-7b97-5771-9d50-bc1741932bbf/4a6765c5-7b97-5771-9d50-bc1741932bbf_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3bbb89c45dc44daf94a794fe64d2d404%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/4.jpg saved to cache
2026-03-27 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a6765c5-7b97-5771-9d50-bc1741932bbf
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df6390>
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6765c5-7b97-5771-9d50-bc1741932bbf/4a6765c5-7b97-5771-9d50-bc1741932bbf_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3bbb89c45dc44daf94a794fe64d2d404%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/5.jpg saved to cache
2026-03-27 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a6765c5-7b97-5771-9d50-bc1741932bbf
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d81b90>
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6765c5-7b97-5771-9d50-bc1741932bbf/4a6765c5-7b97-5771-9d50-bc1741932bbf_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3bbb89c45dc44daf94a794fe64d2d404%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/3.jpg saved to cache
2026-03-27 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a6765c5-7b97-5771-9d50-bc1741932bbf
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4b1d0>
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6765c5-7b97-5771-9d50-bc1741932bbf/4a6765c5-7b97-5771-9d50-bc1741932bbf_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3bbb89c45dc44daf94a794fe64d2d404%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/2.jpg saved to cache
2026-03-27 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a6765c5-7b97-5771-9d50-bc1741932bbf
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b23190>
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6765c5-7b97-5771-9d50-bc1741932bbf/4a6765c5-7b97-5771-9d50-bc1741932bbf_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3bbb89c45dc44daf94a794fe64d2d404%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/6.jpg saved to cache
2026-03-27 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a6765c5-7b97-5771-9d50-bc1741932bbf
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e16490>
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6765c5-7b97-5771-9d50-bc1741932bbf/4a6765c5-7b97-5771-9d50-bc1741932bbf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3bbb89c45dc44daf94a794fe64d2d404%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/1.jpg saved to cache
2026-03-27 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a6765c5-7b97-5771-9d50-bc1741932bbf
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F84af49bd270949e79f48062344bf841c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/3.jpg not downloaded yet
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F84af49bd270949e79f48062344bf841c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/4.jpg not downloaded yet
2026-03-27 16:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F84af49bd270949e79f48062344bf841c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/5.jpg not downloaded yet
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d58b10>
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6765c5-7b97-5771-9d50-bc1741932bbf/4a6765c5-7b97-5771-9d50-bc1741932bbf_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3bbb89c45dc44daf94a794fe64d2d404%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/7.jpg saved to cache
2026-03-27 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a6765c5-7b97-5771-9d50-bc1741932bbf
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b6bc90>
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6765c5-7b97-5771-9d50-bc1741932bbf/4a6765c5-7b97-5771-9d50-bc1741932bbf_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F3bbb89c45dc44daf94a794fe64d2d404%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/8.jpg saved to cache
2026-03-27 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a6765c5-7b97-5771-9d50-bc1741932bbf
2026-03-27 16:45:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a6765c5-7b97-5771-9d50-bc1741932bbf, skipping ID generation
2026-03-27 16:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a6765c5-7b97-5771-9d50-bc1741932bbf with scrape type 1
2026-03-27 16:45:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a6765c5-7b97-5771-9d50-bc1741932bbf sending to next pipeline
2026-03-27 16:45:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4a6765c5-7b97-5771-9d50-bc1741932bbf, identifier: 1988201
2026-03-27 16:45:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4a6765c5-7b97-5771-9d50-bc1741932bbf with identifier: 1988201
2026-03-27 16:45:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4a6765c5-7b97-5771-9d50-bc1741932bbf with identifier: 1988201
2026-03-27 16:45:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4a6765c5-7b97-5771-9d50-bc1741932bbf with identifier: 1988201 to the API
2026-03-27 16:45:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 23,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '4a6765c5-7b97-5771-9d50-bc1741932bbf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC60',
'odometer': 72997,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6765c5-7b97-5771-9d50-bc1741932bbf/4a6765c5-7b97-5771-9d50-bc1741932bbf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371415,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6765c5-7b97-5771-9d50-bc1741932bbf/4a6765c5-7b97-5771-9d50-bc1741932bbf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371415,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6765c5-7b97-5771-9d50-bc1741932bbf/4a6765c5-7b97-5771-9d50-bc1741932bbf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395118,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6765c5-7b97-5771-9d50-bc1741932bbf/4a6765c5-7b97-5771-9d50-bc1741932bbf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331052,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6765c5-7b97-5771-9d50-bc1741932bbf/4a6765c5-7b97-5771-9d50-bc1741932bbf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330228,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6765c5-7b97-5771-9d50-bc1741932bbf/4a6765c5-7b97-5771-9d50-bc1741932bbf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344172,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6765c5-7b97-5771-9d50-bc1741932bbf/4a6765c5-7b97-5771-9d50-bc1741932bbf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365234,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6765c5-7b97-5771-9d50-bc1741932bbf/4a6765c5-7b97-5771-9d50-bc1741932bbf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375345,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/3bbb89c45dc44daf94a794fe64d2d404/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-10',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC60 XC60 T6 AWD 253 + 145ch Plus Style Dark Geartronic',
'transmission': 'automatic',
'trim': 'XC60 T6 AWD 253 + 145ch Plus Style Dark Geartronic',
'vin': None,
'year': 2023}
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988201%27 HTTP/1.1" 200 None
2026-03-27 16:45:29 [ayvens.fr] INFO: Saving data for 1988201: {'created_time': 1774629929.165191, 'last_price_update_time': 1774629929.165203, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988201') HTTP/1.1" 204 0
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F84af49bd270949e79f48062344bf841c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/6.jpg not downloaded yet
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F84af49bd270949e79f48062344bf841c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/7.jpg not downloaded yet
2026-03-27 16:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d80990>
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c7449d-e0dd-5316-b46f-593d0b459bea/c8c7449d-e0dd-5316-b46f-593d0b459bea_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6149278d460f4a95ab0e31ebfe268553%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/8.jpg saved to cache
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8c7449d-e0dd-5316-b46f-593d0b459bea
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590645890>
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c7449d-e0dd-5316-b46f-593d0b459bea/c8c7449d-e0dd-5316-b46f-593d0b459bea_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6149278d460f4a95ab0e31ebfe268553%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/6.jpg saved to cache
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8c7449d-e0dd-5316-b46f-593d0b459bea
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d95d90>
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c7449d-e0dd-5316-b46f-593d0b459bea/c8c7449d-e0dd-5316-b46f-593d0b459bea_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6149278d460f4a95ab0e31ebfe268553%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/7.jpg saved to cache
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8c7449d-e0dd-5316-b46f-593d0b459bea
2026-03-27 16:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F84af49bd270949e79f48062344bf841c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/8.jpg not downloaded yet
2026-03-27 16:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:29 [ayvens.fr] INFO: Found listing with ID: 1988204
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988204%27 HTTP/1.1" 200 None
2026-03-27 16:45:29 [ayvens.fr] INFO: Scrape type for 1988204: 1
2026-03-27 16:45:29 [ayvens.fr] INFO: Extracting data for car ID: 1988204
2026-03-27 16:45:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2eb1496-e5e0-51cb-976e-dada691719a1 with identifier: 1988204
2026-03-27 16:45:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2eb1496-e5e0-51cb-976e-dada691719a1 with scrape type 1
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f2eb1496-e5e0-51cb-976e-dada691719a1
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fec1f7e0fc7c8426ea5b7b4bc89d62ddc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/1.jpg not downloaded yet
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590512f90>
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ee5ded-787b-5355-8883-f3d9d3768629/47ee5ded-787b-5355-8883-f3d9d3768629_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff53db0ecf4aa45dabcefb8faf530cc81%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/3.jpg saved to cache
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47ee5ded-787b-5355-8883-f3d9d3768629
2026-03-27 16:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fec1f7e0fc7c8426ea5b7b4bc89d62ddc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/2.jpg not downloaded yet
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fec1f7e0fc7c8426ea5b7b4bc89d62ddc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/3.jpg not downloaded yet
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590694390>
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ee5ded-787b-5355-8883-f3d9d3768629/47ee5ded-787b-5355-8883-f3d9d3768629_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff53db0ecf4aa45dabcefb8faf530cc81%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/2.jpg saved to cache
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47ee5ded-787b-5355-8883-f3d9d3768629
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b4bc50>
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ee5ded-787b-5355-8883-f3d9d3768629/47ee5ded-787b-5355-8883-f3d9d3768629_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff53db0ecf4aa45dabcefb8faf530cc81%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/1.jpg saved to cache
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47ee5ded-787b-5355-8883-f3d9d3768629
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd8f50>
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ee5ded-787b-5355-8883-f3d9d3768629/47ee5ded-787b-5355-8883-f3d9d3768629_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff53db0ecf4aa45dabcefb8faf530cc81%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/7.jpg saved to cache
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47ee5ded-787b-5355-8883-f3d9d3768629
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b4b590>
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ee5ded-787b-5355-8883-f3d9d3768629/47ee5ded-787b-5355-8883-f3d9d3768629_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff53db0ecf4aa45dabcefb8faf530cc81%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/6.jpg saved to cache
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47ee5ded-787b-5355-8883-f3d9d3768629
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b51a10>
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ee5ded-787b-5355-8883-f3d9d3768629/47ee5ded-787b-5355-8883-f3d9d3768629_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff53db0ecf4aa45dabcefb8faf530cc81%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/4.jpg saved to cache
2026-03-27 16:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47ee5ded-787b-5355-8883-f3d9d3768629
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591003a90>
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ee5ded-787b-5355-8883-f3d9d3768629/47ee5ded-787b-5355-8883-f3d9d3768629_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff53db0ecf4aa45dabcefb8faf530cc81%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/5.jpg saved to cache
2026-03-27 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47ee5ded-787b-5355-8883-f3d9d3768629
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fec1f7e0fc7c8426ea5b7b4bc89d62ddc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/4.jpg not downloaded yet
2026-03-27 16:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fec1f7e0fc7c8426ea5b7b4bc89d62ddc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/5.jpg not downloaded yet
2026-03-27 16:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fec1f7e0fc7c8426ea5b7b4bc89d62ddc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/6.jpg not downloaded yet
2026-03-27 16:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591183250>
2026-03-27 16:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c7449d-e0dd-5316-b46f-593d0b459bea/c8c7449d-e0dd-5316-b46f-593d0b459bea_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6149278d460f4a95ab0e31ebfe268553%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/4.jpg saved to cache
2026-03-27 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8c7449d-e0dd-5316-b46f-593d0b459bea
2026-03-27 16:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fec1f7e0fc7c8426ea5b7b4bc89d62ddc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/7.jpg not downloaded yet
2026-03-27 16:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fec1f7e0fc7c8426ea5b7b4bc89d62ddc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/8.jpg not downloaded yet
2026-03-27 16:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591180790>
2026-03-27 16:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d78772d-19b4-5c9b-842f-333996e37bb7/8d78772d-19b4-5c9b-842f-333996e37bb7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F84af49bd270949e79f48062344bf841c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/1.jpg saved to cache
2026-03-27 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d78772d-19b4-5c9b-842f-333996e37bb7
2026-03-27 16:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d6d390>
2026-03-27 16:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c7449d-e0dd-5316-b46f-593d0b459bea/c8c7449d-e0dd-5316-b46f-593d0b459bea_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6149278d460f4a95ab0e31ebfe268553%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/1.jpg saved to cache
2026-03-27 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8c7449d-e0dd-5316-b46f-593d0b459bea
2026-03-27 16:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b4a010>
2026-03-27 16:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c7449d-e0dd-5316-b46f-593d0b459bea/c8c7449d-e0dd-5316-b46f-593d0b459bea_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6149278d460f4a95ab0e31ebfe268553%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/2.jpg saved to cache
2026-03-27 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8c7449d-e0dd-5316-b46f-593d0b459bea
2026-03-27 16:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051a4d0>
2026-03-27 16:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c7449d-e0dd-5316-b46f-593d0b459bea/c8c7449d-e0dd-5316-b46f-593d0b459bea_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F6149278d460f4a95ab0e31ebfe268553%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/3.jpg saved to cache
2026-03-27 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8c7449d-e0dd-5316-b46f-593d0b459bea
2026-03-27 16:45:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8c7449d-e0dd-5316-b46f-593d0b459bea, skipping ID generation
2026-03-27 16:45:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8c7449d-e0dd-5316-b46f-593d0b459bea with scrape type 1
2026-03-27 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8c7449d-e0dd-5316-b46f-593d0b459bea sending to next pipeline
2026-03-27 16:45:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c8c7449d-e0dd-5316-b46f-593d0b459bea, identifier: 1988200
2026-03-27 16:45:30 [ayvens.fr] INFO: Found listing with ID: 1988205
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988205%27 HTTP/1.1" 200 None
2026-03-27 16:45:30 [ayvens.fr] INFO: Scrape type for 1988205: 1
2026-03-27 16:45:30 [ayvens.fr] INFO: Extracting data for car ID: 1988205
2026-03-27 16:45:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4551bb48-dc5b-5db2-87ce-e0e5be22b9ca with identifier: 1988205
2026-03-27 16:45:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4551bb48-dc5b-5db2-87ce-e0e5be22b9ca with scrape type 1
2026-03-27 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4551bb48-dc5b-5db2-87ce-e0e5be22b9ca
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70f8744720dd4d1f80ae01b6d8a8403c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/1.jpg not downloaded yet
2026-03-27 16:45:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c8c7449d-e0dd-5316-b46f-593d0b459bea with identifier: 1988200
2026-03-27 16:45:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:45:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c8c7449d-e0dd-5316-b46f-593d0b459bea with identifier: 1988200
2026-03-27 16:45:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c8c7449d-e0dd-5316-b46f-593d0b459bea with identifier: 1988200 to the API
2026-03-27 16:45:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 18,
'color': 'GRIS PEBBLE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'c8c7449d-e0dd-5316-b46f-593d0b459bea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'V60',
'odometer': 125651,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c7449d-e0dd-5316-b46f-593d0b459bea/c8c7449d-e0dd-5316-b46f-593d0b459bea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518434,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c7449d-e0dd-5316-b46f-593d0b459bea/c8c7449d-e0dd-5316-b46f-593d0b459bea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518434,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c7449d-e0dd-5316-b46f-593d0b459bea/c8c7449d-e0dd-5316-b46f-593d0b459bea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556066,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c7449d-e0dd-5316-b46f-593d0b459bea/c8c7449d-e0dd-5316-b46f-593d0b459bea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406591,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c7449d-e0dd-5316-b46f-593d0b459bea/c8c7449d-e0dd-5316-b46f-593d0b459bea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330556,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c7449d-e0dd-5316-b46f-593d0b459bea/c8c7449d-e0dd-5316-b46f-593d0b459bea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304106,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c7449d-e0dd-5316-b46f-593d0b459bea/c8c7449d-e0dd-5316-b46f-593d0b459bea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205923,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c7449d-e0dd-5316-b46f-593d0b459bea/c8c7449d-e0dd-5316-b46f-593d0b459bea_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252714,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/6149278d460f4a95ab0e31ebfe268553/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-21',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO V60 V60 T6 AWD 253+87ch Inscription Business Geartronic 8',
'transmission': 'automatic',
'trim': 'V60 T6 AWD 253+87ch Inscription Business Geartronic 8',
'vin': None,
'year': 2022}
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988200%27 HTTP/1.1" 200 None
2026-03-27 16:45:31 [ayvens.fr] INFO: Saving data for 1988200: {'created_time': 1774629931.340512, 'last_price_update_time': 1774629931.340526, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988200') HTTP/1.1" 204 0
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70f8744720dd4d1f80ae01b6d8a8403c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/2.jpg not downloaded yet
2026-03-27 16:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70f8744720dd4d1f80ae01b6d8a8403c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/3.jpg not downloaded yet
2026-03-27 16:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905936d0>
2026-03-27 16:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47ee5ded-787b-5355-8883-f3d9d3768629/47ee5ded-787b-5355-8883-f3d9d3768629_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Ff53db0ecf4aa45dabcefb8faf530cc81%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/8.jpg saved to cache
2026-03-27 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47ee5ded-787b-5355-8883-f3d9d3768629
2026-03-27 16:45:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47ee5ded-787b-5355-8883-f3d9d3768629, skipping ID generation
2026-03-27 16:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47ee5ded-787b-5355-8883-f3d9d3768629 with scrape type 1
2026-03-27 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47ee5ded-787b-5355-8883-f3d9d3768629 sending to next pipeline
2026-03-27 16:45:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 47ee5ded-787b-5355-8883-f3d9d3768629, identifier: 1988202
2026-03-27 16:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911141d0>
2026-03-27 16:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d78772d-19b4-5c9b-842f-333996e37bb7/8d78772d-19b4-5c9b-842f-333996e37bb7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F84af49bd270949e79f48062344bf841c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/3.jpg saved to cache
2026-03-27 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d78772d-19b4-5c9b-842f-333996e37bb7
2026-03-27 16:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591480e50>
2026-03-27 16:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d78772d-19b4-5c9b-842f-333996e37bb7/8d78772d-19b4-5c9b-842f-333996e37bb7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F84af49bd270949e79f48062344bf841c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/4.jpg saved to cache
2026-03-27 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d78772d-19b4-5c9b-842f-333996e37bb7
2026-03-27 16:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591114b10>
2026-03-27 16:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d78772d-19b4-5c9b-842f-333996e37bb7/8d78772d-19b4-5c9b-842f-333996e37bb7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F84af49bd270949e79f48062344bf841c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/2.jpg saved to cache
2026-03-27 16:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d78772d-19b4-5c9b-842f-333996e37bb7
2026-03-27 16:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 47ee5ded-787b-5355-8883-f3d9d3768629 with identifier: 1988202
2026-03-27 16:45:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 47ee5ded-787b-5355-8883-f3d9d3768629 with identifier: 1988202
2026-03-27 16:45:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 47ee5ded-787b-5355-8883-f3d9d3768629 with identifier: 1988202 to the API
2026-03-27 16:45:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 47,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '47ee5ded-787b-5355-8883-f3d9d3768629',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC40',
'odometer': 93180,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ee5ded-787b-5355-8883-f3d9d3768629/47ee5ded-787b-5355-8883-f3d9d3768629_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 595849,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ee5ded-787b-5355-8883-f3d9d3768629/47ee5ded-787b-5355-8883-f3d9d3768629_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 595849,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ee5ded-787b-5355-8883-f3d9d3768629/47ee5ded-787b-5355-8883-f3d9d3768629_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523980,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ee5ded-787b-5355-8883-f3d9d3768629/47ee5ded-787b-5355-8883-f3d9d3768629_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429121,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ee5ded-787b-5355-8883-f3d9d3768629/47ee5ded-787b-5355-8883-f3d9d3768629_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409813,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ee5ded-787b-5355-8883-f3d9d3768629/47ee5ded-787b-5355-8883-f3d9d3768629_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315099,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ee5ded-787b-5355-8883-f3d9d3768629/47ee5ded-787b-5355-8883-f3d9d3768629_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256263,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47ee5ded-787b-5355-8883-f3d9d3768629/47ee5ded-787b-5355-8883-f3d9d3768629_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311202,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/f53db0ecf4aa45dabcefb8faf530cc81/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-20',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC40 XC40 T4 Recharge 129 + 82ch Start DCT 7',
'transmission': 'automatic',
'trim': 'XC40 T4 Recharge 129 + 82ch Start DCT 7',
'vin': None,
'year': 2023}
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988202%27 HTTP/1.1" 200 None
2026-03-27 16:45:32 [ayvens.fr] INFO: Saving data for 1988202: {'created_time': 1774629932.307732, 'last_price_update_time': 1774629932.307745, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988202') HTTP/1.1" 204 0
2026-03-27 16:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70f8744720dd4d1f80ae01b6d8a8403c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/4.jpg not downloaded yet
2026-03-27 16:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc6d10>
2026-03-27 16:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d78772d-19b4-5c9b-842f-333996e37bb7/8d78772d-19b4-5c9b-842f-333996e37bb7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F84af49bd270949e79f48062344bf841c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/6.jpg saved to cache
2026-03-27 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d78772d-19b4-5c9b-842f-333996e37bb7
2026-03-27 16:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70f8744720dd4d1f80ae01b6d8a8403c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/5.jpg not downloaded yet
2026-03-27 16:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efc890>
2026-03-27 16:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d78772d-19b4-5c9b-842f-333996e37bb7/8d78772d-19b4-5c9b-842f-333996e37bb7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F84af49bd270949e79f48062344bf841c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/5.jpg saved to cache
2026-03-27 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d78772d-19b4-5c9b-842f-333996e37bb7
2026-03-27 16:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590aea010>
2026-03-27 16:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d78772d-19b4-5c9b-842f-333996e37bb7/8d78772d-19b4-5c9b-842f-333996e37bb7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F84af49bd270949e79f48062344bf841c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/7.jpg saved to cache
2026-03-27 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d78772d-19b4-5c9b-842f-333996e37bb7
2026-03-27 16:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590519d90>
2026-03-27 16:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d78772d-19b4-5c9b-842f-333996e37bb7/8d78772d-19b4-5c9b-842f-333996e37bb7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F84af49bd270949e79f48062344bf841c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/8.jpg saved to cache
2026-03-27 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d78772d-19b4-5c9b-842f-333996e37bb7
2026-03-27 16:45:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d78772d-19b4-5c9b-842f-333996e37bb7, skipping ID generation
2026-03-27 16:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d78772d-19b4-5c9b-842f-333996e37bb7 with scrape type 1
2026-03-27 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d78772d-19b4-5c9b-842f-333996e37bb7 sending to next pipeline
2026-03-27 16:45:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8d78772d-19b4-5c9b-842f-333996e37bb7, identifier: 1988203
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70f8744720dd4d1f80ae01b6d8a8403c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/6.jpg not downloaded yet
2026-03-27 16:45:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8d78772d-19b4-5c9b-842f-333996e37bb7 with identifier: 1988203
2026-03-27 16:45:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8d78772d-19b4-5c9b-842f-333996e37bb7 with identifier: 1988203
2026-03-27 16:45:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8d78772d-19b4-5c9b-842f-333996e37bb7 with identifier: 1988203 to the API
2026-03-27 16:45:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 47,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '8d78772d-19b4-5c9b-842f-333996e37bb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC40',
'odometer': 92312,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d78772d-19b4-5c9b-842f-333996e37bb7/8d78772d-19b4-5c9b-842f-333996e37bb7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397083,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d78772d-19b4-5c9b-842f-333996e37bb7/8d78772d-19b4-5c9b-842f-333996e37bb7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397083,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d78772d-19b4-5c9b-842f-333996e37bb7/8d78772d-19b4-5c9b-842f-333996e37bb7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306479,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d78772d-19b4-5c9b-842f-333996e37bb7/8d78772d-19b4-5c9b-842f-333996e37bb7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338588,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d78772d-19b4-5c9b-842f-333996e37bb7/8d78772d-19b4-5c9b-842f-333996e37bb7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299098,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d78772d-19b4-5c9b-842f-333996e37bb7/8d78772d-19b4-5c9b-842f-333996e37bb7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d78772d-19b4-5c9b-842f-333996e37bb7/8d78772d-19b4-5c9b-842f-333996e37bb7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284003,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d78772d-19b4-5c9b-842f-333996e37bb7/8d78772d-19b4-5c9b-842f-333996e37bb7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281474,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/84af49bd270949e79f48062344bf841c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-04',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC40 XC40 T4 Recharge 129 + 82ch Start DCT 7',
'transmission': 'automatic',
'trim': 'XC40 T4 Recharge 129 + 82ch Start DCT 7',
'vin': None,
'year': 2022}
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988203%27 HTTP/1.1" 200 None
2026-03-27 16:45:33 [ayvens.fr] INFO: Saving data for 1988203: {'created_time': 1774629933.225496, 'last_price_update_time': 1774629933.225508, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988203') HTTP/1.1" 204 0
2026-03-27 16:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70f8744720dd4d1f80ae01b6d8a8403c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/7.jpg not downloaded yet
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b747d0>
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2eb1496-e5e0-51cb-976e-dada691719a1/f2eb1496-e5e0-51cb-976e-dada691719a1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fec1f7e0fc7c8426ea5b7b4bc89d62ddc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/4.jpg saved to cache
2026-03-27 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2eb1496-e5e0-51cb-976e-dada691719a1
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f80bd0>
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2eb1496-e5e0-51cb-976e-dada691719a1/f2eb1496-e5e0-51cb-976e-dada691719a1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fec1f7e0fc7c8426ea5b7b4bc89d62ddc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/3.jpg saved to cache
2026-03-27 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2eb1496-e5e0-51cb-976e-dada691719a1
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de7f90>
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2eb1496-e5e0-51cb-976e-dada691719a1/f2eb1496-e5e0-51cb-976e-dada691719a1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fec1f7e0fc7c8426ea5b7b4bc89d62ddc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/1.jpg saved to cache
2026-03-27 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2eb1496-e5e0-51cb-976e-dada691719a1
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f81950>
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2eb1496-e5e0-51cb-976e-dada691719a1/f2eb1496-e5e0-51cb-976e-dada691719a1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fec1f7e0fc7c8426ea5b7b4bc89d62ddc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/2.jpg saved to cache
2026-03-27 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2eb1496-e5e0-51cb-976e-dada691719a1
2026-03-27 16:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70f8744720dd4d1f80ae01b6d8a8403c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/8.jpg not downloaded yet
2026-03-27 16:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:33 [ayvens.fr] INFO: Found listing with ID: 1988206
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988206%27 HTTP/1.1" 200 None
2026-03-27 16:45:33 [ayvens.fr] INFO: Scrape type for 1988206: 1
2026-03-27 16:45:33 [ayvens.fr] INFO: Extracting data for car ID: 1988206
2026-03-27 16:45:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 798a2d38-e4d0-5e36-b32d-5fcdeb68adee with identifier: 1988206
2026-03-27 16:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798a2d38-e4d0-5e36-b32d-5fcdeb68adee with scrape type 1
2026-03-27 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 798a2d38-e4d0-5e36-b32d-5fcdeb68adee
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc827d07c76074b53aee52e4aa5e32e9d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/1.jpg not downloaded yet
2026-03-27 16:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590645150>
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2eb1496-e5e0-51cb-976e-dada691719a1/f2eb1496-e5e0-51cb-976e-dada691719a1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fec1f7e0fc7c8426ea5b7b4bc89d62ddc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/5.jpg saved to cache
2026-03-27 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2eb1496-e5e0-51cb-976e-dada691719a1
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc827d07c76074b53aee52e4aa5e32e9d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/2.jpg not downloaded yet
2026-03-27 16:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc827d07c76074b53aee52e4aa5e32e9d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/3.jpg not downloaded yet
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905172d0>
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2eb1496-e5e0-51cb-976e-dada691719a1/f2eb1496-e5e0-51cb-976e-dada691719a1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fec1f7e0fc7c8426ea5b7b4bc89d62ddc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/6.jpg saved to cache
2026-03-27 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2eb1496-e5e0-51cb-976e-dada691719a1
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590db8690>
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2eb1496-e5e0-51cb-976e-dada691719a1/f2eb1496-e5e0-51cb-976e-dada691719a1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fec1f7e0fc7c8426ea5b7b4bc89d62ddc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/7.jpg saved to cache
2026-03-27 16:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f2eb1496-e5e0-51cb-976e-dada691719a1
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065d490>
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2eb1496-e5e0-51cb-976e-dada691719a1/f2eb1496-e5e0-51cb-976e-dada691719a1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fec1f7e0fc7c8426ea5b7b4bc89d62ddc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/8.jpg saved to cache
2026-03-27 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2eb1496-e5e0-51cb-976e-dada691719a1
2026-03-27 16:45:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2eb1496-e5e0-51cb-976e-dada691719a1, skipping ID generation
2026-03-27 16:45:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2eb1496-e5e0-51cb-976e-dada691719a1 with scrape type 1
2026-03-27 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2eb1496-e5e0-51cb-976e-dada691719a1 sending to next pipeline
2026-03-27 16:45:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f2eb1496-e5e0-51cb-976e-dada691719a1, identifier: 1988204
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dffc50>
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4551bb48-dc5b-5db2-87ce-e0e5be22b9ca/4551bb48-dc5b-5db2-87ce-e0e5be22b9ca_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70f8744720dd4d1f80ae01b6d8a8403c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/1.jpg saved to cache
2026-03-27 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4551bb48-dc5b-5db2-87ce-e0e5be22b9ca
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5914318d0>
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4551bb48-dc5b-5db2-87ce-e0e5be22b9ca/4551bb48-dc5b-5db2-87ce-e0e5be22b9ca_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70f8744720dd4d1f80ae01b6d8a8403c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/2.jpg saved to cache
2026-03-27 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4551bb48-dc5b-5db2-87ce-e0e5be22b9ca
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dad3d0>
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4551bb48-dc5b-5db2-87ce-e0e5be22b9ca/4551bb48-dc5b-5db2-87ce-e0e5be22b9ca_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70f8744720dd4d1f80ae01b6d8a8403c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/3.jpg saved to cache
2026-03-27 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4551bb48-dc5b-5db2-87ce-e0e5be22b9ca
2026-03-27 16:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc827d07c76074b53aee52e4aa5e32e9d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/4.jpg not downloaded yet
2026-03-27 16:45:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f2eb1496-e5e0-51cb-976e-dada691719a1 with identifier: 1988204
2026-03-27 16:45:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f2eb1496-e5e0-51cb-976e-dada691719a1 with identifier: 1988204
2026-03-27 16:45:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f2eb1496-e5e0-51cb-976e-dada691719a1 with identifier: 1988204 to the API
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 23,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'f2eb1496-e5e0-51cb-976e-dada691719a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC60',
'odometer': 50811,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2eb1496-e5e0-51cb-976e-dada691719a1/f2eb1496-e5e0-51cb-976e-dada691719a1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 463068,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2eb1496-e5e0-51cb-976e-dada691719a1/f2eb1496-e5e0-51cb-976e-dada691719a1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 463068,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2eb1496-e5e0-51cb-976e-dada691719a1/f2eb1496-e5e0-51cb-976e-dada691719a1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361056,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2eb1496-e5e0-51cb-976e-dada691719a1/f2eb1496-e5e0-51cb-976e-dada691719a1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336052,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2eb1496-e5e0-51cb-976e-dada691719a1/f2eb1496-e5e0-51cb-976e-dada691719a1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316725,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2eb1496-e5e0-51cb-976e-dada691719a1/f2eb1496-e5e0-51cb-976e-dada691719a1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317946,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2eb1496-e5e0-51cb-976e-dada691719a1/f2eb1496-e5e0-51cb-976e-dada691719a1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263865,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2eb1496-e5e0-51cb-976e-dada691719a1/f2eb1496-e5e0-51cb-976e-dada691719a1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277525,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/ec1f7e0fc7c8426ea5b7b4bc89d62ddc/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-09',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC60 XC60 T6 AWD 253 + 145ch Start Geartronic',
'transmission': 'automatic',
'trim': 'XC60 T6 AWD 253 + 145ch Start Geartronic',
'vin': None,
'year': 2022}
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988204%27 HTTP/1.1" 200 None
2026-03-27 16:45:34 [ayvens.fr] INFO: Saving data for 1988204: {'created_time': 1774629934.732424, 'last_price_update_time': 1774629934.732437, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988204') HTTP/1.1" 204 0
2026-03-27 16:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc827d07c76074b53aee52e4aa5e32e9d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/5.jpg not downloaded yet
2026-03-27 16:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b047d0>
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4551bb48-dc5b-5db2-87ce-e0e5be22b9ca/4551bb48-dc5b-5db2-87ce-e0e5be22b9ca_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70f8744720dd4d1f80ae01b6d8a8403c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/4.jpg saved to cache
2026-03-27 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4551bb48-dc5b-5db2-87ce-e0e5be22b9ca
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa32d0>
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4551bb48-dc5b-5db2-87ce-e0e5be22b9ca/4551bb48-dc5b-5db2-87ce-e0e5be22b9ca_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70f8744720dd4d1f80ae01b6d8a8403c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/5.jpg saved to cache
2026-03-27 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4551bb48-dc5b-5db2-87ce-e0e5be22b9ca
2026-03-27 16:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc827d07c76074b53aee52e4aa5e32e9d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/6.jpg not downloaded yet
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc827d07c76074b53aee52e4aa5e32e9d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/7.jpg not downloaded yet
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f81510>
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4551bb48-dc5b-5db2-87ce-e0e5be22b9ca/4551bb48-dc5b-5db2-87ce-e0e5be22b9ca_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70f8744720dd4d1f80ae01b6d8a8403c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/7.jpg saved to cache
2026-03-27 16:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4551bb48-dc5b-5db2-87ce-e0e5be22b9ca
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c8cd0>
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4551bb48-dc5b-5db2-87ce-e0e5be22b9ca/4551bb48-dc5b-5db2-87ce-e0e5be22b9ca_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70f8744720dd4d1f80ae01b6d8a8403c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/8.jpg saved to cache
2026-03-27 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4551bb48-dc5b-5db2-87ce-e0e5be22b9ca
2026-03-27 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc827d07c76074b53aee52e4aa5e32e9d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/8.jpg not downloaded yet
2026-03-27 16:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b4ab50>
2026-03-27 16:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4551bb48-dc5b-5db2-87ce-e0e5be22b9ca/4551bb48-dc5b-5db2-87ce-e0e5be22b9ca_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70f8744720dd4d1f80ae01b6d8a8403c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/6.jpg saved to cache
2026-03-27 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4551bb48-dc5b-5db2-87ce-e0e5be22b9ca
2026-03-27 16:45:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4551bb48-dc5b-5db2-87ce-e0e5be22b9ca, skipping ID generation
2026-03-27 16:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4551bb48-dc5b-5db2-87ce-e0e5be22b9ca with scrape type 1
2026-03-27 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4551bb48-dc5b-5db2-87ce-e0e5be22b9ca sending to next pipeline
2026-03-27 16:45:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4551bb48-dc5b-5db2-87ce-e0e5be22b9ca, identifier: 1988205
2026-03-27 16:45:35 [ayvens.fr] INFO: Found listing with ID: 1988207
2026-03-27 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988207%27 HTTP/1.1" 200 None
2026-03-27 16:45:35 [ayvens.fr] INFO: Scrape type for 1988207: 1
2026-03-27 16:45:35 [ayvens.fr] INFO: Extracting data for car ID: 1988207
2026-03-27 16:45:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49ab857b-3548-558a-8c2b-4dccaed5e70b with identifier: 1988207
2026-03-27 16:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49ab857b-3548-558a-8c2b-4dccaed5e70b with scrape type 1
2026-03-27 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 49ab857b-3548-558a-8c2b-4dccaed5e70b
2026-03-27 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F33f5e6f6f7b3495bbd2ef760680722db%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/1.jpg not downloaded yet
2026-03-27 16:45:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4551bb48-dc5b-5db2-87ce-e0e5be22b9ca with identifier: 1988205
2026-03-27 16:45:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:45:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4551bb48-dc5b-5db2-87ce-e0e5be22b9ca with identifier: 1988205
2026-03-27 16:45:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4551bb48-dc5b-5db2-87ce-e0e5be22b9ca with identifier: 1988205 to the API
2026-03-27 16:45:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 50,
'color': 'ROUGE FUSION',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '4551bb48-dc5b-5db2-87ce-e0e5be22b9ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC40',
'odometer': 9163,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4551bb48-dc5b-5db2-87ce-e0e5be22b9ca/4551bb48-dc5b-5db2-87ce-e0e5be22b9ca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386133,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4551bb48-dc5b-5db2-87ce-e0e5be22b9ca/4551bb48-dc5b-5db2-87ce-e0e5be22b9ca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386133,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4551bb48-dc5b-5db2-87ce-e0e5be22b9ca/4551bb48-dc5b-5db2-87ce-e0e5be22b9ca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412084,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4551bb48-dc5b-5db2-87ce-e0e5be22b9ca/4551bb48-dc5b-5db2-87ce-e0e5be22b9ca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468897,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4551bb48-dc5b-5db2-87ce-e0e5be22b9ca/4551bb48-dc5b-5db2-87ce-e0e5be22b9ca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317465,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4551bb48-dc5b-5db2-87ce-e0e5be22b9ca/4551bb48-dc5b-5db2-87ce-e0e5be22b9ca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362414,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4551bb48-dc5b-5db2-87ce-e0e5be22b9ca/4551bb48-dc5b-5db2-87ce-e0e5be22b9ca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277824,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4551bb48-dc5b-5db2-87ce-e0e5be22b9ca/4551bb48-dc5b-5db2-87ce-e0e5be22b9ca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186585,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/70f8744720dd4d1f80ae01b6d8a8403c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC40 XC40 T5 Recharge 180 + 82ch Ultimate DCT 7',
'transmission': 'automatic',
'trim': 'XC40 T5 Recharge 180 + 82ch Ultimate DCT 7',
'vin': None,
'year': 2022}
2026-03-27 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988205%27 HTTP/1.1" 200 None
2026-03-27 16:45:35 [ayvens.fr] INFO: Saving data for 1988205: {'created_time': 1774629935.985564, 'last_price_update_time': 1774629935.98558, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988205') HTTP/1.1" 204 0
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F33f5e6f6f7b3495bbd2ef760680722db%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/2.jpg not downloaded yet
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9fc50>
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798a2d38-e4d0-5e36-b32d-5fcdeb68adee/798a2d38-e4d0-5e36-b32d-5fcdeb68adee_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc827d07c76074b53aee52e4aa5e32e9d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/1.jpg saved to cache
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 798a2d38-e4d0-5e36-b32d-5fcdeb68adee
2026-03-27 16:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F33f5e6f6f7b3495bbd2ef760680722db%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/3.jpg not downloaded yet
2026-03-27 16:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F33f5e6f6f7b3495bbd2ef760680722db%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/4.jpg not downloaded yet
2026-03-27 16:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F33f5e6f6f7b3495bbd2ef760680722db%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/5.jpg not downloaded yet
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F33f5e6f6f7b3495bbd2ef760680722db%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/6.jpg not downloaded yet
2026-03-27 16:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F33f5e6f6f7b3495bbd2ef760680722db%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/7.jpg not downloaded yet
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F33f5e6f6f7b3495bbd2ef760680722db%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/8.jpg not downloaded yet
2026-03-27 16:45:36 [ayvens.fr] INFO: Found listing with ID: 1988208
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988208%27 HTTP/1.1" 200 None
2026-03-27 16:45:36 [ayvens.fr] INFO: Scrape type for 1988208: 1
2026-03-27 16:45:36 [ayvens.fr] INFO: Extracting data for car ID: 1988208
2026-03-27 16:45:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edebd350-6bb5-5db5-abed-b6f798fc471d with identifier: 1988208
2026-03-27 16:45:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edebd350-6bb5-5db5-abed-b6f798fc471d with scrape type 1
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item edebd350-6bb5-5db5-abed-b6f798fc471d
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F48a183b9d94a4d93832469ea492d216a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/1.jpg not downloaded yet
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df72d0>
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798a2d38-e4d0-5e36-b32d-5fcdeb68adee/798a2d38-e4d0-5e36-b32d-5fcdeb68adee_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc827d07c76074b53aee52e4aa5e32e9d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/5.jpg saved to cache
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 798a2d38-e4d0-5e36-b32d-5fcdeb68adee
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F48a183b9d94a4d93832469ea492d216a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/2.jpg not downloaded yet
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59069fcd0>
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798a2d38-e4d0-5e36-b32d-5fcdeb68adee/798a2d38-e4d0-5e36-b32d-5fcdeb68adee_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc827d07c76074b53aee52e4aa5e32e9d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/3.jpg saved to cache
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 798a2d38-e4d0-5e36-b32d-5fcdeb68adee
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59308c4d0>
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798a2d38-e4d0-5e36-b32d-5fcdeb68adee/798a2d38-e4d0-5e36-b32d-5fcdeb68adee_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc827d07c76074b53aee52e4aa5e32e9d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/4.jpg saved to cache
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 798a2d38-e4d0-5e36-b32d-5fcdeb68adee
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f80e10>
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798a2d38-e4d0-5e36-b32d-5fcdeb68adee/798a2d38-e4d0-5e36-b32d-5fcdeb68adee_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc827d07c76074b53aee52e4aa5e32e9d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/6.jpg saved to cache
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 798a2d38-e4d0-5e36-b32d-5fcdeb68adee
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d0f50>
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798a2d38-e4d0-5e36-b32d-5fcdeb68adee/798a2d38-e4d0-5e36-b32d-5fcdeb68adee_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc827d07c76074b53aee52e4aa5e32e9d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/2.jpg saved to cache
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 798a2d38-e4d0-5e36-b32d-5fcdeb68adee
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050e710>
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798a2d38-e4d0-5e36-b32d-5fcdeb68adee/798a2d38-e4d0-5e36-b32d-5fcdeb68adee_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc827d07c76074b53aee52e4aa5e32e9d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/8.jpg saved to cache
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 798a2d38-e4d0-5e36-b32d-5fcdeb68adee
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F48a183b9d94a4d93832469ea492d216a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/3.jpg not downloaded yet
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b585d0>
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798a2d38-e4d0-5e36-b32d-5fcdeb68adee/798a2d38-e4d0-5e36-b32d-5fcdeb68adee_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fc827d07c76074b53aee52e4aa5e32e9d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/7.jpg saved to cache
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 798a2d38-e4d0-5e36-b32d-5fcdeb68adee
2026-03-27 16:45:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 798a2d38-e4d0-5e36-b32d-5fcdeb68adee, skipping ID generation
2026-03-27 16:45:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798a2d38-e4d0-5e36-b32d-5fcdeb68adee with scrape type 1
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 798a2d38-e4d0-5e36-b32d-5fcdeb68adee sending to next pipeline
2026-03-27 16:45:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 798a2d38-e4d0-5e36-b32d-5fcdeb68adee, identifier: 1988206
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F48a183b9d94a4d93832469ea492d216a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/4.jpg not downloaded yet
2026-03-27 16:45:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 798a2d38-e4d0-5e36-b32d-5fcdeb68adee with identifier: 1988206
2026-03-27 16:45:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:45:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 798a2d38-e4d0-5e36-b32d-5fcdeb68adee with identifier: 1988206
2026-03-27 16:45:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 798a2d38-e4d0-5e36-b32d-5fcdeb68adee with identifier: 1988206 to the API
2026-03-27 16:45:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '798a2d38-e4d0-5e36-b32d-5fcdeb68adee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'MUSTANG MACH-E',
'odometer': 64771,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798a2d38-e4d0-5e36-b32d-5fcdeb68adee/798a2d38-e4d0-5e36-b32d-5fcdeb68adee_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585053,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798a2d38-e4d0-5e36-b32d-5fcdeb68adee/798a2d38-e4d0-5e36-b32d-5fcdeb68adee_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585053,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798a2d38-e4d0-5e36-b32d-5fcdeb68adee/798a2d38-e4d0-5e36-b32d-5fcdeb68adee_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 530315,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798a2d38-e4d0-5e36-b32d-5fcdeb68adee/798a2d38-e4d0-5e36-b32d-5fcdeb68adee_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386775,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798a2d38-e4d0-5e36-b32d-5fcdeb68adee/798a2d38-e4d0-5e36-b32d-5fcdeb68adee_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348414,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798a2d38-e4d0-5e36-b32d-5fcdeb68adee/798a2d38-e4d0-5e36-b32d-5fcdeb68adee_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291860,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798a2d38-e4d0-5e36-b32d-5fcdeb68adee/798a2d38-e4d0-5e36-b32d-5fcdeb68adee_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334859,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798a2d38-e4d0-5e36-b32d-5fcdeb68adee/798a2d38-e4d0-5e36-b32d-5fcdeb68adee_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 241249,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/c827d07c76074b53aee52e4aa5e32e9d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'FORD MUSTANG MACH-E Mustang Mach-E 269ch Standard Range 72,6kWh '
'Mach-E Propulsion',
'transmission': 'automatic',
'trim': 'Mustang Mach-E 269ch Standard Range 72,6kWh Mach-E Propulsion',
'vin': None,
'year': 2024}
2026-03-27 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988206%27 HTTP/1.1" 200 None
2026-03-27 16:45:37 [ayvens.fr] INFO: Saving data for 1988206: {'created_time': 1774629937.835207, 'last_price_update_time': 1774629937.835219, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988206') HTTP/1.1" 204 0
2026-03-27 16:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F48a183b9d94a4d93832469ea492d216a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/5.jpg not downloaded yet
2026-03-27 16:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F48a183b9d94a4d93832469ea492d216a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/6.jpg not downloaded yet
2026-03-27 16:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F48a183b9d94a4d93832469ea492d216a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/7.jpg not downloaded yet
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F48a183b9d94a4d93832469ea492d216a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/8.jpg not downloaded yet
2026-03-27 16:45:38 [ayvens.fr] INFO: Found listing with ID: 1988209
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988209%27 HTTP/1.1" 200 None
2026-03-27 16:45:38 [ayvens.fr] INFO: Scrape type for 1988209: 1
2026-03-27 16:45:38 [ayvens.fr] INFO: Extracting data for car ID: 1988209
2026-03-27 16:45:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a27c7015-3e20-5d1e-88ca-295bfd105d35 with identifier: 1988209
2026-03-27 16:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a27c7015-3e20-5d1e-88ca-295bfd105d35 with scrape type 1
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a27c7015-3e20-5d1e-88ca-295bfd105d35
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F4f839de0ef0f4bcbb8f298f0276277f9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/1.jpg not downloaded yet
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F4f839de0ef0f4bcbb8f298f0276277f9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/2.jpg not downloaded yet
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b5a810>
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ab857b-3548-558a-8c2b-4dccaed5e70b/49ab857b-3548-558a-8c2b-4dccaed5e70b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F33f5e6f6f7b3495bbd2ef760680722db%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/4.jpg saved to cache
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49ab857b-3548-558a-8c2b-4dccaed5e70b
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efdc90>
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ab857b-3548-558a-8c2b-4dccaed5e70b/49ab857b-3548-558a-8c2b-4dccaed5e70b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F33f5e6f6f7b3495bbd2ef760680722db%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/1.jpg saved to cache
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49ab857b-3548-558a-8c2b-4dccaed5e70b
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e55d0>
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ab857b-3548-558a-8c2b-4dccaed5e70b/49ab857b-3548-558a-8c2b-4dccaed5e70b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F33f5e6f6f7b3495bbd2ef760680722db%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/2.jpg saved to cache
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49ab857b-3548-558a-8c2b-4dccaed5e70b
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abc050>
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ab857b-3548-558a-8c2b-4dccaed5e70b/49ab857b-3548-558a-8c2b-4dccaed5e70b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F33f5e6f6f7b3495bbd2ef760680722db%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/5.jpg saved to cache
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49ab857b-3548-558a-8c2b-4dccaed5e70b
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b6a450>
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ab857b-3548-558a-8c2b-4dccaed5e70b/49ab857b-3548-558a-8c2b-4dccaed5e70b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F33f5e6f6f7b3495bbd2ef760680722db%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/6.jpg saved to cache
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 49ab857b-3548-558a-8c2b-4dccaed5e70b
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe3650>
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ab857b-3548-558a-8c2b-4dccaed5e70b/49ab857b-3548-558a-8c2b-4dccaed5e70b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F33f5e6f6f7b3495bbd2ef760680722db%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/3.jpg saved to cache
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49ab857b-3548-558a-8c2b-4dccaed5e70b
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ad68d0>
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ab857b-3548-558a-8c2b-4dccaed5e70b/49ab857b-3548-558a-8c2b-4dccaed5e70b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F33f5e6f6f7b3495bbd2ef760680722db%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/7.jpg saved to cache
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 49ab857b-3548-558a-8c2b-4dccaed5e70b
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F4f839de0ef0f4bcbb8f298f0276277f9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/3.jpg not downloaded yet
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3ae10>
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ab857b-3548-558a-8c2b-4dccaed5e70b/49ab857b-3548-558a-8c2b-4dccaed5e70b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F33f5e6f6f7b3495bbd2ef760680722db%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/8.jpg saved to cache
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 49ab857b-3548-558a-8c2b-4dccaed5e70b
2026-03-27 16:45:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49ab857b-3548-558a-8c2b-4dccaed5e70b, skipping ID generation
2026-03-27 16:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49ab857b-3548-558a-8c2b-4dccaed5e70b with scrape type 1
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49ab857b-3548-558a-8c2b-4dccaed5e70b sending to next pipeline
2026-03-27 16:45:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 49ab857b-3548-558a-8c2b-4dccaed5e70b, identifier: 1988207
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F4f839de0ef0f4bcbb8f298f0276277f9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/4.jpg not downloaded yet
2026-03-27 16:45:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 49ab857b-3548-558a-8c2b-4dccaed5e70b with identifier: 1988207
2026-03-27 16:45:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:45:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:45:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 49ab857b-3548-558a-8c2b-4dccaed5e70b with identifier: 1988207
2026-03-27 16:45:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 49ab857b-3548-558a-8c2b-4dccaed5e70b with identifier: 1988207 to the API
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '49ab857b-3548-558a-8c2b-4dccaed5e70b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '508',
'odometer': 51005,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49ab857b-3548-558a-8c2b-4dccaed5e70b/49ab857b-3548-558a-8c2b-4dccaed5e70b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420192,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49ab857b-3548-558a-8c2b-4dccaed5e70b/49ab857b-3548-558a-8c2b-4dccaed5e70b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420192,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49ab857b-3548-558a-8c2b-4dccaed5e70b/49ab857b-3548-558a-8c2b-4dccaed5e70b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403052,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49ab857b-3548-558a-8c2b-4dccaed5e70b/49ab857b-3548-558a-8c2b-4dccaed5e70b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301090,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49ab857b-3548-558a-8c2b-4dccaed5e70b/49ab857b-3548-558a-8c2b-4dccaed5e70b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381476,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49ab857b-3548-558a-8c2b-4dccaed5e70b/49ab857b-3548-558a-8c2b-4dccaed5e70b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353047,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49ab857b-3548-558a-8c2b-4dccaed5e70b/49ab857b-3548-558a-8c2b-4dccaed5e70b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331456,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49ab857b-3548-558a-8c2b-4dccaed5e70b/49ab857b-3548-558a-8c2b-4dccaed5e70b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 475655,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/33f5e6f6f7b3495bbd2ef760680722db/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-10',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 508 508 SW BlueHDi 130ch S&S Allure Business EAT8',
'transmission': 'automatic',
'trim': '508 SW BlueHDi 130ch S&S Allure Business EAT8',
'vin': None,
'year': 2021}
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988207%27 HTTP/1.1" 200 None
2026-03-27 16:45:39 [ayvens.fr] INFO: Saving data for 1988207: {'created_time': 1774629939.363411, 'last_price_update_time': 1774629939.363422, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988207') HTTP/1.1" 204 0
2026-03-27 16:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F4f839de0ef0f4bcbb8f298f0276277f9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/5.jpg not downloaded yet
2026-03-27 16:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F4f839de0ef0f4bcbb8f298f0276277f9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/6.jpg not downloaded yet
2026-03-27 16:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F4f839de0ef0f4bcbb8f298f0276277f9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/7.jpg not downloaded yet
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F4f839de0ef0f4bcbb8f298f0276277f9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/8.jpg not downloaded yet
2026-03-27 16:45:39 [ayvens.fr] INFO: Found listing with ID: 1988210
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988210%27 HTTP/1.1" 200 None
2026-03-27 16:45:39 [ayvens.fr] INFO: Scrape type for 1988210: 1
2026-03-27 16:45:39 [ayvens.fr] INFO: Extracting data for car ID: 1988210
2026-03-27 16:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19d518bb-c723-54d8-a318-d1e14085b495 with identifier: 1988210
2026-03-27 16:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19d518bb-c723-54d8-a318-d1e14085b495 with scrape type 1
2026-03-27 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 19d518bb-c723-54d8-a318-d1e14085b495
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F585bdb2cca074183b9814b48b90c5529%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/1.jpg not downloaded yet
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F585bdb2cca074183b9814b48b90c5529%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/2.jpg not downloaded yet
2026-03-27 16:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d80210>
2026-03-27 16:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edebd350-6bb5-5db5-abed-b6f798fc471d/edebd350-6bb5-5db5-abed-b6f798fc471d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F48a183b9d94a4d93832469ea492d216a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/4.jpg saved to cache
2026-03-27 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item edebd350-6bb5-5db5-abed-b6f798fc471d
2026-03-27 16:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd1cd0>
2026-03-27 16:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edebd350-6bb5-5db5-abed-b6f798fc471d/edebd350-6bb5-5db5-abed-b6f798fc471d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F48a183b9d94a4d93832469ea492d216a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/2.jpg saved to cache
2026-03-27 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item edebd350-6bb5-5db5-abed-b6f798fc471d
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F585bdb2cca074183b9814b48b90c5529%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/3.jpg not downloaded yet
2026-03-27 16:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a0d50>
2026-03-27 16:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edebd350-6bb5-5db5-abed-b6f798fc471d/edebd350-6bb5-5db5-abed-b6f798fc471d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F48a183b9d94a4d93832469ea492d216a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/3.jpg saved to cache
2026-03-27 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item edebd350-6bb5-5db5-abed-b6f798fc471d
2026-03-27 16:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F585bdb2cca074183b9814b48b90c5529%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/4.jpg not downloaded yet
2026-03-27 16:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066c190>
2026-03-27 16:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edebd350-6bb5-5db5-abed-b6f798fc471d/edebd350-6bb5-5db5-abed-b6f798fc471d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F48a183b9d94a4d93832469ea492d216a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/1.jpg saved to cache
2026-03-27 16:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item edebd350-6bb5-5db5-abed-b6f798fc471d
2026-03-27 16:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b48290>
2026-03-27 16:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edebd350-6bb5-5db5-abed-b6f798fc471d/edebd350-6bb5-5db5-abed-b6f798fc471d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F48a183b9d94a4d93832469ea492d216a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/6.jpg saved to cache
2026-03-27 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item edebd350-6bb5-5db5-abed-b6f798fc471d
2026-03-27 16:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae9250>
2026-03-27 16:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edebd350-6bb5-5db5-abed-b6f798fc471d/edebd350-6bb5-5db5-abed-b6f798fc471d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F48a183b9d94a4d93832469ea492d216a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/5.jpg saved to cache
2026-03-27 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item edebd350-6bb5-5db5-abed-b6f798fc471d
2026-03-27 16:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590514bd0>
2026-03-27 16:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edebd350-6bb5-5db5-abed-b6f798fc471d/edebd350-6bb5-5db5-abed-b6f798fc471d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F48a183b9d94a4d93832469ea492d216a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/7.jpg saved to cache
2026-03-27 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item edebd350-6bb5-5db5-abed-b6f798fc471d
2026-03-27 16:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592c3b210>
2026-03-27 16:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edebd350-6bb5-5db5-abed-b6f798fc471d/edebd350-6bb5-5db5-abed-b6f798fc471d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F48a183b9d94a4d93832469ea492d216a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/8.jpg saved to cache
2026-03-27 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item edebd350-6bb5-5db5-abed-b6f798fc471d
2026-03-27 16:45:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: edebd350-6bb5-5db5-abed-b6f798fc471d, skipping ID generation
2026-03-27 16:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edebd350-6bb5-5db5-abed-b6f798fc471d with scrape type 1
2026-03-27 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item edebd350-6bb5-5db5-abed-b6f798fc471d sending to next pipeline
2026-03-27 16:45:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: edebd350-6bb5-5db5-abed-b6f798fc471d, identifier: 1988208
2026-03-27 16:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: edebd350-6bb5-5db5-abed-b6f798fc471d with identifier: 1988208
2026-03-27 16:45:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:45:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:45:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: edebd350-6bb5-5db5-abed-b6f798fc471d with identifier: 1988208
2026-03-27 16:45:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: edebd350-6bb5-5db5-abed-b6f798fc471d with identifier: 1988208 to the API
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'NOIR AGATHE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'edebd350-6bb5-5db5-abed-b6f798fc471d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'PUMA',
'odometer': 35507,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edebd350-6bb5-5db5-abed-b6f798fc471d/edebd350-6bb5-5db5-abed-b6f798fc471d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307380,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edebd350-6bb5-5db5-abed-b6f798fc471d/edebd350-6bb5-5db5-abed-b6f798fc471d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307380,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edebd350-6bb5-5db5-abed-b6f798fc471d/edebd350-6bb5-5db5-abed-b6f798fc471d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329479,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edebd350-6bb5-5db5-abed-b6f798fc471d/edebd350-6bb5-5db5-abed-b6f798fc471d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319720,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edebd350-6bb5-5db5-abed-b6f798fc471d/edebd350-6bb5-5db5-abed-b6f798fc471d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edebd350-6bb5-5db5-abed-b6f798fc471d/edebd350-6bb5-5db5-abed-b6f798fc471d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356477,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edebd350-6bb5-5db5-abed-b6f798fc471d/edebd350-6bb5-5db5-abed-b6f798fc471d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389055,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edebd350-6bb5-5db5-abed-b6f798fc471d/edebd350-6bb5-5db5-abed-b6f798fc471d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425906,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/48a183b9d94a4d93832469ea492d216a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-12',
'seats_number': 5,
'seller_name': None,
'title': 'FORD PUMA Puma 1.0 EcoBoost 125ch S&S mHEV ST-Line X Powershift',
'transmission': 'automatic',
'trim': 'Puma 1.0 EcoBoost 125ch S&S mHEV ST-Line X Powershift',
'vin': None,
'year': 2023}
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988208%27 HTTP/1.1" 200 None
2026-03-27 16:45:40 [ayvens.fr] INFO: Saving data for 1988208: {'created_time': 1774629940.770305, 'last_price_update_time': 1774629940.770316, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988208') HTTP/1.1" 204 0
2026-03-27 16:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F585bdb2cca074183b9814b48b90c5529%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/5.jpg not downloaded yet
2026-03-27 16:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590529750>
2026-03-27 16:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27c7015-3e20-5d1e-88ca-295bfd105d35/a27c7015-3e20-5d1e-88ca-295bfd105d35_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F4f839de0ef0f4bcbb8f298f0276277f9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/2.jpg saved to cache
2026-03-27 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a27c7015-3e20-5d1e-88ca-295bfd105d35
2026-03-27 16:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F585bdb2cca074183b9814b48b90c5529%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/6.jpg not downloaded yet
2026-03-27 16:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e16b50>
2026-03-27 16:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27c7015-3e20-5d1e-88ca-295bfd105d35/a27c7015-3e20-5d1e-88ca-295bfd105d35_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F4f839de0ef0f4bcbb8f298f0276277f9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/1.jpg saved to cache
2026-03-27 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a27c7015-3e20-5d1e-88ca-295bfd105d35
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F585bdb2cca074183b9814b48b90c5529%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/7.jpg not downloaded yet
2026-03-27 16:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F585bdb2cca074183b9814b48b90c5529%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/8.jpg not downloaded yet
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592ff0b10>
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27c7015-3e20-5d1e-88ca-295bfd105d35/a27c7015-3e20-5d1e-88ca-295bfd105d35_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F4f839de0ef0f4bcbb8f298f0276277f9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/7.jpg saved to cache
2026-03-27 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a27c7015-3e20-5d1e-88ca-295bfd105d35
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f83250>
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27c7015-3e20-5d1e-88ca-295bfd105d35/a27c7015-3e20-5d1e-88ca-295bfd105d35_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F4f839de0ef0f4bcbb8f298f0276277f9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/3.jpg saved to cache
2026-03-27 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a27c7015-3e20-5d1e-88ca-295bfd105d35
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae3d50>
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27c7015-3e20-5d1e-88ca-295bfd105d35/a27c7015-3e20-5d1e-88ca-295bfd105d35_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F4f839de0ef0f4bcbb8f298f0276277f9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/4.jpg saved to cache
2026-03-27 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a27c7015-3e20-5d1e-88ca-295bfd105d35
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59317ac50>
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27c7015-3e20-5d1e-88ca-295bfd105d35/a27c7015-3e20-5d1e-88ca-295bfd105d35_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F4f839de0ef0f4bcbb8f298f0276277f9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/5.jpg saved to cache
2026-03-27 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a27c7015-3e20-5d1e-88ca-295bfd105d35
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae1d90>
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27c7015-3e20-5d1e-88ca-295bfd105d35/a27c7015-3e20-5d1e-88ca-295bfd105d35_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F4f839de0ef0f4bcbb8f298f0276277f9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/8.jpg saved to cache
2026-03-27 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a27c7015-3e20-5d1e-88ca-295bfd105d35
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f807d0>
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27c7015-3e20-5d1e-88ca-295bfd105d35/a27c7015-3e20-5d1e-88ca-295bfd105d35_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F4f839de0ef0f4bcbb8f298f0276277f9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/6.jpg saved to cache
2026-03-27 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a27c7015-3e20-5d1e-88ca-295bfd105d35
2026-03-27 16:45:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a27c7015-3e20-5d1e-88ca-295bfd105d35, skipping ID generation
2026-03-27 16:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a27c7015-3e20-5d1e-88ca-295bfd105d35 with scrape type 1
2026-03-27 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a27c7015-3e20-5d1e-88ca-295bfd105d35 sending to next pipeline
2026-03-27 16:45:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a27c7015-3e20-5d1e-88ca-295bfd105d35, identifier: 1988209
2026-03-27 16:45:41 [ayvens.fr] INFO: Found listing with ID: 1988211
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988211%27 HTTP/1.1" 200 None
2026-03-27 16:45:41 [ayvens.fr] INFO: Scrape type for 1988211: 1
2026-03-27 16:45:41 [ayvens.fr] INFO: Extracting data for car ID: 1988211
2026-03-27 16:45:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9154a34-fe20-538c-b509-7ba8a44118a7 with identifier: 1988211
2026-03-27 16:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9154a34-fe20-538c-b509-7ba8a44118a7 with scrape type 1
2026-03-27 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a9154a34-fe20-538c-b509-7ba8a44118a7
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fc87e6c27d90646ac99b0c30464006b57%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/1.jpg not downloaded yet
2026-03-27 16:45:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a27c7015-3e20-5d1e-88ca-295bfd105d35 with identifier: 1988209
2026-03-27 16:45:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:45:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a27c7015-3e20-5d1e-88ca-295bfd105d35 with identifier: 1988209
2026-03-27 16:45:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a27c7015-3e20-5d1e-88ca-295bfd105d35 with identifier: 1988209 to the API
2026-03-27 16:45:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 128,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'a27c7015-3e20-5d1e-88ca-295bfd105d35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 57594,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27c7015-3e20-5d1e-88ca-295bfd105d35/a27c7015-3e20-5d1e-88ca-295bfd105d35_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298721,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27c7015-3e20-5d1e-88ca-295bfd105d35/a27c7015-3e20-5d1e-88ca-295bfd105d35_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298721,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27c7015-3e20-5d1e-88ca-295bfd105d35/a27c7015-3e20-5d1e-88ca-295bfd105d35_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303275,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27c7015-3e20-5d1e-88ca-295bfd105d35/a27c7015-3e20-5d1e-88ca-295bfd105d35_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285824,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27c7015-3e20-5d1e-88ca-295bfd105d35/a27c7015-3e20-5d1e-88ca-295bfd105d35_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342272,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27c7015-3e20-5d1e-88ca-295bfd105d35/a27c7015-3e20-5d1e-88ca-295bfd105d35_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332011,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27c7015-3e20-5d1e-88ca-295bfd105d35/a27c7015-3e20-5d1e-88ca-295bfd105d35_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309630,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27c7015-3e20-5d1e-88ca-295bfd105d35/a27c7015-3e20-5d1e-88ca-295bfd105d35_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377603,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/4f839de0ef0f4bcbb8f298f0276277f9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-15',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.6 PureTech 180ch S&S GT Line EAT8',
'transmission': 'automatic',
'trim': '3008 1.6 PureTech 180ch S&S GT Line EAT8',
'vin': None,
'year': 2018}
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988209%27 HTTP/1.1" 200 None
2026-03-27 16:45:42 [ayvens.fr] INFO: Saving data for 1988209: {'created_time': 1774629942.732759, 'last_price_update_time': 1774629942.732772, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988209') HTTP/1.1" 204 0
2026-03-27 16:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fc87e6c27d90646ac99b0c30464006b57%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/2.jpg not downloaded yet
2026-03-27 16:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfe010>
2026-03-27 16:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d518bb-c723-54d8-a318-d1e14085b495/19d518bb-c723-54d8-a318-d1e14085b495_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F585bdb2cca074183b9814b48b90c5529%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/1.jpg saved to cache
2026-03-27 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19d518bb-c723-54d8-a318-d1e14085b495
2026-03-27 16:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fc87e6c27d90646ac99b0c30464006b57%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/3.jpg not downloaded yet
2026-03-27 16:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fc87e6c27d90646ac99b0c30464006b57%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/4.jpg not downloaded yet
2026-03-27 16:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fc87e6c27d90646ac99b0c30464006b57%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/5.jpg not downloaded yet
2026-03-27 16:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa09d0>
2026-03-27 16:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d518bb-c723-54d8-a318-d1e14085b495/19d518bb-c723-54d8-a318-d1e14085b495_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F585bdb2cca074183b9814b48b90c5529%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/2.jpg saved to cache
2026-03-27 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 19d518bb-c723-54d8-a318-d1e14085b495
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fc87e6c27d90646ac99b0c30464006b57%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/6.jpg not downloaded yet
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fc87e6c27d90646ac99b0c30464006b57%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/7.jpg not downloaded yet
2026-03-27 16:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590db91d0>
2026-03-27 16:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d518bb-c723-54d8-a318-d1e14085b495/19d518bb-c723-54d8-a318-d1e14085b495_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F585bdb2cca074183b9814b48b90c5529%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/3.jpg saved to cache
2026-03-27 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 19d518bb-c723-54d8-a318-d1e14085b495
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b511d0>
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d518bb-c723-54d8-a318-d1e14085b495/19d518bb-c723-54d8-a318-d1e14085b495_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F585bdb2cca074183b9814b48b90c5529%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/4.jpg saved to cache
2026-03-27 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 19d518bb-c723-54d8-a318-d1e14085b495
2026-03-27 16:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591051ed0>
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d518bb-c723-54d8-a318-d1e14085b495/19d518bb-c723-54d8-a318-d1e14085b495_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F585bdb2cca074183b9814b48b90c5529%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/6.jpg saved to cache
2026-03-27 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 19d518bb-c723-54d8-a318-d1e14085b495
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051bd50>
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d518bb-c723-54d8-a318-d1e14085b495/19d518bb-c723-54d8-a318-d1e14085b495_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F585bdb2cca074183b9814b48b90c5529%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/5.jpg saved to cache
2026-03-27 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 19d518bb-c723-54d8-a318-d1e14085b495
2026-03-27 16:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fc87e6c27d90646ac99b0c30464006b57%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/8.jpg not downloaded yet
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590af1dd0>
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d518bb-c723-54d8-a318-d1e14085b495/19d518bb-c723-54d8-a318-d1e14085b495_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F585bdb2cca074183b9814b48b90c5529%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/7.jpg saved to cache
2026-03-27 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 19d518bb-c723-54d8-a318-d1e14085b495
2026-03-27 16:45:43 [ayvens.fr] INFO: Found listing with ID: 1988212
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988212%27 HTTP/1.1" 200 None
2026-03-27 16:45:43 [ayvens.fr] INFO: Scrape type for 1988212: 1
2026-03-27 16:45:43 [ayvens.fr] INFO: Extracting data for car ID: 1988212
2026-03-27 16:45:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21033bbe-5b6f-53cc-8b31-fcedd19d7c2d with identifier: 1988212
2026-03-27 16:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21033bbe-5b6f-53cc-8b31-fcedd19d7c2d with scrape type 1
2026-03-27 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 21033bbe-5b6f-53cc-8b31-fcedd19d7c2d
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F32c017f3ab7d4b1e9aff5ec0f5861ca9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/1.jpg not downloaded yet
2026-03-27 16:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591444150>
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d518bb-c723-54d8-a318-d1e14085b495/19d518bb-c723-54d8-a318-d1e14085b495_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F585bdb2cca074183b9814b48b90c5529%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/8.jpg saved to cache
2026-03-27 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 19d518bb-c723-54d8-a318-d1e14085b495
2026-03-27 16:45:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19d518bb-c723-54d8-a318-d1e14085b495, skipping ID generation
2026-03-27 16:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19d518bb-c723-54d8-a318-d1e14085b495 with scrape type 1
2026-03-27 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19d518bb-c723-54d8-a318-d1e14085b495 sending to next pipeline
2026-03-27 16:45:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 19d518bb-c723-54d8-a318-d1e14085b495, identifier: 1988210
2026-03-27 16:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F32c017f3ab7d4b1e9aff5ec0f5861ca9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/2.jpg not downloaded yet
2026-03-27 16:45:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 19d518bb-c723-54d8-a318-d1e14085b495 with identifier: 1988210
2026-03-27 16:45:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:45:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 19d518bb-c723-54d8-a318-d1e14085b495 with identifier: 1988210
2026-03-27 16:45:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 19d518bb-c723-54d8-a318-d1e14085b495 with identifier: 1988210 to the API
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'GRIS PERLE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '19d518bb-c723-54d8-a318-d1e14085b495',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'CEED',
'odometer': 15959,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d518bb-c723-54d8-a318-d1e14085b495/19d518bb-c723-54d8-a318-d1e14085b495_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299793,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d518bb-c723-54d8-a318-d1e14085b495/19d518bb-c723-54d8-a318-d1e14085b495_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299793,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d518bb-c723-54d8-a318-d1e14085b495/19d518bb-c723-54d8-a318-d1e14085b495_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327202,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d518bb-c723-54d8-a318-d1e14085b495/19d518bb-c723-54d8-a318-d1e14085b495_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279574,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d518bb-c723-54d8-a318-d1e14085b495/19d518bb-c723-54d8-a318-d1e14085b495_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374602,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d518bb-c723-54d8-a318-d1e14085b495/19d518bb-c723-54d8-a318-d1e14085b495_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323071,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d518bb-c723-54d8-a318-d1e14085b495/19d518bb-c723-54d8-a318-d1e14085b495_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326153,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d518bb-c723-54d8-a318-d1e14085b495/19d518bb-c723-54d8-a318-d1e14085b495_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302470,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/585bdb2cca074183b9814b48b90c5529/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-08-07',
'seats_number': 5,
'seller_name': None,
'title': 'KIA CEED Ceed 1.5 T-GDi 140ch GT Line DCT',
'transmission': 'automatic',
'trim': 'Ceed 1.5 T-GDi 140ch GT Line DCT',
'vin': None,
'year': 2024}
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988210%27 HTTP/1.1" 200 None
2026-03-27 16:45:43 [ayvens.fr] INFO: Saving data for 1988210: {'created_time': 1774629943.965953, 'last_price_update_time': 1774629943.965964, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988210') HTTP/1.1" 204 0
2026-03-27 16:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd2e90>
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9154a34-fe20-538c-b509-7ba8a44118a7/a9154a34-fe20-538c-b509-7ba8a44118a7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fc87e6c27d90646ac99b0c30464006b57%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/1.jpg saved to cache
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9154a34-fe20-538c-b509-7ba8a44118a7
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F32c017f3ab7d4b1e9aff5ec0f5861ca9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/3.jpg not downloaded yet
2026-03-27 16:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590675e10>
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9154a34-fe20-538c-b509-7ba8a44118a7/a9154a34-fe20-538c-b509-7ba8a44118a7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fc87e6c27d90646ac99b0c30464006b57%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/3.jpg saved to cache
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9154a34-fe20-538c-b509-7ba8a44118a7
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592872810>
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9154a34-fe20-538c-b509-7ba8a44118a7/a9154a34-fe20-538c-b509-7ba8a44118a7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fc87e6c27d90646ac99b0c30464006b57%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/4.jpg saved to cache
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9154a34-fe20-538c-b509-7ba8a44118a7
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590591210>
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9154a34-fe20-538c-b509-7ba8a44118a7/a9154a34-fe20-538c-b509-7ba8a44118a7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fc87e6c27d90646ac99b0c30464006b57%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/2.jpg saved to cache
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9154a34-fe20-538c-b509-7ba8a44118a7
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F32c017f3ab7d4b1e9aff5ec0f5861ca9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/4.jpg not downloaded yet
2026-03-27 16:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F32c017f3ab7d4b1e9aff5ec0f5861ca9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/5.jpg not downloaded yet
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b49a50>
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9154a34-fe20-538c-b509-7ba8a44118a7/a9154a34-fe20-538c-b509-7ba8a44118a7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fc87e6c27d90646ac99b0c30464006b57%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/5.jpg saved to cache
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9154a34-fe20-538c-b509-7ba8a44118a7
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b5b610>
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9154a34-fe20-538c-b509-7ba8a44118a7/a9154a34-fe20-538c-b509-7ba8a44118a7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fc87e6c27d90646ac99b0c30464006b57%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/6.jpg saved to cache
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9154a34-fe20-538c-b509-7ba8a44118a7
2026-03-27 16:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F32c017f3ab7d4b1e9aff5ec0f5861ca9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/6.jpg not downloaded yet
2026-03-27 16:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F32c017f3ab7d4b1e9aff5ec0f5861ca9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/7.jpg not downloaded yet
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b1510>
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9154a34-fe20-538c-b509-7ba8a44118a7/a9154a34-fe20-538c-b509-7ba8a44118a7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fc87e6c27d90646ac99b0c30464006b57%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/7.jpg saved to cache
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9154a34-fe20-538c-b509-7ba8a44118a7
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F32c017f3ab7d4b1e9aff5ec0f5861ca9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/8.jpg not downloaded yet
2026-03-27 16:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:44 [ayvens.fr] INFO: Found listing with ID: 1988213
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988213%27 HTTP/1.1" 200 None
2026-03-27 16:45:44 [ayvens.fr] INFO: Scrape type for 1988213: 1
2026-03-27 16:45:44 [ayvens.fr] INFO: Extracting data for car ID: 1988213
2026-03-27 16:45:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d5d6aa6-0b83-5ca5-a384-10aa6201648b with identifier: 1988213
2026-03-27 16:45:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d5d6aa6-0b83-5ca5-a384-10aa6201648b with scrape type 1
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7d5d6aa6-0b83-5ca5-a384-10aa6201648b
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F57611db5891249eab5b2e4dde9c415fb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/1.jpg not downloaded yet
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590516bd0>
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9154a34-fe20-538c-b509-7ba8a44118a7/a9154a34-fe20-538c-b509-7ba8a44118a7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fc87e6c27d90646ac99b0c30464006b57%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/8.jpg saved to cache
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9154a34-fe20-538c-b509-7ba8a44118a7
2026-03-27 16:45:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9154a34-fe20-538c-b509-7ba8a44118a7, skipping ID generation
2026-03-27 16:45:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9154a34-fe20-538c-b509-7ba8a44118a7 with scrape type 1
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9154a34-fe20-538c-b509-7ba8a44118a7 sending to next pipeline
2026-03-27 16:45:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a9154a34-fe20-538c-b509-7ba8a44118a7, identifier: 1988211
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b882d0>
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21033bbe-5b6f-53cc-8b31-fcedd19d7c2d/21033bbe-5b6f-53cc-8b31-fcedd19d7c2d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F32c017f3ab7d4b1e9aff5ec0f5861ca9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/1.jpg saved to cache
2026-03-27 16:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21033bbe-5b6f-53cc-8b31-fcedd19d7c2d
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F57611db5891249eab5b2e4dde9c415fb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/2.jpg not downloaded yet
2026-03-27 16:45:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a9154a34-fe20-538c-b509-7ba8a44118a7 with identifier: 1988211
2026-03-27 16:45:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:45:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a9154a34-fe20-538c-b509-7ba8a44118a7 with identifier: 1988211
2026-03-27 16:45:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a9154a34-fe20-538c-b509-7ba8a44118a7 with identifier: 1988211 to the API
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'NOIR ETOIL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': 'a9154a34-fe20-538c-b509-7ba8a44118a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE E-TECH',
'odometer': 95691,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9154a34-fe20-538c-b509-7ba8a44118a7/a9154a34-fe20-538c-b509-7ba8a44118a7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303737,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9154a34-fe20-538c-b509-7ba8a44118a7/a9154a34-fe20-538c-b509-7ba8a44118a7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303737,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9154a34-fe20-538c-b509-7ba8a44118a7/a9154a34-fe20-538c-b509-7ba8a44118a7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310133,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9154a34-fe20-538c-b509-7ba8a44118a7/a9154a34-fe20-538c-b509-7ba8a44118a7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210905,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9154a34-fe20-538c-b509-7ba8a44118a7/a9154a34-fe20-538c-b509-7ba8a44118a7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327801,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9154a34-fe20-538c-b509-7ba8a44118a7/a9154a34-fe20-538c-b509-7ba8a44118a7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305361,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9154a34-fe20-538c-b509-7ba8a44118a7/a9154a34-fe20-538c-b509-7ba8a44118a7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289935,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9154a34-fe20-538c-b509-7ba8a44118a7/a9154a34-fe20-538c-b509-7ba8a44118a7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404409,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/c87e6c27d90646ac99b0c30464006b57/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-18',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE E-TECH Megane E-Tech Electric EV60 130ch Evolution '
'ER optimum charge',
'transmission': 'automatic',
'trim': 'Megane E-Tech Electric EV60 130ch Evolution ER optimum charge',
'vin': None,
'year': 2023}
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988211%27 HTTP/1.1" 200 None
2026-03-27 16:45:45 [ayvens.fr] INFO: Saving data for 1988211: {'created_time': 1774629945.482219, 'last_price_update_time': 1774629945.482232, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988211') HTTP/1.1" 204 0
2026-03-27 16:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F57611db5891249eab5b2e4dde9c415fb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/3.jpg not downloaded yet
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5928730d0>
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21033bbe-5b6f-53cc-8b31-fcedd19d7c2d/21033bbe-5b6f-53cc-8b31-fcedd19d7c2d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F32c017f3ab7d4b1e9aff5ec0f5861ca9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/2.jpg saved to cache
2026-03-27 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21033bbe-5b6f-53cc-8b31-fcedd19d7c2d
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590eff5d0>
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21033bbe-5b6f-53cc-8b31-fcedd19d7c2d/21033bbe-5b6f-53cc-8b31-fcedd19d7c2d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F32c017f3ab7d4b1e9aff5ec0f5861ca9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/3.jpg saved to cache
2026-03-27 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21033bbe-5b6f-53cc-8b31-fcedd19d7c2d
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F57611db5891249eab5b2e4dde9c415fb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/4.jpg not downloaded yet
2026-03-27 16:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F57611db5891249eab5b2e4dde9c415fb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/5.jpg not downloaded yet
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590db8490>
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21033bbe-5b6f-53cc-8b31-fcedd19d7c2d/21033bbe-5b6f-53cc-8b31-fcedd19d7c2d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F32c017f3ab7d4b1e9aff5ec0f5861ca9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/4.jpg saved to cache
2026-03-27 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21033bbe-5b6f-53cc-8b31-fcedd19d7c2d
2026-03-27 16:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F57611db5891249eab5b2e4dde9c415fb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/6.jpg not downloaded yet
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F57611db5891249eab5b2e4dde9c415fb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/7.jpg not downloaded yet
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590515210>
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21033bbe-5b6f-53cc-8b31-fcedd19d7c2d/21033bbe-5b6f-53cc-8b31-fcedd19d7c2d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F32c017f3ab7d4b1e9aff5ec0f5861ca9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/5.jpg saved to cache
2026-03-27 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21033bbe-5b6f-53cc-8b31-fcedd19d7c2d
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa0290>
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21033bbe-5b6f-53cc-8b31-fcedd19d7c2d/21033bbe-5b6f-53cc-8b31-fcedd19d7c2d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F32c017f3ab7d4b1e9aff5ec0f5861ca9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/6.jpg saved to cache
2026-03-27 16:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21033bbe-5b6f-53cc-8b31-fcedd19d7c2d
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5914459d0>
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21033bbe-5b6f-53cc-8b31-fcedd19d7c2d/21033bbe-5b6f-53cc-8b31-fcedd19d7c2d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F32c017f3ab7d4b1e9aff5ec0f5861ca9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/7.jpg saved to cache
2026-03-27 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21033bbe-5b6f-53cc-8b31-fcedd19d7c2d
2026-03-27 16:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F57611db5891249eab5b2e4dde9c415fb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/8.jpg not downloaded yet
2026-03-27 16:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d95f50>
2026-03-27 16:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21033bbe-5b6f-53cc-8b31-fcedd19d7c2d/21033bbe-5b6f-53cc-8b31-fcedd19d7c2d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F32c017f3ab7d4b1e9aff5ec0f5861ca9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/8.jpg saved to cache
2026-03-27 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21033bbe-5b6f-53cc-8b31-fcedd19d7c2d
2026-03-27 16:45:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21033bbe-5b6f-53cc-8b31-fcedd19d7c2d, skipping ID generation
2026-03-27 16:45:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21033bbe-5b6f-53cc-8b31-fcedd19d7c2d with scrape type 1
2026-03-27 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21033bbe-5b6f-53cc-8b31-fcedd19d7c2d sending to next pipeline
2026-03-27 16:45:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 21033bbe-5b6f-53cc-8b31-fcedd19d7c2d, identifier: 1988212
2026-03-27 16:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:46 [ayvens.fr] INFO: Found listing with ID: 1988214
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988214%27 HTTP/1.1" 200 None
2026-03-27 16:45:46 [ayvens.fr] INFO: Scrape type for 1988214: 1
2026-03-27 16:45:46 [ayvens.fr] INFO: Extracting data for car ID: 1988214
2026-03-27 16:45:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b04398fa-e6ed-5384-b930-cf997f1495c3 with identifier: 1988214
2026-03-27 16:45:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b04398fa-e6ed-5384-b930-cf997f1495c3 with scrape type 1
2026-03-27 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b04398fa-e6ed-5384-b930-cf997f1495c3
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1bd4252709534546b924966f32c427bf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/1.jpg not downloaded yet
2026-03-27 16:45:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 21033bbe-5b6f-53cc-8b31-fcedd19d7c2d with identifier: 1988212
2026-03-27 16:45:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 21033bbe-5b6f-53cc-8b31-fcedd19d7c2d with identifier: 1988212
2026-03-27 16:45:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 21033bbe-5b6f-53cc-8b31-fcedd19d7c2d with identifier: 1988212 to the API
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '21033bbe-5b6f-53cc-8b31-fcedd19d7c2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'I20',
'odometer': 24132,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21033bbe-5b6f-53cc-8b31-fcedd19d7c2d/21033bbe-5b6f-53cc-8b31-fcedd19d7c2d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280272,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21033bbe-5b6f-53cc-8b31-fcedd19d7c2d/21033bbe-5b6f-53cc-8b31-fcedd19d7c2d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280272,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21033bbe-5b6f-53cc-8b31-fcedd19d7c2d/21033bbe-5b6f-53cc-8b31-fcedd19d7c2d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265805,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21033bbe-5b6f-53cc-8b31-fcedd19d7c2d/21033bbe-5b6f-53cc-8b31-fcedd19d7c2d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258257,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21033bbe-5b6f-53cc-8b31-fcedd19d7c2d/21033bbe-5b6f-53cc-8b31-fcedd19d7c2d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368728,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21033bbe-5b6f-53cc-8b31-fcedd19d7c2d/21033bbe-5b6f-53cc-8b31-fcedd19d7c2d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296378,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21033bbe-5b6f-53cc-8b31-fcedd19d7c2d/21033bbe-5b6f-53cc-8b31-fcedd19d7c2d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292272,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21033bbe-5b6f-53cc-8b31-fcedd19d7c2d/21033bbe-5b6f-53cc-8b31-fcedd19d7c2d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419121,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/32c017f3ab7d4b1e9aff5ec0f5861ca9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-05',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI I20 i20 1.0 T-GDi 100ch Hybrid Intuitive DCT-7',
'transmission': 'automatic',
'trim': 'i20 1.0 T-GDi 100ch Hybrid Intuitive DCT-7',
'vin': None,
'year': 2023}
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988212%27 HTTP/1.1" 200 None
2026-03-27 16:45:46 [ayvens.fr] INFO: Saving data for 1988212: {'created_time': 1774629946.61961, 'last_price_update_time': 1774629946.619621, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988212') HTTP/1.1" 204 0
2026-03-27 16:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1bd4252709534546b924966f32c427bf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/2.jpg not downloaded yet
2026-03-27 16:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd2890>
2026-03-27 16:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5d6aa6-0b83-5ca5-a384-10aa6201648b/7d5d6aa6-0b83-5ca5-a384-10aa6201648b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F57611db5891249eab5b2e4dde9c415fb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/1.jpg saved to cache
2026-03-27 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d5d6aa6-0b83-5ca5-a384-10aa6201648b
2026-03-27 16:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d6f150>
2026-03-27 16:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5d6aa6-0b83-5ca5-a384-10aa6201648b/7d5d6aa6-0b83-5ca5-a384-10aa6201648b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F57611db5891249eab5b2e4dde9c415fb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/2.jpg saved to cache
2026-03-27 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d5d6aa6-0b83-5ca5-a384-10aa6201648b
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1bd4252709534546b924966f32c427bf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/3.jpg not downloaded yet
2026-03-27 16:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b23ad0>
2026-03-27 16:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5d6aa6-0b83-5ca5-a384-10aa6201648b/7d5d6aa6-0b83-5ca5-a384-10aa6201648b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F57611db5891249eab5b2e4dde9c415fb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/3.jpg saved to cache
2026-03-27 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d5d6aa6-0b83-5ca5-a384-10aa6201648b
2026-03-27 16:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d0ad0>
2026-03-27 16:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5d6aa6-0b83-5ca5-a384-10aa6201648b/7d5d6aa6-0b83-5ca5-a384-10aa6201648b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F57611db5891249eab5b2e4dde9c415fb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/4.jpg saved to cache
2026-03-27 16:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d5d6aa6-0b83-5ca5-a384-10aa6201648b
2026-03-27 16:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1bd4252709534546b924966f32c427bf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/4.jpg not downloaded yet
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1bd4252709534546b924966f32c427bf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/5.jpg not downloaded yet
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b42990>
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5d6aa6-0b83-5ca5-a384-10aa6201648b/7d5d6aa6-0b83-5ca5-a384-10aa6201648b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F57611db5891249eab5b2e4dde9c415fb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/5.jpg saved to cache
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d5d6aa6-0b83-5ca5-a384-10aa6201648b
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d945d0>
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5d6aa6-0b83-5ca5-a384-10aa6201648b/7d5d6aa6-0b83-5ca5-a384-10aa6201648b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F57611db5891249eab5b2e4dde9c415fb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/6.jpg saved to cache
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d5d6aa6-0b83-5ca5-a384-10aa6201648b
2026-03-27 16:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1bd4252709534546b924966f32c427bf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/6.jpg not downloaded yet
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1bd4252709534546b924966f32c427bf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/7.jpg not downloaded yet
2026-03-27 16:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1bd4252709534546b924966f32c427bf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/8.jpg not downloaded yet
2026-03-27 16:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:47 [ayvens.fr] INFO: Found listing with ID: 1988215
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988215%27 HTTP/1.1" 200 None
2026-03-27 16:45:47 [ayvens.fr] INFO: Scrape type for 1988215: 1
2026-03-27 16:45:47 [ayvens.fr] INFO: Extracting data for car ID: 1988215
2026-03-27 16:45:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49353d46-5dfa-5667-93a8-b52f2fcea1c9 with identifier: 1988215
2026-03-27 16:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49353d46-5dfa-5667-93a8-b52f2fcea1c9 with scrape type 1
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 49353d46-5dfa-5667-93a8-b52f2fcea1c9
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F40c293b2d43d42c0983969338ee55d56%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/1.jpg not downloaded yet
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F40c293b2d43d42c0983969338ee55d56%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/2.jpg not downloaded yet
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b42990>
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5d6aa6-0b83-5ca5-a384-10aa6201648b/7d5d6aa6-0b83-5ca5-a384-10aa6201648b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F57611db5891249eab5b2e4dde9c415fb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/7.jpg saved to cache
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d5d6aa6-0b83-5ca5-a384-10aa6201648b
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f119d0>
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b04398fa-e6ed-5384-b930-cf997f1495c3/b04398fa-e6ed-5384-b930-cf997f1495c3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1bd4252709534546b924966f32c427bf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/1.jpg saved to cache
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b04398fa-e6ed-5384-b930-cf997f1495c3
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df4e90>
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5d6aa6-0b83-5ca5-a384-10aa6201648b/7d5d6aa6-0b83-5ca5-a384-10aa6201648b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F57611db5891249eab5b2e4dde9c415fb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/8.jpg saved to cache
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d5d6aa6-0b83-5ca5-a384-10aa6201648b
2026-03-27 16:45:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d5d6aa6-0b83-5ca5-a384-10aa6201648b, skipping ID generation
2026-03-27 16:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d5d6aa6-0b83-5ca5-a384-10aa6201648b with scrape type 1
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d5d6aa6-0b83-5ca5-a384-10aa6201648b sending to next pipeline
2026-03-27 16:45:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7d5d6aa6-0b83-5ca5-a384-10aa6201648b, identifier: 1988213
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4ae90>
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b04398fa-e6ed-5384-b930-cf997f1495c3/b04398fa-e6ed-5384-b930-cf997f1495c3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1bd4252709534546b924966f32c427bf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/3.jpg saved to cache
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b04398fa-e6ed-5384-b930-cf997f1495c3
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e08c50>
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b04398fa-e6ed-5384-b930-cf997f1495c3/b04398fa-e6ed-5384-b930-cf997f1495c3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1bd4252709534546b924966f32c427bf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/2.jpg saved to cache
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b04398fa-e6ed-5384-b930-cf997f1495c3
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F40c293b2d43d42c0983969338ee55d56%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/3.jpg not downloaded yet
2026-03-27 16:45:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7d5d6aa6-0b83-5ca5-a384-10aa6201648b with identifier: 1988213
2026-03-27 16:45:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:45:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7d5d6aa6-0b83-5ca5-a384-10aa6201648b with identifier: 1988213
2026-03-27 16:45:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7d5d6aa6-0b83-5ca5-a384-10aa6201648b with identifier: 1988213 to the API
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': 'BLEU COSMOS',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '7d5d6aa6-0b83-5ca5-a384-10aa6201648b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'SCENIC',
'odometer': 89660,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5d6aa6-0b83-5ca5-a384-10aa6201648b/7d5d6aa6-0b83-5ca5-a384-10aa6201648b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362852,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5d6aa6-0b83-5ca5-a384-10aa6201648b/7d5d6aa6-0b83-5ca5-a384-10aa6201648b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362852,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5d6aa6-0b83-5ca5-a384-10aa6201648b/7d5d6aa6-0b83-5ca5-a384-10aa6201648b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339288,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5d6aa6-0b83-5ca5-a384-10aa6201648b/7d5d6aa6-0b83-5ca5-a384-10aa6201648b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261213,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5d6aa6-0b83-5ca5-a384-10aa6201648b/7d5d6aa6-0b83-5ca5-a384-10aa6201648b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336664,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5d6aa6-0b83-5ca5-a384-10aa6201648b/7d5d6aa6-0b83-5ca5-a384-10aa6201648b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283511,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5d6aa6-0b83-5ca5-a384-10aa6201648b/7d5d6aa6-0b83-5ca5-a384-10aa6201648b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448927,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5d6aa6-0b83-5ca5-a384-10aa6201648b/7d5d6aa6-0b83-5ca5-a384-10aa6201648b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464320,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/57611db5891249eab5b2e4dde9c415fb/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-14',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT SCENIC Scenic 1.3 TCe 140ch FAP Business',
'transmission': 'manual',
'trim': 'Scenic 1.3 TCe 140ch FAP Business',
'vin': None,
'year': 2019}
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988213%27 HTTP/1.1" 200 None
2026-03-27 16:45:48 [ayvens.fr] INFO: Saving data for 1988213: {'created_time': 1774629948.102095, 'last_price_update_time': 1774629948.102105, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988213') HTTP/1.1" 204 0
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F40c293b2d43d42c0983969338ee55d56%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/4.jpg not downloaded yet
2026-03-27 16:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F40c293b2d43d42c0983969338ee55d56%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/5.jpg not downloaded yet
2026-03-27 16:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F40c293b2d43d42c0983969338ee55d56%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/6.jpg not downloaded yet
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F40c293b2d43d42c0983969338ee55d56%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/7.jpg not downloaded yet
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F40c293b2d43d42c0983969338ee55d56%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/8.jpg not downloaded yet
2026-03-27 16:45:48 [ayvens.fr] INFO: Found listing with ID: 1988216
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988216%27 HTTP/1.1" 200 None
2026-03-27 16:45:48 [ayvens.fr] INFO: Scrape type for 1988216: 1
2026-03-27 16:45:48 [ayvens.fr] INFO: Extracting data for car ID: 1988216
2026-03-27 16:45:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65c6629e-4af7-50de-a431-c0fb94eb149c with identifier: 1988216
2026-03-27 16:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65c6629e-4af7-50de-a431-c0fb94eb149c with scrape type 1
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 65c6629e-4af7-50de-a431-c0fb94eb149c
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6d0add3b11a54ac4a2f0091633fb548f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/1.jpg not downloaded yet
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6d0add3b11a54ac4a2f0091633fb548f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/2.jpg not downloaded yet
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6d0add3b11a54ac4a2f0091633fb548f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/3.jpg not downloaded yet
2026-03-27 16:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d81b10>
2026-03-27 16:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b04398fa-e6ed-5384-b930-cf997f1495c3/b04398fa-e6ed-5384-b930-cf997f1495c3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1bd4252709534546b924966f32c427bf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/4.jpg saved to cache
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b04398fa-e6ed-5384-b930-cf997f1495c3
2026-03-27 16:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590654750>
2026-03-27 16:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b04398fa-e6ed-5384-b930-cf997f1495c3/b04398fa-e6ed-5384-b930-cf997f1495c3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1bd4252709534546b924966f32c427bf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/5.jpg saved to cache
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b04398fa-e6ed-5384-b930-cf997f1495c3
2026-03-27 16:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd2fd0>
2026-03-27 16:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b04398fa-e6ed-5384-b930-cf997f1495c3/b04398fa-e6ed-5384-b930-cf997f1495c3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1bd4252709534546b924966f32c427bf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/6.jpg saved to cache
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b04398fa-e6ed-5384-b930-cf997f1495c3
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6d0add3b11a54ac4a2f0091633fb548f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/4.jpg not downloaded yet
2026-03-27 16:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4b6d0>
2026-03-27 16:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b04398fa-e6ed-5384-b930-cf997f1495c3/b04398fa-e6ed-5384-b930-cf997f1495c3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1bd4252709534546b924966f32c427bf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/8.jpg saved to cache
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b04398fa-e6ed-5384-b930-cf997f1495c3
2026-03-27 16:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590aff990>
2026-03-27 16:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b04398fa-e6ed-5384-b930-cf997f1495c3/b04398fa-e6ed-5384-b930-cf997f1495c3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1bd4252709534546b924966f32c427bf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/7.jpg saved to cache
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b04398fa-e6ed-5384-b930-cf997f1495c3
2026-03-27 16:45:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b04398fa-e6ed-5384-b930-cf997f1495c3, skipping ID generation
2026-03-27 16:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b04398fa-e6ed-5384-b930-cf997f1495c3 with scrape type 1
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b04398fa-e6ed-5384-b930-cf997f1495c3 sending to next pipeline
2026-03-27 16:45:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b04398fa-e6ed-5384-b930-cf997f1495c3, identifier: 1988214
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6d0add3b11a54ac4a2f0091633fb548f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/5.jpg not downloaded yet
2026-03-27 16:45:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b04398fa-e6ed-5384-b930-cf997f1495c3 with identifier: 1988214
2026-03-27 16:45:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b04398fa-e6ed-5384-b930-cf997f1495c3 with identifier: 1988214
2026-03-27 16:45:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b04398fa-e6ed-5384-b930-cf997f1495c3 with identifier: 1988214 to the API
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 30,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'b04398fa-e6ed-5384-b930-cf997f1495c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 114877,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04398fa-e6ed-5384-b930-cf997f1495c3/b04398fa-e6ed-5384-b930-cf997f1495c3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341810,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04398fa-e6ed-5384-b930-cf997f1495c3/b04398fa-e6ed-5384-b930-cf997f1495c3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341810,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04398fa-e6ed-5384-b930-cf997f1495c3/b04398fa-e6ed-5384-b930-cf997f1495c3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351747,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04398fa-e6ed-5384-b930-cf997f1495c3/b04398fa-e6ed-5384-b930-cf997f1495c3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336690,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04398fa-e6ed-5384-b930-cf997f1495c3/b04398fa-e6ed-5384-b930-cf997f1495c3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387054,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04398fa-e6ed-5384-b930-cf997f1495c3/b04398fa-e6ed-5384-b930-cf997f1495c3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358822,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04398fa-e6ed-5384-b930-cf997f1495c3/b04398fa-e6ed-5384-b930-cf997f1495c3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297126,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04398fa-e6ed-5384-b930-cf997f1495c3/b04398fa-e6ed-5384-b930-cf997f1495c3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288655,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/1bd4252709534546b924966f32c427bf/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-27',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 HYBRID4 300ch GT e-EAT8',
'transmission': 'automatic',
'trim': '3008 HYBRID4 300ch GT e-EAT8',
'vin': None,
'year': 2021}
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988214%27 HTTP/1.1" 200 None
2026-03-27 16:45:49 [ayvens.fr] INFO: Saving data for 1988214: {'created_time': 1774629949.097311, 'last_price_update_time': 1774629949.097323, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988214') HTTP/1.1" 204 0
2026-03-27 16:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6d0add3b11a54ac4a2f0091633fb548f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/6.jpg not downloaded yet
2026-03-27 16:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6d0add3b11a54ac4a2f0091633fb548f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/7.jpg not downloaded yet
2026-03-27 16:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6d0add3b11a54ac4a2f0091633fb548f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/8.jpg not downloaded yet
2026-03-27 16:45:49 [ayvens.fr] INFO: Found listing with ID: 1988217
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988217%27 HTTP/1.1" 200 None
2026-03-27 16:45:49 [ayvens.fr] INFO: Scrape type for 1988217: 1
2026-03-27 16:45:49 [ayvens.fr] INFO: Extracting data for car ID: 1988217
2026-03-27 16:45:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e72c090-44b9-5227-b1f2-8f45661c81d0 with identifier: 1988217
2026-03-27 16:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e72c090-44b9-5227-b1f2-8f45661c81d0 with scrape type 1
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1e72c090-44b9-5227-b1f2-8f45661c81d0
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff2154edab1784668b1542863778f52f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/1.jpg not downloaded yet
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff2154edab1784668b1542863778f52f8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/2.jpg not downloaded yet
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff2154edab1784668b1542863778f52f8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/3.jpg not downloaded yet
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b538d0>
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49353d46-5dfa-5667-93a8-b52f2fcea1c9/49353d46-5dfa-5667-93a8-b52f2fcea1c9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F40c293b2d43d42c0983969338ee55d56%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/2.jpg saved to cache
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49353d46-5dfa-5667-93a8-b52f2fcea1c9
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae8610>
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49353d46-5dfa-5667-93a8-b52f2fcea1c9/49353d46-5dfa-5667-93a8-b52f2fcea1c9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F40c293b2d43d42c0983969338ee55d56%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/3.jpg saved to cache
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49353d46-5dfa-5667-93a8-b52f2fcea1c9
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f82010>
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49353d46-5dfa-5667-93a8-b52f2fcea1c9/49353d46-5dfa-5667-93a8-b52f2fcea1c9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F40c293b2d43d42c0983969338ee55d56%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/4.jpg saved to cache
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49353d46-5dfa-5667-93a8-b52f2fcea1c9
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903dff10>
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49353d46-5dfa-5667-93a8-b52f2fcea1c9/49353d46-5dfa-5667-93a8-b52f2fcea1c9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F40c293b2d43d42c0983969338ee55d56%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/7.jpg saved to cache
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 49353d46-5dfa-5667-93a8-b52f2fcea1c9
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f81bd0>
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49353d46-5dfa-5667-93a8-b52f2fcea1c9/49353d46-5dfa-5667-93a8-b52f2fcea1c9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F40c293b2d43d42c0983969338ee55d56%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/8.jpg saved to cache
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 49353d46-5dfa-5667-93a8-b52f2fcea1c9
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff2154edab1784668b1542863778f52f8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/4.jpg not downloaded yet
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59307f5d0>
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49353d46-5dfa-5667-93a8-b52f2fcea1c9/49353d46-5dfa-5667-93a8-b52f2fcea1c9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F40c293b2d43d42c0983969338ee55d56%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/1.jpg saved to cache
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49353d46-5dfa-5667-93a8-b52f2fcea1c9
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ec77d0>
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49353d46-5dfa-5667-93a8-b52f2fcea1c9/49353d46-5dfa-5667-93a8-b52f2fcea1c9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F40c293b2d43d42c0983969338ee55d56%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/5.jpg saved to cache
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49353d46-5dfa-5667-93a8-b52f2fcea1c9
2026-03-27 16:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff2154edab1784668b1542863778f52f8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/5.jpg not downloaded yet
2026-03-27 16:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59287aa10>
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49353d46-5dfa-5667-93a8-b52f2fcea1c9/49353d46-5dfa-5667-93a8-b52f2fcea1c9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F40c293b2d43d42c0983969338ee55d56%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/6.jpg saved to cache
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 49353d46-5dfa-5667-93a8-b52f2fcea1c9
2026-03-27 16:45:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49353d46-5dfa-5667-93a8-b52f2fcea1c9, skipping ID generation
2026-03-27 16:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49353d46-5dfa-5667-93a8-b52f2fcea1c9 with scrape type 1
2026-03-27 16:45:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49353d46-5dfa-5667-93a8-b52f2fcea1c9 sending to next pipeline
2026-03-27 16:45:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 49353d46-5dfa-5667-93a8-b52f2fcea1c9, identifier: 1988215
2026-03-27 16:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff2154edab1784668b1542863778f52f8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/6.jpg not downloaded yet
2026-03-27 16:45:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 49353d46-5dfa-5667-93a8-b52f2fcea1c9 with identifier: 1988215
2026-03-27 16:45:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:45:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 49353d46-5dfa-5667-93a8-b52f2fcea1c9 with identifier: 1988215
2026-03-27 16:45:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 49353d46-5dfa-5667-93a8-b52f2fcea1c9 with identifier: 1988215 to the API
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '49353d46-5dfa-5667-93a8-b52f2fcea1c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 32695,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49353d46-5dfa-5667-93a8-b52f2fcea1c9/49353d46-5dfa-5667-93a8-b52f2fcea1c9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361133,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49353d46-5dfa-5667-93a8-b52f2fcea1c9/49353d46-5dfa-5667-93a8-b52f2fcea1c9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361133,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49353d46-5dfa-5667-93a8-b52f2fcea1c9/49353d46-5dfa-5667-93a8-b52f2fcea1c9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308053,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49353d46-5dfa-5667-93a8-b52f2fcea1c9/49353d46-5dfa-5667-93a8-b52f2fcea1c9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297250,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49353d46-5dfa-5667-93a8-b52f2fcea1c9/49353d46-5dfa-5667-93a8-b52f2fcea1c9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354616,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49353d46-5dfa-5667-93a8-b52f2fcea1c9/49353d46-5dfa-5667-93a8-b52f2fcea1c9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285897,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49353d46-5dfa-5667-93a8-b52f2fcea1c9/49353d46-5dfa-5667-93a8-b52f2fcea1c9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291735,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49353d46-5dfa-5667-93a8-b52f2fcea1c9/49353d46-5dfa-5667-93a8-b52f2fcea1c9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/40c293b2d43d42c0983969338ee55d56/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-11',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 100ch S&S Allure',
'transmission': 'manual',
'trim': '2008 1.2 PureTech 100ch S&S Allure',
'vin': None,
'year': 2023}
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988215%27 HTTP/1.1" 200 None
2026-03-27 16:45:50 [ayvens.fr] INFO: Saving data for 1988215: {'created_time': 1774629950.512828, 'last_price_update_time': 1774629950.512841, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988215') HTTP/1.1" 204 0
2026-03-27 16:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff2154edab1784668b1542863778f52f8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/7.jpg not downloaded yet
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7fbd0>
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c6629e-4af7-50de-a431-c0fb94eb149c/65c6629e-4af7-50de-a431-c0fb94eb149c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6d0add3b11a54ac4a2f0091633fb548f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/5.jpg saved to cache
2026-03-27 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65c6629e-4af7-50de-a431-c0fb94eb149c
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a9610>
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c6629e-4af7-50de-a431-c0fb94eb149c/65c6629e-4af7-50de-a431-c0fb94eb149c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6d0add3b11a54ac4a2f0091633fb548f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/7.jpg saved to cache
2026-03-27 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 65c6629e-4af7-50de-a431-c0fb94eb149c
2026-03-27 16:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff2154edab1784668b1542863778f52f8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/8.jpg not downloaded yet
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b5b950>
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c6629e-4af7-50de-a431-c0fb94eb149c/65c6629e-4af7-50de-a431-c0fb94eb149c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6d0add3b11a54ac4a2f0091633fb548f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/8.jpg saved to cache
2026-03-27 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 65c6629e-4af7-50de-a431-c0fb94eb149c
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903dc1d0>
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c6629e-4af7-50de-a431-c0fb94eb149c/65c6629e-4af7-50de-a431-c0fb94eb149c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6d0add3b11a54ac4a2f0091633fb548f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/2.jpg saved to cache
2026-03-27 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65c6629e-4af7-50de-a431-c0fb94eb149c
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d8c910>
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c6629e-4af7-50de-a431-c0fb94eb149c/65c6629e-4af7-50de-a431-c0fb94eb149c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6d0add3b11a54ac4a2f0091633fb548f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/4.jpg saved to cache
2026-03-27 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65c6629e-4af7-50de-a431-c0fb94eb149c
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0a190>
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c6629e-4af7-50de-a431-c0fb94eb149c/65c6629e-4af7-50de-a431-c0fb94eb149c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6d0add3b11a54ac4a2f0091633fb548f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/6.jpg saved to cache
2026-03-27 16:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 65c6629e-4af7-50de-a431-c0fb94eb149c
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d0350>
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c6629e-4af7-50de-a431-c0fb94eb149c/65c6629e-4af7-50de-a431-c0fb94eb149c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6d0add3b11a54ac4a2f0091633fb548f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/1.jpg saved to cache
2026-03-27 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65c6629e-4af7-50de-a431-c0fb94eb149c
2026-03-27 16:45:51 [ayvens.fr] INFO: Found listing with ID: 1988218
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988218%27 HTTP/1.1" 200 None
2026-03-27 16:45:51 [ayvens.fr] INFO: Scrape type for 1988218: 1
2026-03-27 16:45:51 [ayvens.fr] INFO: Extracting data for car ID: 1988218
2026-03-27 16:45:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27b88641-3bfc-526c-bac4-894d539642cd with identifier: 1988218
2026-03-27 16:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27b88641-3bfc-526c-bac4-894d539642cd with scrape type 1
2026-03-27 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 27b88641-3bfc-526c-bac4-894d539642cd
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fa091f20472d848b08a93845759e06f79%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/1.jpg not downloaded yet
2026-03-27 16:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fa091f20472d848b08a93845759e06f79%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/2.jpg not downloaded yet
2026-03-27 16:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065fcd0>
2026-03-27 16:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c6629e-4af7-50de-a431-c0fb94eb149c/65c6629e-4af7-50de-a431-c0fb94eb149c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6d0add3b11a54ac4a2f0091633fb548f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/3.jpg saved to cache
2026-03-27 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65c6629e-4af7-50de-a431-c0fb94eb149c
2026-03-27 16:45:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65c6629e-4af7-50de-a431-c0fb94eb149c, skipping ID generation
2026-03-27 16:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65c6629e-4af7-50de-a431-c0fb94eb149c with scrape type 1
2026-03-27 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65c6629e-4af7-50de-a431-c0fb94eb149c sending to next pipeline
2026-03-27 16:45:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 65c6629e-4af7-50de-a431-c0fb94eb149c, identifier: 1988216
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fa091f20472d848b08a93845759e06f79%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/3.jpg not downloaded yet
2026-03-27 16:45:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 65c6629e-4af7-50de-a431-c0fb94eb149c with identifier: 1988216
2026-03-27 16:45:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 65c6629e-4af7-50de-a431-c0fb94eb149c with identifier: 1988216
2026-03-27 16:45:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 65c6629e-4af7-50de-a431-c0fb94eb149c with identifier: 1988216 to the API
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '65c6629e-4af7-50de-a431-c0fb94eb149c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308',
'odometer': 51171,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65c6629e-4af7-50de-a431-c0fb94eb149c/65c6629e-4af7-50de-a431-c0fb94eb149c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434712,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65c6629e-4af7-50de-a431-c0fb94eb149c/65c6629e-4af7-50de-a431-c0fb94eb149c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434712,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65c6629e-4af7-50de-a431-c0fb94eb149c/65c6629e-4af7-50de-a431-c0fb94eb149c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 513965,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65c6629e-4af7-50de-a431-c0fb94eb149c/65c6629e-4af7-50de-a431-c0fb94eb149c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405585,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65c6629e-4af7-50de-a431-c0fb94eb149c/65c6629e-4af7-50de-a431-c0fb94eb149c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370834,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65c6629e-4af7-50de-a431-c0fb94eb149c/65c6629e-4af7-50de-a431-c0fb94eb149c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359263,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65c6629e-4af7-50de-a431-c0fb94eb149c/65c6629e-4af7-50de-a431-c0fb94eb149c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250979,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65c6629e-4af7-50de-a431-c0fb94eb149c/65c6629e-4af7-50de-a431-c0fb94eb149c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322172,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/6d0add3b11a54ac4a2f0091633fb548f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-01',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 308 1.2 PureTech 130ch S&S Active Pack EAT8',
'transmission': 'automatic',
'trim': '308 1.2 PureTech 130ch S&S Active Pack EAT8',
'vin': None,
'year': 2023}
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988216%27 HTTP/1.1" 200 None
2026-03-27 16:45:51 [ayvens.fr] INFO: Saving data for 1988216: {'created_time': 1774629951.873391, 'last_price_update_time': 1774629951.873405, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988216') HTTP/1.1" 204 0
2026-03-27 16:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fa091f20472d848b08a93845759e06f79%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/4.jpg not downloaded yet
2026-03-27 16:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d74290>
2026-03-27 16:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e72c090-44b9-5227-b1f2-8f45661c81d0/1e72c090-44b9-5227-b1f2-8f45661c81d0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff2154edab1784668b1542863778f52f8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/2.jpg saved to cache
2026-03-27 16:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e72c090-44b9-5227-b1f2-8f45661c81d0
2026-03-27 16:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065ff50>
2026-03-27 16:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e72c090-44b9-5227-b1f2-8f45661c81d0/1e72c090-44b9-5227-b1f2-8f45661c81d0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff2154edab1784668b1542863778f52f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/1.jpg saved to cache
2026-03-27 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e72c090-44b9-5227-b1f2-8f45661c81d0
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ac66d0>
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e72c090-44b9-5227-b1f2-8f45661c81d0/1e72c090-44b9-5227-b1f2-8f45661c81d0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff2154edab1784668b1542863778f52f8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/3.jpg saved to cache
2026-03-27 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e72c090-44b9-5227-b1f2-8f45661c81d0
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fa091f20472d848b08a93845759e06f79%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/5.jpg not downloaded yet
2026-03-27 16:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fa091f20472d848b08a93845759e06f79%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/6.jpg not downloaded yet
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d81690>
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e72c090-44b9-5227-b1f2-8f45661c81d0/1e72c090-44b9-5227-b1f2-8f45661c81d0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff2154edab1784668b1542863778f52f8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/4.jpg saved to cache
2026-03-27 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e72c090-44b9-5227-b1f2-8f45661c81d0
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dbb550>
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e72c090-44b9-5227-b1f2-8f45661c81d0/1e72c090-44b9-5227-b1f2-8f45661c81d0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff2154edab1784668b1542863778f52f8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/6.jpg saved to cache
2026-03-27 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e72c090-44b9-5227-b1f2-8f45661c81d0
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0d9d0>
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e72c090-44b9-5227-b1f2-8f45661c81d0/1e72c090-44b9-5227-b1f2-8f45661c81d0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff2154edab1784668b1542863778f52f8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/5.jpg saved to cache
2026-03-27 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e72c090-44b9-5227-b1f2-8f45661c81d0
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fa091f20472d848b08a93845759e06f79%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/7.jpg not downloaded yet
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fa091f20472d848b08a93845759e06f79%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/8.jpg not downloaded yet
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c3c90>
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e72c090-44b9-5227-b1f2-8f45661c81d0/1e72c090-44b9-5227-b1f2-8f45661c81d0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff2154edab1784668b1542863778f52f8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/7.jpg saved to cache
2026-03-27 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e72c090-44b9-5227-b1f2-8f45661c81d0
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b68610>
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e72c090-44b9-5227-b1f2-8f45661c81d0/1e72c090-44b9-5227-b1f2-8f45661c81d0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff2154edab1784668b1542863778f52f8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/8.jpg saved to cache
2026-03-27 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e72c090-44b9-5227-b1f2-8f45661c81d0
2026-03-27 16:45:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e72c090-44b9-5227-b1f2-8f45661c81d0, skipping ID generation
2026-03-27 16:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e72c090-44b9-5227-b1f2-8f45661c81d0 with scrape type 1
2026-03-27 16:45:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e72c090-44b9-5227-b1f2-8f45661c81d0 sending to next pipeline
2026-03-27 16:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1e72c090-44b9-5227-b1f2-8f45661c81d0, identifier: 1988217
2026-03-27 16:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1e72c090-44b9-5227-b1f2-8f45661c81d0 with identifier: 1988217
2026-03-27 16:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1e72c090-44b9-5227-b1f2-8f45661c81d0 with identifier: 1988217
2026-03-27 16:45:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1e72c090-44b9-5227-b1f2-8f45661c81d0 with identifier: 1988217 to the API
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 141,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '1e72c090-44b9-5227-b1f2-8f45661c81d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 76717,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e72c090-44b9-5227-b1f2-8f45661c81d0/1e72c090-44b9-5227-b1f2-8f45661c81d0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333953,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e72c090-44b9-5227-b1f2-8f45661c81d0/1e72c090-44b9-5227-b1f2-8f45661c81d0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333953,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e72c090-44b9-5227-b1f2-8f45661c81d0/1e72c090-44b9-5227-b1f2-8f45661c81d0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336584,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e72c090-44b9-5227-b1f2-8f45661c81d0/1e72c090-44b9-5227-b1f2-8f45661c81d0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276277,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e72c090-44b9-5227-b1f2-8f45661c81d0/1e72c090-44b9-5227-b1f2-8f45661c81d0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336288,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e72c090-44b9-5227-b1f2-8f45661c81d0/1e72c090-44b9-5227-b1f2-8f45661c81d0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287535,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e72c090-44b9-5227-b1f2-8f45661c81d0/1e72c090-44b9-5227-b1f2-8f45661c81d0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307084,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e72c090-44b9-5227-b1f2-8f45661c81d0/1e72c090-44b9-5227-b1f2-8f45661c81d0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338039,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/f2154edab1784668b1542863778f52f8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-25',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CAPTUR Captur 1.3 TCe 130ch FAP Business EDC',
'transmission': 'automatic',
'trim': 'Captur 1.3 TCe 130ch FAP Business EDC',
'vin': None,
'year': 2021}
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988217%27 HTTP/1.1" 200 None
2026-03-27 16:45:53 [ayvens.fr] INFO: Saving data for 1988217: {'created_time': 1774629953.078218, 'last_price_update_time': 1774629953.078232, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988217') HTTP/1.1" 204 0
2026-03-27 16:45:53 [ayvens.fr] INFO: Found listing with ID: 1988219
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988219%27 HTTP/1.1" 200 None
2026-03-27 16:45:53 [ayvens.fr] INFO: Scrape type for 1988219: 1
2026-03-27 16:45:53 [ayvens.fr] INFO: Extracting data for car ID: 1988219
2026-03-27 16:45:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 703fc6e0-c4ef-55ee-ac7a-4f307a55ea68 with identifier: 1988219
2026-03-27 16:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 703fc6e0-c4ef-55ee-ac7a-4f307a55ea68 with scrape type 1
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 703fc6e0-c4ef-55ee-ac7a-4f307a55ea68
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F3bcf0acfa02046b082c067b62718a93b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/1.jpg not downloaded yet
2026-03-27 16:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F3bcf0acfa02046b082c067b62718a93b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/2.jpg not downloaded yet
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051f390>
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27b88641-3bfc-526c-bac4-894d539642cd/27b88641-3bfc-526c-bac4-894d539642cd_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fa091f20472d848b08a93845759e06f79%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/2.jpg saved to cache
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27b88641-3bfc-526c-bac4-894d539642cd
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e16110>
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27b88641-3bfc-526c-bac4-894d539642cd/27b88641-3bfc-526c-bac4-894d539642cd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fa091f20472d848b08a93845759e06f79%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/1.jpg saved to cache
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27b88641-3bfc-526c-bac4-894d539642cd
2026-03-27 16:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F3bcf0acfa02046b082c067b62718a93b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/3.jpg not downloaded yet
2026-03-27 16:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F3bcf0acfa02046b082c067b62718a93b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/4.jpg not downloaded yet
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dac550>
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27b88641-3bfc-526c-bac4-894d539642cd/27b88641-3bfc-526c-bac4-894d539642cd_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fa091f20472d848b08a93845759e06f79%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/4.jpg saved to cache
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27b88641-3bfc-526c-bac4-894d539642cd
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ac5f10>
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27b88641-3bfc-526c-bac4-894d539642cd/27b88641-3bfc-526c-bac4-894d539642cd_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fa091f20472d848b08a93845759e06f79%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/3.jpg saved to cache
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27b88641-3bfc-526c-bac4-894d539642cd
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F3bcf0acfa02046b082c067b62718a93b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/5.jpg not downloaded yet
2026-03-27 16:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F3bcf0acfa02046b082c067b62718a93b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/6.jpg not downloaded yet
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592872990>
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27b88641-3bfc-526c-bac4-894d539642cd/27b88641-3bfc-526c-bac4-894d539642cd_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fa091f20472d848b08a93845759e06f79%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/6.jpg saved to cache
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27b88641-3bfc-526c-bac4-894d539642cd
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae0f10>
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27b88641-3bfc-526c-bac4-894d539642cd/27b88641-3bfc-526c-bac4-894d539642cd_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fa091f20472d848b08a93845759e06f79%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/5.jpg saved to cache
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27b88641-3bfc-526c-bac4-894d539642cd
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F3bcf0acfa02046b082c067b62718a93b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/7.jpg not downloaded yet
2026-03-27 16:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F3bcf0acfa02046b082c067b62718a93b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/8.jpg not downloaded yet
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592872990>
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27b88641-3bfc-526c-bac4-894d539642cd/27b88641-3bfc-526c-bac4-894d539642cd_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fa091f20472d848b08a93845759e06f79%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/8.jpg saved to cache
2026-03-27 16:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27b88641-3bfc-526c-bac4-894d539642cd
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae8390>
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27b88641-3bfc-526c-bac4-894d539642cd/27b88641-3bfc-526c-bac4-894d539642cd_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fa091f20472d848b08a93845759e06f79%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/7.jpg saved to cache
2026-03-27 16:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27b88641-3bfc-526c-bac4-894d539642cd
2026-03-27 16:45:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27b88641-3bfc-526c-bac4-894d539642cd, skipping ID generation
2026-03-27 16:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27b88641-3bfc-526c-bac4-894d539642cd with scrape type 1
2026-03-27 16:45:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27b88641-3bfc-526c-bac4-894d539642cd sending to next pipeline
2026-03-27 16:45:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 27b88641-3bfc-526c-bac4-894d539642cd, identifier: 1988218
2026-03-27 16:45:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 27b88641-3bfc-526c-bac4-894d539642cd with identifier: 1988218
2026-03-27 16:45:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 27b88641-3bfc-526c-bac4-894d539642cd with identifier: 1988218
2026-03-27 16:45:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 27b88641-3bfc-526c-bac4-894d539642cd with identifier: 1988218 to the API
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '27b88641-3bfc-526c-bac4-894d539642cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'MAZDA',
'model': 'MAZDA2',
'odometer': 44474,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27b88641-3bfc-526c-bac4-894d539642cd/27b88641-3bfc-526c-bac4-894d539642cd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 452513,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27b88641-3bfc-526c-bac4-894d539642cd/27b88641-3bfc-526c-bac4-894d539642cd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 452513,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27b88641-3bfc-526c-bac4-894d539642cd/27b88641-3bfc-526c-bac4-894d539642cd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355801,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27b88641-3bfc-526c-bac4-894d539642cd/27b88641-3bfc-526c-bac4-894d539642cd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379248,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27b88641-3bfc-526c-bac4-894d539642cd/27b88641-3bfc-526c-bac4-894d539642cd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332397,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27b88641-3bfc-526c-bac4-894d539642cd/27b88641-3bfc-526c-bac4-894d539642cd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316691,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27b88641-3bfc-526c-bac4-894d539642cd/27b88641-3bfc-526c-bac4-894d539642cd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353791,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27b88641-3bfc-526c-bac4-894d539642cd/27b88641-3bfc-526c-bac4-894d539642cd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274997,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/a091f20472d848b08a93845759e06f79/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-06',
'seats_number': 5,
'seller_name': None,
'title': 'MAZDA MAZDA2 Mazda 2 1.5 e-SKYACTIV G M Hybrid 90ch Elégance',
'transmission': 'manual',
'trim': 'Mazda 2 1.5 e-SKYACTIV G M Hybrid 90ch Elégance',
'vin': None,
'year': 2023}
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988218%27 HTTP/1.1" 200 None
2026-03-27 16:45:54 [ayvens.fr] INFO: Saving data for 1988218: {'created_time': 1774629954.507504, 'last_price_update_time': 1774629954.507521, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988218') HTTP/1.1" 204 0
2026-03-27 16:45:54 [ayvens.fr] INFO: Found listing with ID: 1988220
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988220%27 HTTP/1.1" 200 None
2026-03-27 16:45:54 [ayvens.fr] INFO: Scrape type for 1988220: 1
2026-03-27 16:45:54 [ayvens.fr] INFO: Extracting data for car ID: 1988220
2026-03-27 16:45:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcd6d80b-d81c-5bc4-8996-7773f4f4534f with identifier: 1988220
2026-03-27 16:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcd6d80b-d81c-5bc4-8996-7773f4f4534f with scrape type 1
2026-03-27 16:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dcd6d80b-d81c-5bc4-8996-7773f4f4534f
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F9180a85605c14560ac7299be96ccfa4d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/9180a85605c14560ac7299be96ccfa4d/images/large/1.jpg not downloaded yet
2026-03-27 16:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590528450>
2026-03-27 16:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_703fc6e0-c4ef-55ee-ac7a-4f307a55ea68/703fc6e0-c4ef-55ee-ac7a-4f307a55ea68_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F3bcf0acfa02046b082c067b62718a93b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/1.jpg saved to cache
2026-03-27 16:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 703fc6e0-c4ef-55ee-ac7a-4f307a55ea68
2026-03-27 16:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c1550>
2026-03-27 16:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_703fc6e0-c4ef-55ee-ac7a-4f307a55ea68/703fc6e0-c4ef-55ee-ac7a-4f307a55ea68_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F3bcf0acfa02046b082c067b62718a93b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/2.jpg saved to cache
2026-03-27 16:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 703fc6e0-c4ef-55ee-ac7a-4f307a55ea68
2026-03-27 16:45:54 [ayvens.fr] INFO: Found listing with ID: 1988221
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988221%27 HTTP/1.1" 200 None
2026-03-27 16:45:54 [ayvens.fr] INFO: Scrape type for 1988221: 1
2026-03-27 16:45:54 [ayvens.fr] INFO: Extracting data for car ID: 1988221
2026-03-27 16:45:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fba65655-c6b0-5466-b517-88d71b776072 with identifier: 1988221
2026-03-27 16:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fba65655-c6b0-5466-b517-88d71b776072 with scrape type 1
2026-03-27 16:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item fba65655-c6b0-5466-b517-88d71b776072
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F4f1c285b93ac4fc7b7349374d346552f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/1.jpg not downloaded yet
2026-03-27 16:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F4f1c285b93ac4fc7b7349374d346552f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/2.jpg not downloaded yet
2026-03-27 16:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa9bd0>
2026-03-27 16:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_703fc6e0-c4ef-55ee-ac7a-4f307a55ea68/703fc6e0-c4ef-55ee-ac7a-4f307a55ea68_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F3bcf0acfa02046b082c067b62718a93b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/3.jpg saved to cache
2026-03-27 16:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 703fc6e0-c4ef-55ee-ac7a-4f307a55ea68
2026-03-27 16:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590655610>
2026-03-27 16:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_703fc6e0-c4ef-55ee-ac7a-4f307a55ea68/703fc6e0-c4ef-55ee-ac7a-4f307a55ea68_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F3bcf0acfa02046b082c067b62718a93b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/4.jpg saved to cache
2026-03-27 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 703fc6e0-c4ef-55ee-ac7a-4f307a55ea68
2026-03-27 16:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F4f1c285b93ac4fc7b7349374d346552f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/3.jpg not downloaded yet
2026-03-27 16:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b1bdd0>
2026-03-27 16:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_703fc6e0-c4ef-55ee-ac7a-4f307a55ea68/703fc6e0-c4ef-55ee-ac7a-4f307a55ea68_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F3bcf0acfa02046b082c067b62718a93b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/6.jpg saved to cache
2026-03-27 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 703fc6e0-c4ef-55ee-ac7a-4f307a55ea68
2026-03-27 16:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b04790>
2026-03-27 16:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_703fc6e0-c4ef-55ee-ac7a-4f307a55ea68/703fc6e0-c4ef-55ee-ac7a-4f307a55ea68_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F3bcf0acfa02046b082c067b62718a93b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/5.jpg saved to cache
2026-03-27 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 703fc6e0-c4ef-55ee-ac7a-4f307a55ea68
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F4f1c285b93ac4fc7b7349374d346552f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/4.jpg not downloaded yet
2026-03-27 16:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F4f1c285b93ac4fc7b7349374d346552f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/5.jpg not downloaded yet
2026-03-27 16:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050d350>
2026-03-27 16:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_703fc6e0-c4ef-55ee-ac7a-4f307a55ea68/703fc6e0-c4ef-55ee-ac7a-4f307a55ea68_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F3bcf0acfa02046b082c067b62718a93b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/7.jpg saved to cache
2026-03-27 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 703fc6e0-c4ef-55ee-ac7a-4f307a55ea68
2026-03-27 16:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/9180a85605c14560ac7299be96ccfa4d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F4f1c285b93ac4fc7b7349374d346552f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/6.jpg not downloaded yet
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F4f1c285b93ac4fc7b7349374d346552f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/7.jpg not downloaded yet
2026-03-27 16:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F4f1c285b93ac4fc7b7349374d346552f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/8.jpg not downloaded yet
2026-03-27 16:45:55 [ayvens.fr] INFO: Found listing with ID: 1988222
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988222%27 HTTP/1.1" 200 None
2026-03-27 16:45:55 [ayvens.fr] INFO: Scrape type for 1988222: 1
2026-03-27 16:45:55 [ayvens.fr] INFO: Extracting data for car ID: 1988222
2026-03-27 16:45:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 400a8e3b-90c9-5335-bf57-651756d093f2 with identifier: 1988222
2026-03-27 16:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 400a8e3b-90c9-5335-bf57-651756d093f2 with scrape type 1
2026-03-27 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 400a8e3b-90c9-5335-bf57-651756d093f2
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F24bf6c36943c4926a3b0f6d9fb9a0b8f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/1.jpg not downloaded yet
2026-03-27 16:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b1a890>
2026-03-27 16:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_703fc6e0-c4ef-55ee-ac7a-4f307a55ea68/703fc6e0-c4ef-55ee-ac7a-4f307a55ea68_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F3bcf0acfa02046b082c067b62718a93b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/8.jpg saved to cache
2026-03-27 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 703fc6e0-c4ef-55ee-ac7a-4f307a55ea68
2026-03-27 16:45:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 703fc6e0-c4ef-55ee-ac7a-4f307a55ea68, skipping ID generation
2026-03-27 16:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 703fc6e0-c4ef-55ee-ac7a-4f307a55ea68 with scrape type 1
2026-03-27 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 703fc6e0-c4ef-55ee-ac7a-4f307a55ea68 sending to next pipeline
2026-03-27 16:45:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 703fc6e0-c4ef-55ee-ac7a-4f307a55ea68, identifier: 1988219
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F24bf6c36943c4926a3b0f6d9fb9a0b8f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/2.jpg not downloaded yet
2026-03-27 16:45:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 703fc6e0-c4ef-55ee-ac7a-4f307a55ea68 with identifier: 1988219
2026-03-27 16:45:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 703fc6e0-c4ef-55ee-ac7a-4f307a55ea68 with identifier: 1988219
2026-03-27 16:45:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 703fc6e0-c4ef-55ee-ac7a-4f307a55ea68 with identifier: 1988219 to the API
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 32,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '703fc6e0-c4ef-55ee-ac7a-4f307a55ea68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'DS AUTOMOBILES',
'model': 'DS4',
'odometer': 42010,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_703fc6e0-c4ef-55ee-ac7a-4f307a55ea68/703fc6e0-c4ef-55ee-ac7a-4f307a55ea68_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359397,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_703fc6e0-c4ef-55ee-ac7a-4f307a55ea68/703fc6e0-c4ef-55ee-ac7a-4f307a55ea68_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359397,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_703fc6e0-c4ef-55ee-ac7a-4f307a55ea68/703fc6e0-c4ef-55ee-ac7a-4f307a55ea68_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319159,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_703fc6e0-c4ef-55ee-ac7a-4f307a55ea68/703fc6e0-c4ef-55ee-ac7a-4f307a55ea68_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_703fc6e0-c4ef-55ee-ac7a-4f307a55ea68/703fc6e0-c4ef-55ee-ac7a-4f307a55ea68_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289529,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_703fc6e0-c4ef-55ee-ac7a-4f307a55ea68/703fc6e0-c4ef-55ee-ac7a-4f307a55ea68_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256100,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_703fc6e0-c4ef-55ee-ac7a-4f307a55ea68/703fc6e0-c4ef-55ee-ac7a-4f307a55ea68_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254366,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_703fc6e0-c4ef-55ee-ac7a-4f307a55ea68/703fc6e0-c4ef-55ee-ac7a-4f307a55ea68_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281296,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/3bcf0acfa02046b082c067b62718a93b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-09',
'seats_number': 5,
'seller_name': None,
'title': 'DS AUTOMOBILES DS4 DS 4 E-TENSE 225ch Rivoli',
'transmission': 'automatic',
'trim': 'DS 4 E-TENSE 225ch Rivoli',
'vin': None,
'year': 2022}
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988219%27 HTTP/1.1" 200 None
2026-03-27 16:45:55 [ayvens.fr] INFO: Saving data for 1988219: {'created_time': 1774629955.967467, 'last_price_update_time': 1774629955.96748, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988219') HTTP/1.1" 204 0
2026-03-27 16:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F24bf6c36943c4926a3b0f6d9fb9a0b8f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/3.jpg not downloaded yet
2026-03-27 16:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F24bf6c36943c4926a3b0f6d9fb9a0b8f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/4.jpg not downloaded yet
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ab9090>
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd6d80b-d81c-5bc4-8996-7773f4f4534f/dcd6d80b-d81c-5bc4-8996-7773f4f4534f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F9180a85605c14560ac7299be96ccfa4d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/9180a85605c14560ac7299be96ccfa4d/images/large/1.jpg saved to cache
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dcd6d80b-d81c-5bc4-8996-7773f4f4534f
2026-03-27 16:45:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dcd6d80b-d81c-5bc4-8996-7773f4f4534f, skipping ID generation
2026-03-27 16:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcd6d80b-d81c-5bc4-8996-7773f4f4534f with scrape type 1
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dcd6d80b-d81c-5bc4-8996-7773f4f4534f sending to next pipeline
2026-03-27 16:45:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: dcd6d80b-d81c-5bc4-8996-7773f4f4534f, identifier: 1988220
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066e010>
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fba65655-c6b0-5466-b517-88d71b776072/fba65655-c6b0-5466-b517-88d71b776072_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F4f1c285b93ac4fc7b7349374d346552f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/1.jpg saved to cache
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fba65655-c6b0-5466-b517-88d71b776072
2026-03-27 16:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: dcd6d80b-d81c-5bc4-8996-7773f4f4534f with identifier: 1988220
2026-03-27 16:45:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: dcd6d80b-d81c-5bc4-8996-7773f4f4534f with identifier: 1988220
2026-03-27 16:45:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: dcd6d80b-d81c-5bc4-8996-7773f4f4534f with identifier: 1988220 to the API
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/9180a85605c14560ac7299be96ccfa4d/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'dcd6d80b-d81c-5bc4-8996-7773f4f4534f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 104394,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 1,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd6d80b-d81c-5bc4-8996-7773f4f4534f/dcd6d80b-d81c-5bc4-8996-7773f4f4534f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340267,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/9180a85605c14560ac7299be96ccfa4d/images/large/1.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-16',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 100ch S&S Allure',
'transmission': 'manual',
'trim': '2008 1.2 PureTech 100ch S&S Allure',
'vin': None,
'year': 2021}
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988220%27 HTTP/1.1" 200 None
2026-03-27 16:45:56 [ayvens.fr] INFO: Saving data for 1988220: {'created_time': 1774629956.565053, 'last_price_update_time': 1774629956.565063, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988220') HTTP/1.1" 204 0
2026-03-27 16:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F24bf6c36943c4926a3b0f6d9fb9a0b8f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/5.jpg not downloaded yet
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F24bf6c36943c4926a3b0f6d9fb9a0b8f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/6.jpg not downloaded yet
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903dc510>
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fba65655-c6b0-5466-b517-88d71b776072/fba65655-c6b0-5466-b517-88d71b776072_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F4f1c285b93ac4fc7b7349374d346552f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/2.jpg saved to cache
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fba65655-c6b0-5466-b517-88d71b776072
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7fc50>
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fba65655-c6b0-5466-b517-88d71b776072/fba65655-c6b0-5466-b517-88d71b776072_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F4f1c285b93ac4fc7b7349374d346552f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/3.jpg saved to cache
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fba65655-c6b0-5466-b517-88d71b776072
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b41910>
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fba65655-c6b0-5466-b517-88d71b776072/fba65655-c6b0-5466-b517-88d71b776072_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F4f1c285b93ac4fc7b7349374d346552f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/6.jpg saved to cache
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fba65655-c6b0-5466-b517-88d71b776072
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F24bf6c36943c4926a3b0f6d9fb9a0b8f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/7.jpg not downloaded yet
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F24bf6c36943c4926a3b0f6d9fb9a0b8f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/8.jpg not downloaded yet
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591181a50>
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fba65655-c6b0-5466-b517-88d71b776072/fba65655-c6b0-5466-b517-88d71b776072_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F4f1c285b93ac4fc7b7349374d346552f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/4.jpg saved to cache
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fba65655-c6b0-5466-b517-88d71b776072
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b58150>
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fba65655-c6b0-5466-b517-88d71b776072/fba65655-c6b0-5466-b517-88d71b776072_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F4f1c285b93ac4fc7b7349374d346552f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/7.jpg saved to cache
2026-03-27 16:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fba65655-c6b0-5466-b517-88d71b776072
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b36190>
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fba65655-c6b0-5466-b517-88d71b776072/fba65655-c6b0-5466-b517-88d71b776072_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F4f1c285b93ac4fc7b7349374d346552f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/5.jpg saved to cache
2026-03-27 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fba65655-c6b0-5466-b517-88d71b776072
2026-03-27 16:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9f0d0>
2026-03-27 16:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fba65655-c6b0-5466-b517-88d71b776072/fba65655-c6b0-5466-b517-88d71b776072_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F4f1c285b93ac4fc7b7349374d346552f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/8.jpg saved to cache
2026-03-27 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fba65655-c6b0-5466-b517-88d71b776072
2026-03-27 16:45:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fba65655-c6b0-5466-b517-88d71b776072, skipping ID generation
2026-03-27 16:45:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fba65655-c6b0-5466-b517-88d71b776072 with scrape type 1
2026-03-27 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fba65655-c6b0-5466-b517-88d71b776072 sending to next pipeline
2026-03-27 16:45:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: fba65655-c6b0-5466-b517-88d71b776072, identifier: 1988221
2026-03-27 16:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: fba65655-c6b0-5466-b517-88d71b776072 with identifier: 1988221
2026-03-27 16:45:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:45:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: fba65655-c6b0-5466-b517-88d71b776072 with identifier: 1988221
2026-03-27 16:45:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: fba65655-c6b0-5466-b517-88d71b776072 with identifier: 1988221 to the API
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'GRIS MAGNETIC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'fba65655-c6b0-5466-b517-88d71b776072',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FOCUS',
'odometer': 128115,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fba65655-c6b0-5466-b517-88d71b776072/fba65655-c6b0-5466-b517-88d71b776072_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367551,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fba65655-c6b0-5466-b517-88d71b776072/fba65655-c6b0-5466-b517-88d71b776072_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367551,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fba65655-c6b0-5466-b517-88d71b776072/fba65655-c6b0-5466-b517-88d71b776072_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336295,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fba65655-c6b0-5466-b517-88d71b776072/fba65655-c6b0-5466-b517-88d71b776072_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342986,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fba65655-c6b0-5466-b517-88d71b776072/fba65655-c6b0-5466-b517-88d71b776072_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367955,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fba65655-c6b0-5466-b517-88d71b776072/fba65655-c6b0-5466-b517-88d71b776072_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291816,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fba65655-c6b0-5466-b517-88d71b776072/fba65655-c6b0-5466-b517-88d71b776072_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 390096,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fba65655-c6b0-5466-b517-88d71b776072/fba65655-c6b0-5466-b517-88d71b776072_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300841,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/4f1c285b93ac4fc7b7349374d346552f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-02',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FOCUS Focus Active 1.0 EcoBoost 125ch Active V BVA',
'transmission': 'automatic',
'trim': 'Focus Active 1.0 EcoBoost 125ch Active V BVA',
'vin': None,
'year': 2020}
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988221%27 HTTP/1.1" 200 None
2026-03-27 16:45:57 [ayvens.fr] INFO: Saving data for 1988221: {'created_time': 1774629957.558787, 'last_price_update_time': 1774629957.558803, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988221') HTTP/1.1" 204 0
2026-03-27 16:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:57 [ayvens.fr] INFO: Found listing with ID: 1988223
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988223%27 HTTP/1.1" 200 None
2026-03-27 16:45:57 [ayvens.fr] INFO: Scrape type for 1988223: 1
2026-03-27 16:45:57 [ayvens.fr] INFO: Extracting data for car ID: 1988223
2026-03-27 16:45:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8af1a400-aa29-5718-8f8d-b1f27b4a34c0 with identifier: 1988223
2026-03-27 16:45:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8af1a400-aa29-5718-8f8d-b1f27b4a34c0 with scrape type 1
2026-03-27 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 8af1a400-aa29-5718-8f8d-b1f27b4a34c0
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252Fba60d3b6ceb94f5d8f7f1837aad81c65%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/1.jpg not downloaded yet
2026-03-27 16:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252Fba60d3b6ceb94f5d8f7f1837aad81c65%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/2.jpg not downloaded yet
2026-03-27 16:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9e690>
2026-03-27 16:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_400a8e3b-90c9-5335-bf57-651756d093f2/400a8e3b-90c9-5335-bf57-651756d093f2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F24bf6c36943c4926a3b0f6d9fb9a0b8f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/1.jpg saved to cache
2026-03-27 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 400a8e3b-90c9-5335-bf57-651756d093f2
2026-03-27 16:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252Fba60d3b6ceb94f5d8f7f1837aad81c65%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/3.jpg not downloaded yet
2026-03-27 16:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252Fba60d3b6ceb94f5d8f7f1837aad81c65%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/4.jpg not downloaded yet
2026-03-27 16:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd0f50>
2026-03-27 16:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_400a8e3b-90c9-5335-bf57-651756d093f2/400a8e3b-90c9-5335-bf57-651756d093f2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F24bf6c36943c4926a3b0f6d9fb9a0b8f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/2.jpg saved to cache
2026-03-27 16:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 400a8e3b-90c9-5335-bf57-651756d093f2
2026-03-27 16:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc4d10>
2026-03-27 16:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_400a8e3b-90c9-5335-bf57-651756d093f2/400a8e3b-90c9-5335-bf57-651756d093f2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F24bf6c36943c4926a3b0f6d9fb9a0b8f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/4.jpg saved to cache
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 400a8e3b-90c9-5335-bf57-651756d093f2
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252Fba60d3b6ceb94f5d8f7f1837aad81c65%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/5.jpg not downloaded yet
2026-03-27 16:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252Fba60d3b6ceb94f5d8f7f1837aad81c65%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/6.jpg not downloaded yet
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c3190>
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_400a8e3b-90c9-5335-bf57-651756d093f2/400a8e3b-90c9-5335-bf57-651756d093f2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F24bf6c36943c4926a3b0f6d9fb9a0b8f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/3.jpg saved to cache
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 400a8e3b-90c9-5335-bf57-651756d093f2
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590aeaf50>
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_400a8e3b-90c9-5335-bf57-651756d093f2/400a8e3b-90c9-5335-bf57-651756d093f2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F24bf6c36943c4926a3b0f6d9fb9a0b8f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/6.jpg saved to cache
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 400a8e3b-90c9-5335-bf57-651756d093f2
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa96d0>
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_400a8e3b-90c9-5335-bf57-651756d093f2/400a8e3b-90c9-5335-bf57-651756d093f2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F24bf6c36943c4926a3b0f6d9fb9a0b8f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/5.jpg saved to cache
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 400a8e3b-90c9-5335-bf57-651756d093f2
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252Fba60d3b6ceb94f5d8f7f1837aad81c65%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/7.jpg not downloaded yet
2026-03-27 16:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252Fba60d3b6ceb94f5d8f7f1837aad81c65%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/8.jpg not downloaded yet
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590668350>
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_400a8e3b-90c9-5335-bf57-651756d093f2/400a8e3b-90c9-5335-bf57-651756d093f2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F24bf6c36943c4926a3b0f6d9fb9a0b8f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/7.jpg saved to cache
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 400a8e3b-90c9-5335-bf57-651756d093f2
2026-03-27 16:45:58 [ayvens.fr] INFO: Found listing with ID: 1988224
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988224%27 HTTP/1.1" 200 None
2026-03-27 16:45:58 [ayvens.fr] INFO: Scrape type for 1988224: 1
2026-03-27 16:45:58 [ayvens.fr] INFO: Extracting data for car ID: 1988224
2026-03-27 16:45:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 998dcbf4-eb7e-50f1-b12a-3d0d56514a79 with identifier: 1988224
2026-03-27 16:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 998dcbf4-eb7e-50f1-b12a-3d0d56514a79 with scrape type 1
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 998dcbf4-eb7e-50f1-b12a-3d0d56514a79
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fef975f70d03549fa99d7dfa5cc1e9a5c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/1.jpg not downloaded yet
2026-03-27 16:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fef975f70d03549fa99d7dfa5cc1e9a5c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/2.jpg not downloaded yet
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b52f90>
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_400a8e3b-90c9-5335-bf57-651756d093f2/400a8e3b-90c9-5335-bf57-651756d093f2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F24bf6c36943c4926a3b0f6d9fb9a0b8f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/8.jpg saved to cache
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 400a8e3b-90c9-5335-bf57-651756d093f2
2026-03-27 16:45:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 400a8e3b-90c9-5335-bf57-651756d093f2, skipping ID generation
2026-03-27 16:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 400a8e3b-90c9-5335-bf57-651756d093f2 with scrape type 1
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 400a8e3b-90c9-5335-bf57-651756d093f2 sending to next pipeline
2026-03-27 16:45:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 400a8e3b-90c9-5335-bf57-651756d093f2, identifier: 1988222
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9e450>
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8af1a400-aa29-5718-8f8d-b1f27b4a34c0/8af1a400-aa29-5718-8f8d-b1f27b4a34c0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252Fba60d3b6ceb94f5d8f7f1837aad81c65%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/1.jpg saved to cache
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8af1a400-aa29-5718-8f8d-b1f27b4a34c0
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd88d0>
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8af1a400-aa29-5718-8f8d-b1f27b4a34c0/8af1a400-aa29-5718-8f8d-b1f27b4a34c0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252Fba60d3b6ceb94f5d8f7f1837aad81c65%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/2.jpg saved to cache
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8af1a400-aa29-5718-8f8d-b1f27b4a34c0
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fef975f70d03549fa99d7dfa5cc1e9a5c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/3.jpg not downloaded yet
2026-03-27 16:45:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 400a8e3b-90c9-5335-bf57-651756d093f2 with identifier: 1988222
2026-03-27 16:45:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:45:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:45:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 400a8e3b-90c9-5335-bf57-651756d093f2 with identifier: 1988222
2026-03-27 16:45:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 400a8e3b-90c9-5335-bf57-651756d093f2 with identifier: 1988222 to the API
2026-03-27 16:45:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:45:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid',
'id': '400a8e3b-90c9-5335-bf57-651756d093f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'PUMA',
'odometer': 135786,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_400a8e3b-90c9-5335-bf57-651756d093f2/400a8e3b-90c9-5335-bf57-651756d093f2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 502088,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_400a8e3b-90c9-5335-bf57-651756d093f2/400a8e3b-90c9-5335-bf57-651756d093f2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 502088,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_400a8e3b-90c9-5335-bf57-651756d093f2/400a8e3b-90c9-5335-bf57-651756d093f2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 467994,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_400a8e3b-90c9-5335-bf57-651756d093f2/400a8e3b-90c9-5335-bf57-651756d093f2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388559,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_400a8e3b-90c9-5335-bf57-651756d093f2/400a8e3b-90c9-5335-bf57-651756d093f2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425853,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_400a8e3b-90c9-5335-bf57-651756d093f2/400a8e3b-90c9-5335-bf57-651756d093f2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387636,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_400a8e3b-90c9-5335-bf57-651756d093f2/400a8e3b-90c9-5335-bf57-651756d093f2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355124,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_400a8e3b-90c9-5335-bf57-651756d093f2/400a8e3b-90c9-5335-bf57-651756d093f2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341441,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/24bf6c36943c4926a3b0f6d9fb9a0b8f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'FORD PUMA Puma 1.0 Flexifuel 125ch S&S mHEV Titanium Business',
'transmission': 'manual',
'trim': 'Puma 1.0 Flexifuel 125ch S&S mHEV Titanium Business',
'vin': None,
'year': 2023}
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988222%27 HTTP/1.1" 200 None
2026-03-27 16:45:59 [ayvens.fr] INFO: Saving data for 1988222: {'created_time': 1774629959.181033, 'last_price_update_time': 1774629959.181044, 'auction_closing_time': 1774969200.0}
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988222') HTTP/1.1" 204 0
2026-03-27 16:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fef975f70d03549fa99d7dfa5cc1e9a5c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/4.jpg not downloaded yet
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e7d10>
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8af1a400-aa29-5718-8f8d-b1f27b4a34c0/8af1a400-aa29-5718-8f8d-b1f27b4a34c0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252Fba60d3b6ceb94f5d8f7f1837aad81c65%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/3.jpg saved to cache
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8af1a400-aa29-5718-8f8d-b1f27b4a34c0
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b23ed0>
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8af1a400-aa29-5718-8f8d-b1f27b4a34c0/8af1a400-aa29-5718-8f8d-b1f27b4a34c0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252Fba60d3b6ceb94f5d8f7f1837aad81c65%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/4.jpg saved to cache
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8af1a400-aa29-5718-8f8d-b1f27b4a34c0
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fef975f70d03549fa99d7dfa5cc1e9a5c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/5.jpg not downloaded yet
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fef975f70d03549fa99d7dfa5cc1e9a5c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/6.jpg not downloaded yet
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dbbe50>
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8af1a400-aa29-5718-8f8d-b1f27b4a34c0/8af1a400-aa29-5718-8f8d-b1f27b4a34c0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252Fba60d3b6ceb94f5d8f7f1837aad81c65%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/5.jpg saved to cache
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8af1a400-aa29-5718-8f8d-b1f27b4a34c0
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590529dd0>
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8af1a400-aa29-5718-8f8d-b1f27b4a34c0/8af1a400-aa29-5718-8f8d-b1f27b4a34c0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252Fba60d3b6ceb94f5d8f7f1837aad81c65%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/6.jpg saved to cache
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8af1a400-aa29-5718-8f8d-b1f27b4a34c0
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911820d0>
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8af1a400-aa29-5718-8f8d-b1f27b4a34c0/8af1a400-aa29-5718-8f8d-b1f27b4a34c0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252Fba60d3b6ceb94f5d8f7f1837aad81c65%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/7.jpg saved to cache
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8af1a400-aa29-5718-8f8d-b1f27b4a34c0
2026-03-27 16:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fef975f70d03549fa99d7dfa5cc1e9a5c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/7.jpg not downloaded yet
2026-03-27 16:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fef975f70d03549fa99d7dfa5cc1e9a5c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/8.jpg not downloaded yet
2026-03-27 16:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:59 [ayvens.fr] INFO: Found listing with ID: 1988225
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988225%27 HTTP/1.1" 200 None
2026-03-27 16:45:59 [ayvens.fr] INFO: Scrape type for 1988225: 1
2026-03-27 16:45:59 [ayvens.fr] INFO: Extracting data for car ID: 1988225
2026-03-27 16:45:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 074694d0-efa7-5fe7-aa40-4aa07bbc3e22 with identifier: 1988225
2026-03-27 16:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 074694d0-efa7-5fe7-aa40-4aa07bbc3e22 with scrape type 1
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 074694d0-efa7-5fe7-aa40-4aa07bbc3e22
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fbc7c8b17bcde4a018ea459f1cf3c36d4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/1.jpg not downloaded yet
2026-03-27 16:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fbc7c8b17bcde4a018ea459f1cf3c36d4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/2.jpg not downloaded yet
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fbc7c8b17bcde4a018ea459f1cf3c36d4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/3.jpg not downloaded yet
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b77310>
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8af1a400-aa29-5718-8f8d-b1f27b4a34c0/8af1a400-aa29-5718-8f8d-b1f27b4a34c0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252Fba60d3b6ceb94f5d8f7f1837aad81c65%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/8.jpg saved to cache
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8af1a400-aa29-5718-8f8d-b1f27b4a34c0
2026-03-27 16:45:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8af1a400-aa29-5718-8f8d-b1f27b4a34c0, skipping ID generation
2026-03-27 16:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8af1a400-aa29-5718-8f8d-b1f27b4a34c0 with scrape type 1
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8af1a400-aa29-5718-8f8d-b1f27b4a34c0 sending to next pipeline
2026-03-27 16:45:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8af1a400-aa29-5718-8f8d-b1f27b4a34c0, identifier: 1988223
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065e590>
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_998dcbf4-eb7e-50f1-b12a-3d0d56514a79/998dcbf4-eb7e-50f1-b12a-3d0d56514a79_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fef975f70d03549fa99d7dfa5cc1e9a5c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/1.jpg saved to cache
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 998dcbf4-eb7e-50f1-b12a-3d0d56514a79
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fbc7c8b17bcde4a018ea459f1cf3c36d4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/4.jpg not downloaded yet
2026-03-27 16:45:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8af1a400-aa29-5718-8f8d-b1f27b4a34c0 with identifier: 1988223
2026-03-27 16:45:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8af1a400-aa29-5718-8f8d-b1f27b4a34c0 with identifier: 1988223
2026-03-27 16:46:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8af1a400-aa29-5718-8f8d-b1f27b4a34c0 with identifier: 1988223 to the API
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '8af1a400-aa29-5718-8f8d-b1f27b4a34c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 63109,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8af1a400-aa29-5718-8f8d-b1f27b4a34c0/8af1a400-aa29-5718-8f8d-b1f27b4a34c0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338159,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8af1a400-aa29-5718-8f8d-b1f27b4a34c0/8af1a400-aa29-5718-8f8d-b1f27b4a34c0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338159,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8af1a400-aa29-5718-8f8d-b1f27b4a34c0/8af1a400-aa29-5718-8f8d-b1f27b4a34c0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327502,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8af1a400-aa29-5718-8f8d-b1f27b4a34c0/8af1a400-aa29-5718-8f8d-b1f27b4a34c0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331959,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8af1a400-aa29-5718-8f8d-b1f27b4a34c0/8af1a400-aa29-5718-8f8d-b1f27b4a34c0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322113,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8af1a400-aa29-5718-8f8d-b1f27b4a34c0/8af1a400-aa29-5718-8f8d-b1f27b4a34c0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290356,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8af1a400-aa29-5718-8f8d-b1f27b4a34c0/8af1a400-aa29-5718-8f8d-b1f27b4a34c0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316467,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8af1a400-aa29-5718-8f8d-b1f27b4a34c0/8af1a400-aa29-5718-8f8d-b1f27b4a34c0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433747,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/ba60d3b6ceb94f5d8f7f1837aad81c65/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-03',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch E6.c Active Business S&S',
'transmission': 'manual',
'trim': '3008 1.2 PureTech 130ch E6.c Active Business S&S',
'vin': None,
'year': 2019}
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988223%27 HTTP/1.1" 200 None
2026-03-27 16:46:00 [ayvens.fr] INFO: Saving data for 1988223: {'created_time': 1774629960.444601, 'last_price_update_time': 1774629960.444613, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988223') HTTP/1.1" 204 0
2026-03-27 16:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b6be50>
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_998dcbf4-eb7e-50f1-b12a-3d0d56514a79/998dcbf4-eb7e-50f1-b12a-3d0d56514a79_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fef975f70d03549fa99d7dfa5cc1e9a5c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/2.jpg saved to cache
2026-03-27 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 998dcbf4-eb7e-50f1-b12a-3d0d56514a79
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fbc7c8b17bcde4a018ea459f1cf3c36d4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/5.jpg not downloaded yet
2026-03-27 16:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee2550>
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_998dcbf4-eb7e-50f1-b12a-3d0d56514a79/998dcbf4-eb7e-50f1-b12a-3d0d56514a79_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fef975f70d03549fa99d7dfa5cc1e9a5c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/4.jpg saved to cache
2026-03-27 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 998dcbf4-eb7e-50f1-b12a-3d0d56514a79
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590591210>
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_998dcbf4-eb7e-50f1-b12a-3d0d56514a79/998dcbf4-eb7e-50f1-b12a-3d0d56514a79_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fef975f70d03549fa99d7dfa5cc1e9a5c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/3.jpg saved to cache
2026-03-27 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 998dcbf4-eb7e-50f1-b12a-3d0d56514a79
2026-03-27 16:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fbc7c8b17bcde4a018ea459f1cf3c36d4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/6.jpg not downloaded yet
2026-03-27 16:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fbc7c8b17bcde4a018ea459f1cf3c36d4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/7.jpg not downloaded yet
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7ce90>
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_998dcbf4-eb7e-50f1-b12a-3d0d56514a79/998dcbf4-eb7e-50f1-b12a-3d0d56514a79_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fef975f70d03549fa99d7dfa5cc1e9a5c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/7.jpg saved to cache
2026-03-27 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 998dcbf4-eb7e-50f1-b12a-3d0d56514a79
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59064ec50>
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_998dcbf4-eb7e-50f1-b12a-3d0d56514a79/998dcbf4-eb7e-50f1-b12a-3d0d56514a79_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fef975f70d03549fa99d7dfa5cc1e9a5c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/5.jpg saved to cache
2026-03-27 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 998dcbf4-eb7e-50f1-b12a-3d0d56514a79
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fbc7c8b17bcde4a018ea459f1cf3c36d4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/8.jpg not downloaded yet
2026-03-27 16:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591480890>
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_998dcbf4-eb7e-50f1-b12a-3d0d56514a79/998dcbf4-eb7e-50f1-b12a-3d0d56514a79_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fef975f70d03549fa99d7dfa5cc1e9a5c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/6.jpg saved to cache
2026-03-27 16:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 998dcbf4-eb7e-50f1-b12a-3d0d56514a79
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590675410>
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_074694d0-efa7-5fe7-aa40-4aa07bbc3e22/074694d0-efa7-5fe7-aa40-4aa07bbc3e22_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fbc7c8b17bcde4a018ea459f1cf3c36d4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/1.jpg saved to cache
2026-03-27 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 074694d0-efa7-5fe7-aa40-4aa07bbc3e22
2026-03-27 16:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b36c50>
2026-03-27 16:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_998dcbf4-eb7e-50f1-b12a-3d0d56514a79/998dcbf4-eb7e-50f1-b12a-3d0d56514a79_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fef975f70d03549fa99d7dfa5cc1e9a5c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/8.jpg saved to cache
2026-03-27 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 998dcbf4-eb7e-50f1-b12a-3d0d56514a79
2026-03-27 16:46:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 998dcbf4-eb7e-50f1-b12a-3d0d56514a79, skipping ID generation
2026-03-27 16:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 998dcbf4-eb7e-50f1-b12a-3d0d56514a79 with scrape type 1
2026-03-27 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 998dcbf4-eb7e-50f1-b12a-3d0d56514a79 sending to next pipeline
2026-03-27 16:46:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 998dcbf4-eb7e-50f1-b12a-3d0d56514a79, identifier: 1988224
2026-03-27 16:46:01 [ayvens.fr] INFO: Found listing with ID: 1988226
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988226%27 HTTP/1.1" 200 None
2026-03-27 16:46:01 [ayvens.fr] INFO: Scrape type for 1988226: 1
2026-03-27 16:46:01 [ayvens.fr] INFO: Extracting data for car ID: 1988226
2026-03-27 16:46:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e with identifier: 1988226
2026-03-27 16:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e with scrape type 1
2026-03-27 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc1f6b30ba62548a0a7f63f212346d1e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/1.jpg not downloaded yet
2026-03-27 16:46:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 998dcbf4-eb7e-50f1-b12a-3d0d56514a79 with identifier: 1988224
2026-03-27 16:46:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 998dcbf4-eb7e-50f1-b12a-3d0d56514a79 with identifier: 1988224
2026-03-27 16:46:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 998dcbf4-eb7e-50f1-b12a-3d0d56514a79 with identifier: 1988224 to the API
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '998dcbf4-eb7e-50f1-b12a-3d0d56514a79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 101457,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_998dcbf4-eb7e-50f1-b12a-3d0d56514a79/998dcbf4-eb7e-50f1-b12a-3d0d56514a79_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385915,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_998dcbf4-eb7e-50f1-b12a-3d0d56514a79/998dcbf4-eb7e-50f1-b12a-3d0d56514a79_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385915,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_998dcbf4-eb7e-50f1-b12a-3d0d56514a79/998dcbf4-eb7e-50f1-b12a-3d0d56514a79_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327186,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_998dcbf4-eb7e-50f1-b12a-3d0d56514a79/998dcbf4-eb7e-50f1-b12a-3d0d56514a79_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308989,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_998dcbf4-eb7e-50f1-b12a-3d0d56514a79/998dcbf4-eb7e-50f1-b12a-3d0d56514a79_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260897,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_998dcbf4-eb7e-50f1-b12a-3d0d56514a79/998dcbf4-eb7e-50f1-b12a-3d0d56514a79_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258014,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_998dcbf4-eb7e-50f1-b12a-3d0d56514a79/998dcbf4-eb7e-50f1-b12a-3d0d56514a79_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257450,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_998dcbf4-eb7e-50f1-b12a-3d0d56514a79/998dcbf4-eb7e-50f1-b12a-3d0d56514a79_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388877,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/ef975f70d03549fa99d7dfa5cc1e9a5c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-12',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 1.2 PureTech 83ch S&S Feel Business',
'transmission': 'manual',
'trim': 'C3 1.2 PureTech 83ch S&S Feel Business',
'vin': None,
'year': 2020}
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988224%27 HTTP/1.1" 200 None
2026-03-27 16:46:01 [ayvens.fr] INFO: Saving data for 1988224: {'created_time': 1774629961.563211, 'last_price_update_time': 1774629961.563224, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988224') HTTP/1.1" 204 0
2026-03-27 16:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc1f6b30ba62548a0a7f63f212346d1e7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/2.jpg not downloaded yet
2026-03-27 16:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc7750>
2026-03-27 16:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_074694d0-efa7-5fe7-aa40-4aa07bbc3e22/074694d0-efa7-5fe7-aa40-4aa07bbc3e22_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fbc7c8b17bcde4a018ea459f1cf3c36d4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/2.jpg saved to cache
2026-03-27 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 074694d0-efa7-5fe7-aa40-4aa07bbc3e22
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc1f6b30ba62548a0a7f63f212346d1e7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/3.jpg not downloaded yet
2026-03-27 16:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc1f6b30ba62548a0a7f63f212346d1e7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/4.jpg not downloaded yet
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc1f6b30ba62548a0a7f63f212346d1e7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/5.jpg not downloaded yet
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc1f6b30ba62548a0a7f63f212346d1e7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/6.jpg not downloaded yet
2026-03-27 16:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b18610>
2026-03-27 16:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_074694d0-efa7-5fe7-aa40-4aa07bbc3e22/074694d0-efa7-5fe7-aa40-4aa07bbc3e22_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fbc7c8b17bcde4a018ea459f1cf3c36d4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/3.jpg saved to cache
2026-03-27 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 074694d0-efa7-5fe7-aa40-4aa07bbc3e22
2026-03-27 16:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5914304d0>
2026-03-27 16:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_074694d0-efa7-5fe7-aa40-4aa07bbc3e22/074694d0-efa7-5fe7-aa40-4aa07bbc3e22_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fbc7c8b17bcde4a018ea459f1cf3c36d4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/5.jpg saved to cache
2026-03-27 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 074694d0-efa7-5fe7-aa40-4aa07bbc3e22
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc1f6b30ba62548a0a7f63f212346d1e7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/7.jpg not downloaded yet
2026-03-27 16:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b50ad0>
2026-03-27 16:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_074694d0-efa7-5fe7-aa40-4aa07bbc3e22/074694d0-efa7-5fe7-aa40-4aa07bbc3e22_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fbc7c8b17bcde4a018ea459f1cf3c36d4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/4.jpg saved to cache
2026-03-27 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 074694d0-efa7-5fe7-aa40-4aa07bbc3e22
2026-03-27 16:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b22e50>
2026-03-27 16:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_074694d0-efa7-5fe7-aa40-4aa07bbc3e22/074694d0-efa7-5fe7-aa40-4aa07bbc3e22_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fbc7c8b17bcde4a018ea459f1cf3c36d4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/6.jpg saved to cache
2026-03-27 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 074694d0-efa7-5fe7-aa40-4aa07bbc3e22
2026-03-27 16:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc1f6b30ba62548a0a7f63f212346d1e7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/8.jpg not downloaded yet
2026-03-27 16:46:02 [ayvens.fr] INFO: Found listing with ID: 1988227
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988227%27 HTTP/1.1" 200 None
2026-03-27 16:46:02 [ayvens.fr] INFO: Scrape type for 1988227: 1
2026-03-27 16:46:02 [ayvens.fr] INFO: Extracting data for car ID: 1988227
2026-03-27 16:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84fcb59b-18fe-534f-bd0c-f9025f94a3d9 with identifier: 1988227
2026-03-27 16:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84fcb59b-18fe-534f-bd0c-f9025f94a3d9 with scrape type 1
2026-03-27 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 84fcb59b-18fe-534f-bd0c-f9025f94a3d9
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa8f414c254be4a6497adc6e3576f1fc6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/1.jpg not downloaded yet
2026-03-27 16:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590592c90>
2026-03-27 16:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_074694d0-efa7-5fe7-aa40-4aa07bbc3e22/074694d0-efa7-5fe7-aa40-4aa07bbc3e22_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fbc7c8b17bcde4a018ea459f1cf3c36d4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/8.jpg saved to cache
2026-03-27 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 074694d0-efa7-5fe7-aa40-4aa07bbc3e22
2026-03-27 16:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa8f414c254be4a6497adc6e3576f1fc6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/2.jpg not downloaded yet
2026-03-27 16:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae0c10>
2026-03-27 16:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_074694d0-efa7-5fe7-aa40-4aa07bbc3e22/074694d0-efa7-5fe7-aa40-4aa07bbc3e22_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fbc7c8b17bcde4a018ea459f1cf3c36d4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/7.jpg saved to cache
2026-03-27 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 074694d0-efa7-5fe7-aa40-4aa07bbc3e22
2026-03-27 16:46:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 074694d0-efa7-5fe7-aa40-4aa07bbc3e22, skipping ID generation
2026-03-27 16:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 074694d0-efa7-5fe7-aa40-4aa07bbc3e22 with scrape type 1
2026-03-27 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 074694d0-efa7-5fe7-aa40-4aa07bbc3e22 sending to next pipeline
2026-03-27 16:46:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 074694d0-efa7-5fe7-aa40-4aa07bbc3e22, identifier: 1988225
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa8f414c254be4a6497adc6e3576f1fc6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/3.jpg not downloaded yet
2026-03-27 16:46:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 074694d0-efa7-5fe7-aa40-4aa07bbc3e22 with identifier: 1988225
2026-03-27 16:46:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 074694d0-efa7-5fe7-aa40-4aa07bbc3e22 with identifier: 1988225
2026-03-27 16:46:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 074694d0-efa7-5fe7-aa40-4aa07bbc3e22 with identifier: 1988225 to the API
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'GRIS TITANIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'gas',
'id': '074694d0-efa7-5fe7-aa40-4aa07bbc3e22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 60959,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_074694d0-efa7-5fe7-aa40-4aa07bbc3e22/074694d0-efa7-5fe7-aa40-4aa07bbc3e22_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328278,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_074694d0-efa7-5fe7-aa40-4aa07bbc3e22/074694d0-efa7-5fe7-aa40-4aa07bbc3e22_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328278,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_074694d0-efa7-5fe7-aa40-4aa07bbc3e22/074694d0-efa7-5fe7-aa40-4aa07bbc3e22_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368711,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_074694d0-efa7-5fe7-aa40-4aa07bbc3e22/074694d0-efa7-5fe7-aa40-4aa07bbc3e22_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342870,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_074694d0-efa7-5fe7-aa40-4aa07bbc3e22/074694d0-efa7-5fe7-aa40-4aa07bbc3e22_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324291,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_074694d0-efa7-5fe7-aa40-4aa07bbc3e22/074694d0-efa7-5fe7-aa40-4aa07bbc3e22_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339803,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_074694d0-efa7-5fe7-aa40-4aa07bbc3e22/074694d0-efa7-5fe7-aa40-4aa07bbc3e22_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283145,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_074694d0-efa7-5fe7-aa40-4aa07bbc3e22/074694d0-efa7-5fe7-aa40-4aa07bbc3e22_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329681,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/bc7c8b17bcde4a018ea459f1cf3c36d4/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-29',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.0 TCe 100ch Intens GPL -21',
'transmission': 'manual',
'trim': 'Clio 1.0 TCe 100ch Intens GPL -21',
'vin': None,
'year': 2021}
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988225%27 HTTP/1.1" 200 None
2026-03-27 16:46:02 [ayvens.fr] INFO: Saving data for 1988225: {'created_time': 1774629962.972715, 'last_price_update_time': 1774629962.972726, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988225') HTTP/1.1" 204 0
2026-03-27 16:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa8f414c254be4a6497adc6e3576f1fc6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/4.jpg not downloaded yet
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae3f90>
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e/7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc1f6b30ba62548a0a7f63f212346d1e7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/2.jpg saved to cache
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065c050>
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e/7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc1f6b30ba62548a0a7f63f212346d1e7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/3.jpg saved to cache
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ec4e90>
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e/7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc1f6b30ba62548a0a7f63f212346d1e7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/4.jpg saved to cache
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b53f50>
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e/7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc1f6b30ba62548a0a7f63f212346d1e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/1.jpg saved to cache
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9f9d0>
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e/7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc1f6b30ba62548a0a7f63f212346d1e7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/5.jpg saved to cache
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa8f414c254be4a6497adc6e3576f1fc6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/5.jpg not downloaded yet
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa8f414c254be4a6497adc6e3576f1fc6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/6.jpg not downloaded yet
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590675ad0>
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e/7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc1f6b30ba62548a0a7f63f212346d1e7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/6.jpg saved to cache
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a32d0>
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e/7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc1f6b30ba62548a0a7f63f212346d1e7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/7.jpg saved to cache
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e
2026-03-27 16:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa8f414c254be4a6497adc6e3576f1fc6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/7.jpg not downloaded yet
2026-03-27 16:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa8f414c254be4a6497adc6e3576f1fc6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/8.jpg not downloaded yet
2026-03-27 16:46:03 [ayvens.fr] INFO: Found listing with ID: 1988228
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988228%27 HTTP/1.1" 200 None
2026-03-27 16:46:03 [ayvens.fr] INFO: Scrape type for 1988228: 1
2026-03-27 16:46:03 [ayvens.fr] INFO: Extracting data for car ID: 1988228
2026-03-27 16:46:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fd1df72-9ae3-57cf-b08f-8453f523c7ce with identifier: 1988228
2026-03-27 16:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fd1df72-9ae3-57cf-b08f-8453f523c7ce with scrape type 1
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0fd1df72-9ae3-57cf-b08f-8453f523c7ce
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3735ef58fc154397b7354f6fdeb0ff02%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/1.jpg not downloaded yet
2026-03-27 16:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3735ef58fc154397b7354f6fdeb0ff02%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/2.jpg not downloaded yet
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3735ef58fc154397b7354f6fdeb0ff02%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/3.jpg not downloaded yet
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3735ef58fc154397b7354f6fdeb0ff02%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/4.jpg not downloaded yet
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3735ef58fc154397b7354f6fdeb0ff02%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/5.jpg not downloaded yet
2026-03-27 16:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e08410>
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e/7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc1f6b30ba62548a0a7f63f212346d1e7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/8.jpg saved to cache
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e
2026-03-27 16:46:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e, skipping ID generation
2026-03-27 16:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e with scrape type 1
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e sending to next pipeline
2026-03-27 16:46:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e, identifier: 1988226
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b61550>
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84fcb59b-18fe-534f-bd0c-f9025f94a3d9/84fcb59b-18fe-534f-bd0c-f9025f94a3d9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa8f414c254be4a6497adc6e3576f1fc6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/1.jpg saved to cache
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84fcb59b-18fe-534f-bd0c-f9025f94a3d9
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee1210>
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84fcb59b-18fe-534f-bd0c-f9025f94a3d9/84fcb59b-18fe-534f-bd0c-f9025f94a3d9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa8f414c254be4a6497adc6e3576f1fc6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/2.jpg saved to cache
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84fcb59b-18fe-534f-bd0c-f9025f94a3d9
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3735ef58fc154397b7354f6fdeb0ff02%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/6.jpg not downloaded yet
2026-03-27 16:46:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e with identifier: 1988226
2026-03-27 16:46:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e with identifier: 1988226
2026-03-27 16:46:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e with identifier: 1988226 to the API
2026-03-27 16:46:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 140220,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e/7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379224,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e/7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379224,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e/7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274926,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e/7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290632,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e/7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217964,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e/7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250909,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e/7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248386,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e/7b18edb0-4f8b-555a-9166-6d6d2b1e7a5e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 493171,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/c1f6b30ba62548a0a7f63f212346d1e7/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-08',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 130ch S&S Allure Business EAT8',
'transmission': 'automatic',
'trim': '2008 1.2 PureTech 130ch S&S Allure Business EAT8',
'vin': None,
'year': 2021}
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988226%27 HTTP/1.1" 200 None
2026-03-27 16:46:04 [ayvens.fr] INFO: Saving data for 1988226: {'created_time': 1774629964.241586, 'last_price_update_time': 1774629964.241601, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988226') HTTP/1.1" 204 0
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3735ef58fc154397b7354f6fdeb0ff02%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/7.jpg not downloaded yet
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d81190>
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84fcb59b-18fe-534f-bd0c-f9025f94a3d9/84fcb59b-18fe-534f-bd0c-f9025f94a3d9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa8f414c254be4a6497adc6e3576f1fc6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/4.jpg saved to cache
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84fcb59b-18fe-534f-bd0c-f9025f94a3d9
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2c3d0>
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84fcb59b-18fe-534f-bd0c-f9025f94a3d9/84fcb59b-18fe-534f-bd0c-f9025f94a3d9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa8f414c254be4a6497adc6e3576f1fc6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/3.jpg saved to cache
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84fcb59b-18fe-534f-bd0c-f9025f94a3d9
2026-03-27 16:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3735ef58fc154397b7354f6fdeb0ff02%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/8.jpg not downloaded yet
2026-03-27 16:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:04 [ayvens.fr] INFO: Found listing with ID: 1988229
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988229%27 HTTP/1.1" 200 None
2026-03-27 16:46:04 [ayvens.fr] INFO: Scrape type for 1988229: 1
2026-03-27 16:46:04 [ayvens.fr] INFO: Extracting data for car ID: 1988229
2026-03-27 16:46:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0fa24f0-da2c-572e-8d29-5312d4afe6f7 with identifier: 1988229
2026-03-27 16:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0fa24f0-da2c-572e-8d29-5312d4afe6f7 with scrape type 1
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c0fa24f0-da2c-572e-8d29-5312d4afe6f7
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F220f4e45638e433daf0df14e15f6ffaf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/1.jpg not downloaded yet
2026-03-27 16:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F220f4e45638e433daf0df14e15f6ffaf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/2.jpg not downloaded yet
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F220f4e45638e433daf0df14e15f6ffaf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/3.jpg not downloaded yet
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F220f4e45638e433daf0df14e15f6ffaf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/4.jpg not downloaded yet
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F220f4e45638e433daf0df14e15f6ffaf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/5.jpg not downloaded yet
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051a290>
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84fcb59b-18fe-534f-bd0c-f9025f94a3d9/84fcb59b-18fe-534f-bd0c-f9025f94a3d9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa8f414c254be4a6497adc6e3576f1fc6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/5.jpg saved to cache
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84fcb59b-18fe-534f-bd0c-f9025f94a3d9
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa2250>
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84fcb59b-18fe-534f-bd0c-f9025f94a3d9/84fcb59b-18fe-534f-bd0c-f9025f94a3d9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa8f414c254be4a6497adc6e3576f1fc6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/6.jpg saved to cache
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84fcb59b-18fe-534f-bd0c-f9025f94a3d9
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F220f4e45638e433daf0df14e15f6ffaf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/6.jpg not downloaded yet
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F220f4e45638e433daf0df14e15f6ffaf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/7.jpg not downloaded yet
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b6aad0>
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd1df72-9ae3-57cf-b08f-8453f523c7ce/0fd1df72-9ae3-57cf-b08f-8453f523c7ce_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3735ef58fc154397b7354f6fdeb0ff02%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/1.jpg saved to cache
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0fd1df72-9ae3-57cf-b08f-8453f523c7ce
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590daca90>
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd1df72-9ae3-57cf-b08f-8453f523c7ce/0fd1df72-9ae3-57cf-b08f-8453f523c7ce_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3735ef58fc154397b7354f6fdeb0ff02%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/2.jpg saved to cache
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0fd1df72-9ae3-57cf-b08f-8453f523c7ce
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050f290>
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd1df72-9ae3-57cf-b08f-8453f523c7ce/0fd1df72-9ae3-57cf-b08f-8453f523c7ce_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3735ef58fc154397b7354f6fdeb0ff02%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/3.jpg saved to cache
2026-03-27 16:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0fd1df72-9ae3-57cf-b08f-8453f523c7ce
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5942bea90>
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84fcb59b-18fe-534f-bd0c-f9025f94a3d9/84fcb59b-18fe-534f-bd0c-f9025f94a3d9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa8f414c254be4a6497adc6e3576f1fc6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/7.jpg saved to cache
2026-03-27 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84fcb59b-18fe-534f-bd0c-f9025f94a3d9
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a8c90>
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84fcb59b-18fe-534f-bd0c-f9025f94a3d9/84fcb59b-18fe-534f-bd0c-f9025f94a3d9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa8f414c254be4a6497adc6e3576f1fc6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/8.jpg saved to cache
2026-03-27 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84fcb59b-18fe-534f-bd0c-f9025f94a3d9
2026-03-27 16:46:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84fcb59b-18fe-534f-bd0c-f9025f94a3d9, skipping ID generation
2026-03-27 16:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84fcb59b-18fe-534f-bd0c-f9025f94a3d9 with scrape type 1
2026-03-27 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84fcb59b-18fe-534f-bd0c-f9025f94a3d9 sending to next pipeline
2026-03-27 16:46:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 84fcb59b-18fe-534f-bd0c-f9025f94a3d9, identifier: 1988227
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5936b6550>
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd1df72-9ae3-57cf-b08f-8453f523c7ce/0fd1df72-9ae3-57cf-b08f-8453f523c7ce_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3735ef58fc154397b7354f6fdeb0ff02%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/4.jpg saved to cache
2026-03-27 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0fd1df72-9ae3-57cf-b08f-8453f523c7ce
2026-03-27 16:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 84fcb59b-18fe-534f-bd0c-f9025f94a3d9 with identifier: 1988227
2026-03-27 16:46:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 84fcb59b-18fe-534f-bd0c-f9025f94a3d9 with identifier: 1988227
2026-03-27 16:46:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 84fcb59b-18fe-534f-bd0c-f9025f94a3d9 with identifier: 1988227 to the API
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 106,
'color': 'BOSSA NOVA WHITE',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '84fcb59b-18fe-534f-bd0c-f9025f94a3d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 21439,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84fcb59b-18fe-534f-bd0c-f9025f94a3d9/84fcb59b-18fe-534f-bd0c-f9025f94a3d9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294583,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84fcb59b-18fe-534f-bd0c-f9025f94a3d9/84fcb59b-18fe-534f-bd0c-f9025f94a3d9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294583,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84fcb59b-18fe-534f-bd0c-f9025f94a3d9/84fcb59b-18fe-534f-bd0c-f9025f94a3d9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318282,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84fcb59b-18fe-534f-bd0c-f9025f94a3d9/84fcb59b-18fe-534f-bd0c-f9025f94a3d9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334596,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84fcb59b-18fe-534f-bd0c-f9025f94a3d9/84fcb59b-18fe-534f-bd0c-f9025f94a3d9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352814,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84fcb59b-18fe-534f-bd0c-f9025f94a3d9/84fcb59b-18fe-534f-bd0c-f9025f94a3d9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299313,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84fcb59b-18fe-534f-bd0c-f9025f94a3d9/84fcb59b-18fe-534f-bd0c-f9025f94a3d9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316431,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84fcb59b-18fe-534f-bd0c-f9025f94a3d9/84fcb59b-18fe-534f-bd0c-f9025f94a3d9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327772,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/a8f414c254be4a6497adc6e3576f1fc6/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 1.0 70ch BSG S&S Cult',
'transmission': 'manual',
'trim': '500 1.0 70ch BSG S&S Cult',
'vin': None,
'year': 2022}
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988227%27 HTTP/1.1" 200 None
2026-03-27 16:46:05 [ayvens.fr] INFO: Saving data for 1988227: {'created_time': 1774629965.597719, 'last_price_update_time': 1774629965.597734, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988227') HTTP/1.1" 204 0
2026-03-27 16:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F220f4e45638e433daf0df14e15f6ffaf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/8.jpg not downloaded yet
2026-03-27 16:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:05 [ayvens.fr] INFO: Found listing with ID: 1988230
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988230%27 HTTP/1.1" 200 None
2026-03-27 16:46:05 [ayvens.fr] INFO: Scrape type for 1988230: 1
2026-03-27 16:46:05 [ayvens.fr] INFO: Extracting data for car ID: 1988230
2026-03-27 16:46:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc3a3269-3b8d-5c44-b626-bd543678ee34 with identifier: 1988230
2026-03-27 16:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc3a3269-3b8d-5c44-b626-bd543678ee34 with scrape type 1
2026-03-27 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item fc3a3269-3b8d-5c44-b626-bd543678ee34
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fd769554d0c904d94963b085c2aba69ac%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/1.jpg not downloaded yet
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59102c150>
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd1df72-9ae3-57cf-b08f-8453f523c7ce/0fd1df72-9ae3-57cf-b08f-8453f523c7ce_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3735ef58fc154397b7354f6fdeb0ff02%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/7.jpg saved to cache
2026-03-27 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0fd1df72-9ae3-57cf-b08f-8453f523c7ce
2026-03-27 16:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fd769554d0c904d94963b085c2aba69ac%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/2.jpg not downloaded yet
2026-03-27 16:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fd769554d0c904d94963b085c2aba69ac%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/3.jpg not downloaded yet
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904fdb10>
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd1df72-9ae3-57cf-b08f-8453f523c7ce/0fd1df72-9ae3-57cf-b08f-8453f523c7ce_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3735ef58fc154397b7354f6fdeb0ff02%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/6.jpg saved to cache
2026-03-27 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0fd1df72-9ae3-57cf-b08f-8453f523c7ce
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abf890>
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd1df72-9ae3-57cf-b08f-8453f523c7ce/0fd1df72-9ae3-57cf-b08f-8453f523c7ce_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3735ef58fc154397b7354f6fdeb0ff02%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/5.jpg saved to cache
2026-03-27 16:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0fd1df72-9ae3-57cf-b08f-8453f523c7ce
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ddb850>
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0fa24f0-da2c-572e-8d29-5312d4afe6f7/c0fa24f0-da2c-572e-8d29-5312d4afe6f7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F220f4e45638e433daf0df14e15f6ffaf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/1.jpg saved to cache
2026-03-27 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0fa24f0-da2c-572e-8d29-5312d4afe6f7
2026-03-27 16:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a23d0>
2026-03-27 16:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd1df72-9ae3-57cf-b08f-8453f523c7ce/0fd1df72-9ae3-57cf-b08f-8453f523c7ce_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3735ef58fc154397b7354f6fdeb0ff02%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/8.jpg saved to cache
2026-03-27 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0fd1df72-9ae3-57cf-b08f-8453f523c7ce
2026-03-27 16:46:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0fd1df72-9ae3-57cf-b08f-8453f523c7ce, skipping ID generation
2026-03-27 16:46:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fd1df72-9ae3-57cf-b08f-8453f523c7ce with scrape type 1
2026-03-27 16:46:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0fd1df72-9ae3-57cf-b08f-8453f523c7ce sending to next pipeline
2026-03-27 16:46:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0fd1df72-9ae3-57cf-b08f-8453f523c7ce, identifier: 1988228
2026-03-27 16:46:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0fd1df72-9ae3-57cf-b08f-8453f523c7ce with identifier: 1988228
2026-03-27 16:46:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0fd1df72-9ae3-57cf-b08f-8453f523c7ce with identifier: 1988228
2026-03-27 16:46:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0fd1df72-9ae3-57cf-b08f-8453f523c7ce with identifier: 1988228 to the API
2026-03-27 16:46:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'GRIS VULKAN',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '0fd1df72-9ae3-57cf-b08f-8453f523c7ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'ASTRA',
'odometer': 23533,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd1df72-9ae3-57cf-b08f-8453f523c7ce/0fd1df72-9ae3-57cf-b08f-8453f523c7ce_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300013,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd1df72-9ae3-57cf-b08f-8453f523c7ce/0fd1df72-9ae3-57cf-b08f-8453f523c7ce_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300013,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd1df72-9ae3-57cf-b08f-8453f523c7ce/0fd1df72-9ae3-57cf-b08f-8453f523c7ce_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288157,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd1df72-9ae3-57cf-b08f-8453f523c7ce/0fd1df72-9ae3-57cf-b08f-8453f523c7ce_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286887,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd1df72-9ae3-57cf-b08f-8453f523c7ce/0fd1df72-9ae3-57cf-b08f-8453f523c7ce_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349728,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd1df72-9ae3-57cf-b08f-8453f523c7ce/0fd1df72-9ae3-57cf-b08f-8453f523c7ce_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320468,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd1df72-9ae3-57cf-b08f-8453f523c7ce/0fd1df72-9ae3-57cf-b08f-8453f523c7ce_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273024,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd1df72-9ae3-57cf-b08f-8453f523c7ce/0fd1df72-9ae3-57cf-b08f-8453f523c7ce_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360331,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3735ef58fc154397b7354f6fdeb0ff02/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-02',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL ASTRA Astra 1.2 Turbo 130ch GS',
'transmission': 'manual',
'trim': 'Astra 1.2 Turbo 130ch GS',
'vin': None,
'year': 2023}
2026-03-27 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988228%27 HTTP/1.1" 200 None
2026-03-27 16:46:06 [ayvens.fr] INFO: Saving data for 1988228: {'created_time': 1774629966.914077, 'last_price_update_time': 1774629966.914088, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988228') HTTP/1.1" 204 0
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fd769554d0c904d94963b085c2aba69ac%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/4.jpg not downloaded yet
2026-03-27 16:46:07 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at 5 pages/min), scraped 31 items (at 31 items/min)
2026-03-27 16:46:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ddbf50>
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0fa24f0-da2c-572e-8d29-5312d4afe6f7/c0fa24f0-da2c-572e-8d29-5312d4afe6f7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F220f4e45638e433daf0df14e15f6ffaf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/2.jpg saved to cache
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0fa24f0-da2c-572e-8d29-5312d4afe6f7
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b40990>
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0fa24f0-da2c-572e-8d29-5312d4afe6f7/c0fa24f0-da2c-572e-8d29-5312d4afe6f7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F220f4e45638e433daf0df14e15f6ffaf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/3.jpg saved to cache
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0fa24f0-da2c-572e-8d29-5312d4afe6f7
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d63f10>
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0fa24f0-da2c-572e-8d29-5312d4afe6f7/c0fa24f0-da2c-572e-8d29-5312d4afe6f7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F220f4e45638e433daf0df14e15f6ffaf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/4.jpg saved to cache
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0fa24f0-da2c-572e-8d29-5312d4afe6f7
2026-03-27 16:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fd769554d0c904d94963b085c2aba69ac%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/5.jpg not downloaded yet
2026-03-27 16:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fd769554d0c904d94963b085c2aba69ac%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/6.jpg not downloaded yet
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fd769554d0c904d94963b085c2aba69ac%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/7.jpg not downloaded yet
2026-03-27 16:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fd769554d0c904d94963b085c2aba69ac%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/8.jpg not downloaded yet
2026-03-27 16:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:07 [ayvens.fr] INFO: Found listing with ID: 1988231
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988231%27 HTTP/1.1" 200 None
2026-03-27 16:46:07 [ayvens.fr] INFO: Scrape type for 1988231: 1
2026-03-27 16:46:07 [ayvens.fr] INFO: Extracting data for car ID: 1988231
2026-03-27 16:46:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa96c947-ec23-58a3-8617-682c9c497d93 with identifier: 1988231
2026-03-27 16:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa96c947-ec23-58a3-8617-682c9c497d93 with scrape type 1
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item aa96c947-ec23-58a3-8617-682c9c497d93
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3eedd99de7a74c3db903516254e23f29%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/1.jpg not downloaded yet
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3eedd99de7a74c3db903516254e23f29%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/2.jpg not downloaded yet
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae9190>
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0fa24f0-da2c-572e-8d29-5312d4afe6f7/c0fa24f0-da2c-572e-8d29-5312d4afe6f7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F220f4e45638e433daf0df14e15f6ffaf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/7.jpg saved to cache
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0fa24f0-da2c-572e-8d29-5312d4afe6f7
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3eedd99de7a74c3db903516254e23f29%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/3.jpg not downloaded yet
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd0750>
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0fa24f0-da2c-572e-8d29-5312d4afe6f7/c0fa24f0-da2c-572e-8d29-5312d4afe6f7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F220f4e45638e433daf0df14e15f6ffaf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/5.jpg saved to cache
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0fa24f0-da2c-572e-8d29-5312d4afe6f7
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ab87d0>
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0fa24f0-da2c-572e-8d29-5312d4afe6f7/c0fa24f0-da2c-572e-8d29-5312d4afe6f7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F220f4e45638e433daf0df14e15f6ffaf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/6.jpg saved to cache
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c0fa24f0-da2c-572e-8d29-5312d4afe6f7
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d51850>
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3a3269-3b8d-5c44-b626-bd543678ee34/fc3a3269-3b8d-5c44-b626-bd543678ee34_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fd769554d0c904d94963b085c2aba69ac%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/1.jpg saved to cache
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc3a3269-3b8d-5c44-b626-bd543678ee34
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3eedd99de7a74c3db903516254e23f29%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/4.jpg not downloaded yet
2026-03-27 16:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3eedd99de7a74c3db903516254e23f29%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/5.jpg not downloaded yet
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59287a790>
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0fa24f0-da2c-572e-8d29-5312d4afe6f7/c0fa24f0-da2c-572e-8d29-5312d4afe6f7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F220f4e45638e433daf0df14e15f6ffaf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/8.jpg saved to cache
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0fa24f0-da2c-572e-8d29-5312d4afe6f7
2026-03-27 16:46:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0fa24f0-da2c-572e-8d29-5312d4afe6f7, skipping ID generation
2026-03-27 16:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0fa24f0-da2c-572e-8d29-5312d4afe6f7 with scrape type 1
2026-03-27 16:46:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0fa24f0-da2c-572e-8d29-5312d4afe6f7 sending to next pipeline
2026-03-27 16:46:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c0fa24f0-da2c-572e-8d29-5312d4afe6f7, identifier: 1988229
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59317af50>
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3a3269-3b8d-5c44-b626-bd543678ee34/fc3a3269-3b8d-5c44-b626-bd543678ee34_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fd769554d0c904d94963b085c2aba69ac%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/2.jpg saved to cache
2026-03-27 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc3a3269-3b8d-5c44-b626-bd543678ee34
2026-03-27 16:46:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c0fa24f0-da2c-572e-8d29-5312d4afe6f7 with identifier: 1988229
2026-03-27 16:46:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c0fa24f0-da2c-572e-8d29-5312d4afe6f7 with identifier: 1988229
2026-03-27 16:46:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c0fa24f0-da2c-572e-8d29-5312d4afe6f7 with identifier: 1988229 to the API
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 24,
'color': 'GRIS MONTAGNE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'c0fa24f0-da2c-572e-8d29-5312d4afe6f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'CLASSE CLA',
'odometer': 63016,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0fa24f0-da2c-572e-8d29-5312d4afe6f7/c0fa24f0-da2c-572e-8d29-5312d4afe6f7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496039,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0fa24f0-da2c-572e-8d29-5312d4afe6f7/c0fa24f0-da2c-572e-8d29-5312d4afe6f7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496039,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0fa24f0-da2c-572e-8d29-5312d4afe6f7/c0fa24f0-da2c-572e-8d29-5312d4afe6f7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478094,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0fa24f0-da2c-572e-8d29-5312d4afe6f7/c0fa24f0-da2c-572e-8d29-5312d4afe6f7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403438,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0fa24f0-da2c-572e-8d29-5312d4afe6f7/c0fa24f0-da2c-572e-8d29-5312d4afe6f7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389873,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0fa24f0-da2c-572e-8d29-5312d4afe6f7/c0fa24f0-da2c-572e-8d29-5312d4afe6f7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 366917,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0fa24f0-da2c-572e-8d29-5312d4afe6f7/c0fa24f0-da2c-572e-8d29-5312d4afe6f7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299221,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0fa24f0-da2c-572e-8d29-5312d4afe6f7/c0fa24f0-da2c-572e-8d29-5312d4afe6f7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 551274,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/220f4e45638e433daf0df14e15f6ffaf/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-12',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ CLASSE CLA CLA Shooting Brake 250 e 160+102ch '
'Business Line 8G-DCT',
'transmission': 'automatic',
'trim': 'CLA Shooting Brake 250 e 160+102ch Business Line 8G-DCT',
'vin': None,
'year': 2022}
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988229%27 HTTP/1.1" 200 None
2026-03-27 16:46:08 [ayvens.fr] INFO: Saving data for 1988229: {'created_time': 1774629968.598194, 'last_price_update_time': 1774629968.598205, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988229') HTTP/1.1" 204 0
2026-03-27 16:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3eedd99de7a74c3db903516254e23f29%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/6.jpg not downloaded yet
2026-03-27 16:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b18450>
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3a3269-3b8d-5c44-b626-bd543678ee34/fc3a3269-3b8d-5c44-b626-bd543678ee34_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fd769554d0c904d94963b085c2aba69ac%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/7.jpg saved to cache
2026-03-27 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc3a3269-3b8d-5c44-b626-bd543678ee34
2026-03-27 16:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3eedd99de7a74c3db903516254e23f29%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/7.jpg not downloaded yet
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3eedd99de7a74c3db903516254e23f29%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/8.jpg not downloaded yet
2026-03-27 16:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:08 [ayvens.fr] INFO: Found listing with ID: 1988232
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988232%27 HTTP/1.1" 200 None
2026-03-27 16:46:08 [ayvens.fr] INFO: Scrape type for 1988232: 1
2026-03-27 16:46:08 [ayvens.fr] INFO: Extracting data for car ID: 1988232
2026-03-27 16:46:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ce595aa-9f39-538a-8031-0c670dfac83e with identifier: 1988232
2026-03-27 16:46:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ce595aa-9f39-538a-8031-0c670dfac83e with scrape type 1
2026-03-27 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7ce595aa-9f39-538a-8031-0c670dfac83e
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0de0829df3da40b580a2b9ce704fa9d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/1.jpg not downloaded yet
2026-03-27 16:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0de0829df3da40b580a2b9ce704fa9d0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/2.jpg not downloaded yet
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2d8d0>
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3a3269-3b8d-5c44-b626-bd543678ee34/fc3a3269-3b8d-5c44-b626-bd543678ee34_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fd769554d0c904d94963b085c2aba69ac%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/3.jpg saved to cache
2026-03-27 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc3a3269-3b8d-5c44-b626-bd543678ee34
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0fd10>
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3a3269-3b8d-5c44-b626-bd543678ee34/fc3a3269-3b8d-5c44-b626-bd543678ee34_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fd769554d0c904d94963b085c2aba69ac%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/4.jpg saved to cache
2026-03-27 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc3a3269-3b8d-5c44-b626-bd543678ee34
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abc6d0>
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3a3269-3b8d-5c44-b626-bd543678ee34/fc3a3269-3b8d-5c44-b626-bd543678ee34_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fd769554d0c904d94963b085c2aba69ac%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/5.jpg saved to cache
2026-03-27 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc3a3269-3b8d-5c44-b626-bd543678ee34
2026-03-27 16:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0de0829df3da40b580a2b9ce704fa9d0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/3.jpg not downloaded yet
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0de0829df3da40b580a2b9ce704fa9d0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/4.jpg not downloaded yet
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0d310>
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3a3269-3b8d-5c44-b626-bd543678ee34/fc3a3269-3b8d-5c44-b626-bd543678ee34_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fd769554d0c904d94963b085c2aba69ac%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/6.jpg saved to cache
2026-03-27 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc3a3269-3b8d-5c44-b626-bd543678ee34
2026-03-27 16:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051c890>
2026-03-27 16:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3a3269-3b8d-5c44-b626-bd543678ee34/fc3a3269-3b8d-5c44-b626-bd543678ee34_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fd769554d0c904d94963b085c2aba69ac%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/8.jpg saved to cache
2026-03-27 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc3a3269-3b8d-5c44-b626-bd543678ee34
2026-03-27 16:46:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc3a3269-3b8d-5c44-b626-bd543678ee34, skipping ID generation
2026-03-27 16:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc3a3269-3b8d-5c44-b626-bd543678ee34 with scrape type 1
2026-03-27 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc3a3269-3b8d-5c44-b626-bd543678ee34 sending to next pipeline
2026-03-27 16:46:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: fc3a3269-3b8d-5c44-b626-bd543678ee34, identifier: 1988230
2026-03-27 16:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2e810>
2026-03-27 16:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa96c947-ec23-58a3-8617-682c9c497d93/aa96c947-ec23-58a3-8617-682c9c497d93_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3eedd99de7a74c3db903516254e23f29%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/1.jpg saved to cache
2026-03-27 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa96c947-ec23-58a3-8617-682c9c497d93
2026-03-27 16:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051e750>
2026-03-27 16:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa96c947-ec23-58a3-8617-682c9c497d93/aa96c947-ec23-58a3-8617-682c9c497d93_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3eedd99de7a74c3db903516254e23f29%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/2.jpg saved to cache
2026-03-27 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa96c947-ec23-58a3-8617-682c9c497d93
2026-03-27 16:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0de0829df3da40b580a2b9ce704fa9d0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/5.jpg not downloaded yet
2026-03-27 16:46:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: fc3a3269-3b8d-5c44-b626-bd543678ee34 with identifier: 1988230
2026-03-27 16:46:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: fc3a3269-3b8d-5c44-b626-bd543678ee34 with identifier: 1988230
2026-03-27 16:46:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: fc3a3269-3b8d-5c44-b626-bd543678ee34 with identifier: 1988230 to the API
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 128,
'color': 'NOIR PERLANERA METAL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'fc3a3269-3b8d-5c44-b626-bd543678ee34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308',
'odometer': 122508,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3a3269-3b8d-5c44-b626-bd543678ee34/fc3a3269-3b8d-5c44-b626-bd543678ee34_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322234,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3a3269-3b8d-5c44-b626-bd543678ee34/fc3a3269-3b8d-5c44-b626-bd543678ee34_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322234,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3a3269-3b8d-5c44-b626-bd543678ee34/fc3a3269-3b8d-5c44-b626-bd543678ee34_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353668,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3a3269-3b8d-5c44-b626-bd543678ee34/fc3a3269-3b8d-5c44-b626-bd543678ee34_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360713,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3a3269-3b8d-5c44-b626-bd543678ee34/fc3a3269-3b8d-5c44-b626-bd543678ee34_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307473,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3a3269-3b8d-5c44-b626-bd543678ee34/fc3a3269-3b8d-5c44-b626-bd543678ee34_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380783,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3a3269-3b8d-5c44-b626-bd543678ee34/fc3a3269-3b8d-5c44-b626-bd543678ee34_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208664,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3a3269-3b8d-5c44-b626-bd543678ee34/fc3a3269-3b8d-5c44-b626-bd543678ee34_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342672,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/d769554d0c904d94963b085c2aba69ac/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-10',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 308 1.2 PureTech 130ch S&S Active Pack EAT8',
'transmission': 'automatic',
'trim': '308 1.2 PureTech 130ch S&S Active Pack EAT8',
'vin': None,
'year': 2023}
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988230%27 HTTP/1.1" 200 None
2026-03-27 16:46:09 [ayvens.fr] INFO: Saving data for 1988230: {'created_time': 1774629969.856314, 'last_price_update_time': 1774629969.856325, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988230') HTTP/1.1" 204 0
2026-03-27 16:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0de0829df3da40b580a2b9ce704fa9d0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/6.jpg not downloaded yet
2026-03-27 16:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911cb0d0>
2026-03-27 16:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa96c947-ec23-58a3-8617-682c9c497d93/aa96c947-ec23-58a3-8617-682c9c497d93_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3eedd99de7a74c3db903516254e23f29%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/3.jpg saved to cache
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa96c947-ec23-58a3-8617-682c9c497d93
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae13d0>
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa96c947-ec23-58a3-8617-682c9c497d93/aa96c947-ec23-58a3-8617-682c9c497d93_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3eedd99de7a74c3db903516254e23f29%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/7.jpg saved to cache
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa96c947-ec23-58a3-8617-682c9c497d93
2026-03-27 16:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0de0829df3da40b580a2b9ce704fa9d0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/7.jpg not downloaded yet
2026-03-27 16:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0de0829df3da40b580a2b9ce704fa9d0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/8.jpg not downloaded yet
2026-03-27 16:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abaed0>
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa96c947-ec23-58a3-8617-682c9c497d93/aa96c947-ec23-58a3-8617-682c9c497d93_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3eedd99de7a74c3db903516254e23f29%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/6.jpg saved to cache
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa96c947-ec23-58a3-8617-682c9c497d93
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a2010>
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa96c947-ec23-58a3-8617-682c9c497d93/aa96c947-ec23-58a3-8617-682c9c497d93_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3eedd99de7a74c3db903516254e23f29%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/8.jpg saved to cache
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa96c947-ec23-58a3-8617-682c9c497d93
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e5610>
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa96c947-ec23-58a3-8617-682c9c497d93/aa96c947-ec23-58a3-8617-682c9c497d93_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3eedd99de7a74c3db903516254e23f29%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/5.jpg saved to cache
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa96c947-ec23-58a3-8617-682c9c497d93
2026-03-27 16:46:10 [ayvens.fr] INFO: Found listing with ID: 1988233
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988233%27 HTTP/1.1" 200 None
2026-03-27 16:46:10 [ayvens.fr] INFO: Scrape type for 1988233: 1
2026-03-27 16:46:10 [ayvens.fr] INFO: Extracting data for car ID: 1988233
2026-03-27 16:46:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 296ab206-6fbd-53a9-be82-c8aaba639661 with identifier: 1988233
2026-03-27 16:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 296ab206-6fbd-53a9-be82-c8aaba639661 with scrape type 1
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 296ab206-6fbd-53a9-be82-c8aaba639661
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fc6a088167ec7489b9ae2973edf75109e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/1.jpg not downloaded yet
2026-03-27 16:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fc6a088167ec7489b9ae2973edf75109e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/2.jpg not downloaded yet
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d77b90>
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa96c947-ec23-58a3-8617-682c9c497d93/aa96c947-ec23-58a3-8617-682c9c497d93_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3eedd99de7a74c3db903516254e23f29%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/4.jpg saved to cache
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa96c947-ec23-58a3-8617-682c9c497d93
2026-03-27 16:46:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa96c947-ec23-58a3-8617-682c9c497d93, skipping ID generation
2026-03-27 16:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa96c947-ec23-58a3-8617-682c9c497d93 with scrape type 1
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa96c947-ec23-58a3-8617-682c9c497d93 sending to next pipeline
2026-03-27 16:46:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: aa96c947-ec23-58a3-8617-682c9c497d93, identifier: 1988231
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910524d0>
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ce595aa-9f39-538a-8031-0c670dfac83e/7ce595aa-9f39-538a-8031-0c670dfac83e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0de0829df3da40b580a2b9ce704fa9d0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/2.jpg saved to cache
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ce595aa-9f39-538a-8031-0c670dfac83e
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e5150>
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ce595aa-9f39-538a-8031-0c670dfac83e/7ce595aa-9f39-538a-8031-0c670dfac83e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0de0829df3da40b580a2b9ce704fa9d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/1.jpg saved to cache
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ce595aa-9f39-538a-8031-0c670dfac83e
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e5850>
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ce595aa-9f39-538a-8031-0c670dfac83e/7ce595aa-9f39-538a-8031-0c670dfac83e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0de0829df3da40b580a2b9ce704fa9d0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/3.jpg saved to cache
2026-03-27 16:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ce595aa-9f39-538a-8031-0c670dfac83e
2026-03-27 16:46:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: aa96c947-ec23-58a3-8617-682c9c497d93 with identifier: 1988231
2026-03-27 16:46:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: aa96c947-ec23-58a3-8617-682c9c497d93 with identifier: 1988231
2026-03-27 16:46:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: aa96c947-ec23-58a3-8617-682c9c497d93 with identifier: 1988231 to the API
2026-03-27 16:46:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'color': 'GRIS ELECTROCLASH',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'aa96c947-ec23-58a3-8617-682c9c497d93',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 19268,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa96c947-ec23-58a3-8617-682c9c497d93/aa96c947-ec23-58a3-8617-682c9c497d93_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555755,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa96c947-ec23-58a3-8617-682c9c497d93/aa96c947-ec23-58a3-8617-682c9c497d93_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555755,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa96c947-ec23-58a3-8617-682c9c497d93/aa96c947-ec23-58a3-8617-682c9c497d93_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 593019,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa96c947-ec23-58a3-8617-682c9c497d93/aa96c947-ec23-58a3-8617-682c9c497d93_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa96c947-ec23-58a3-8617-682c9c497d93/aa96c947-ec23-58a3-8617-682c9c497d93_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364392,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa96c947-ec23-58a3-8617-682c9c497d93/aa96c947-ec23-58a3-8617-682c9c497d93_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340256,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa96c947-ec23-58a3-8617-682c9c497d93/aa96c947-ec23-58a3-8617-682c9c497d93_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253783,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa96c947-ec23-58a3-8617-682c9c497d93/aa96c947-ec23-58a3-8617-682c9c497d93_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220631,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3eedd99de7a74c3db903516254e23f29/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-22',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 1.0 70ch BSG S&S Dolcevita',
'transmission': 'manual',
'trim': '500 1.0 70ch BSG S&S Dolcevita',
'vin': None,
'year': 2022}
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988231%27 HTTP/1.1" 200 None
2026-03-27 16:46:11 [ayvens.fr] INFO: Saving data for 1988231: {'created_time': 1774629971.332446, 'last_price_update_time': 1774629971.332457, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988231') HTTP/1.1" 204 0
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fc6a088167ec7489b9ae2973edf75109e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/3.jpg not downloaded yet
2026-03-27 16:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b1c50>
2026-03-27 16:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ce595aa-9f39-538a-8031-0c670dfac83e/7ce595aa-9f39-538a-8031-0c670dfac83e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0de0829df3da40b580a2b9ce704fa9d0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/4.jpg saved to cache
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ce595aa-9f39-538a-8031-0c670dfac83e
2026-03-27 16:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fc6a088167ec7489b9ae2973edf75109e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/4.jpg not downloaded yet
2026-03-27 16:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fc6a088167ec7489b9ae2973edf75109e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/5.jpg not downloaded yet
2026-03-27 16:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fc6a088167ec7489b9ae2973edf75109e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/6.jpg not downloaded yet
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fc6a088167ec7489b9ae2973edf75109e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/7.jpg not downloaded yet
2026-03-27 16:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591115bd0>
2026-03-27 16:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ce595aa-9f39-538a-8031-0c670dfac83e/7ce595aa-9f39-538a-8031-0c670dfac83e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0de0829df3da40b580a2b9ce704fa9d0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/5.jpg saved to cache
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ce595aa-9f39-538a-8031-0c670dfac83e
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fc6a088167ec7489b9ae2973edf75109e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/8.jpg not downloaded yet
2026-03-27 16:46:11 [ayvens.fr] INFO: Found listing with ID: 1988234
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988234%27 HTTP/1.1" 200 None
2026-03-27 16:46:11 [ayvens.fr] INFO: Scrape type for 1988234: 1
2026-03-27 16:46:11 [ayvens.fr] INFO: Extracting data for car ID: 1988234
2026-03-27 16:46:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e9e739d-d118-5c5c-898e-af5c7324a92a with identifier: 1988234
2026-03-27 16:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e9e739d-d118-5c5c-898e-af5c7324a92a with scrape type 1
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e9e739d-d118-5c5c-898e-af5c7324a92a
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9156172f1e8e46659c64ba7289b39af7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/1.jpg not downloaded yet
2026-03-27 16:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904d6090>
2026-03-27 16:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ce595aa-9f39-538a-8031-0c670dfac83e/7ce595aa-9f39-538a-8031-0c670dfac83e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0de0829df3da40b580a2b9ce704fa9d0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/6.jpg saved to cache
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ce595aa-9f39-538a-8031-0c670dfac83e
2026-03-27 16:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59064f790>
2026-03-27 16:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ce595aa-9f39-538a-8031-0c670dfac83e/7ce595aa-9f39-538a-8031-0c670dfac83e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0de0829df3da40b580a2b9ce704fa9d0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/8.jpg saved to cache
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ce595aa-9f39-538a-8031-0c670dfac83e
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9156172f1e8e46659c64ba7289b39af7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/2.jpg not downloaded yet
2026-03-27 16:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591480890>
2026-03-27 16:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ce595aa-9f39-538a-8031-0c670dfac83e/7ce595aa-9f39-538a-8031-0c670dfac83e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0de0829df3da40b580a2b9ce704fa9d0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/7.jpg saved to cache
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ce595aa-9f39-538a-8031-0c670dfac83e
2026-03-27 16:46:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ce595aa-9f39-538a-8031-0c670dfac83e, skipping ID generation
2026-03-27 16:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ce595aa-9f39-538a-8031-0c670dfac83e with scrape type 1
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ce595aa-9f39-538a-8031-0c670dfac83e sending to next pipeline
2026-03-27 16:46:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7ce595aa-9f39-538a-8031-0c670dfac83e, identifier: 1988232
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9156172f1e8e46659c64ba7289b39af7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/3.jpg not downloaded yet
2026-03-27 16:46:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7ce595aa-9f39-538a-8031-0c670dfac83e with identifier: 1988232
2026-03-27 16:46:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7ce595aa-9f39-538a-8031-0c670dfac83e with identifier: 1988232
2026-03-27 16:46:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7ce595aa-9f39-538a-8031-0c670dfac83e with identifier: 1988232 to the API
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'NOIR ETOIL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '7ce595aa-9f39-538a-8031-0c670dfac83e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE E-TECH',
'odometer': 96532,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce595aa-9f39-538a-8031-0c670dfac83e/7ce595aa-9f39-538a-8031-0c670dfac83e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318971,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce595aa-9f39-538a-8031-0c670dfac83e/7ce595aa-9f39-538a-8031-0c670dfac83e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318971,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce595aa-9f39-538a-8031-0c670dfac83e/7ce595aa-9f39-538a-8031-0c670dfac83e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335497,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce595aa-9f39-538a-8031-0c670dfac83e/7ce595aa-9f39-538a-8031-0c670dfac83e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340452,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce595aa-9f39-538a-8031-0c670dfac83e/7ce595aa-9f39-538a-8031-0c670dfac83e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323708,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce595aa-9f39-538a-8031-0c670dfac83e/7ce595aa-9f39-538a-8031-0c670dfac83e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300611,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce595aa-9f39-538a-8031-0c670dfac83e/7ce595aa-9f39-538a-8031-0c670dfac83e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333077,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce595aa-9f39-538a-8031-0c670dfac83e/7ce595aa-9f39-538a-8031-0c670dfac83e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319362,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/0de0829df3da40b580a2b9ce704fa9d0/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE E-TECH Megane E-Tech Electric EV60 130ch Evolution '
'ER optimum charge -C',
'transmission': 'automatic',
'trim': 'Megane E-Tech Electric EV60 130ch Evolution ER optimum charge -C',
'vin': None,
'year': 2023}
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988232%27 HTTP/1.1" 200 None
2026-03-27 16:46:12 [ayvens.fr] INFO: Saving data for 1988232: {'created_time': 1774629972.500193, 'last_price_update_time': 1774629972.500204, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988232') HTTP/1.1" 204 0
2026-03-27 16:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9156172f1e8e46659c64ba7289b39af7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/4.jpg not downloaded yet
2026-03-27 16:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9156172f1e8e46659c64ba7289b39af7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/5.jpg not downloaded yet
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9156172f1e8e46659c64ba7289b39af7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/6.jpg not downloaded yet
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9156172f1e8e46659c64ba7289b39af7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/7.jpg not downloaded yet
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9156172f1e8e46659c64ba7289b39af7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/8.jpg not downloaded yet
2026-03-27 16:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9156172f1e8e46659c64ba7289b39af7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/9.jpg not downloaded yet
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9156172f1e8e46659c64ba7289b39af7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/10.jpg not downloaded yet
2026-03-27 16:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590515c50>
2026-03-27 16:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296ab206-6fbd-53a9-be82-c8aaba639661/296ab206-6fbd-53a9-be82-c8aaba639661_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fc6a088167ec7489b9ae2973edf75109e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/1.jpg saved to cache
2026-03-27 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 296ab206-6fbd-53a9-be82-c8aaba639661
2026-03-27 16:46:12 [ayvens.fr] INFO: Found listing with ID: 1988235
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988235%27 HTTP/1.1" 200 None
2026-03-27 16:46:12 [ayvens.fr] INFO: Scrape type for 1988235: 1
2026-03-27 16:46:12 [ayvens.fr] INFO: Extracting data for car ID: 1988235
2026-03-27 16:46:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cac9db4-602f-5d26-a13c-cd286729c75c with identifier: 1988235
2026-03-27 16:46:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cac9db4-602f-5d26-a13c-cd286729c75c with scrape type 1
2026-03-27 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1cac9db4-602f-5d26-a13c-cd286729c75c
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F8ae76141b4984d329768b3a337982f91%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/1.jpg not downloaded yet
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F8ae76141b4984d329768b3a337982f91%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/2.jpg not downloaded yet
2026-03-27 16:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d50cd0>
2026-03-27 16:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296ab206-6fbd-53a9-be82-c8aaba639661/296ab206-6fbd-53a9-be82-c8aaba639661_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fc6a088167ec7489b9ae2973edf75109e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/2.jpg saved to cache
2026-03-27 16:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 296ab206-6fbd-53a9-be82-c8aaba639661
2026-03-27 16:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903ddc90>
2026-03-27 16:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296ab206-6fbd-53a9-be82-c8aaba639661/296ab206-6fbd-53a9-be82-c8aaba639661_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fc6a088167ec7489b9ae2973edf75109e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/4.jpg saved to cache
2026-03-27 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 296ab206-6fbd-53a9-be82-c8aaba639661
2026-03-27 16:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c3750>
2026-03-27 16:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296ab206-6fbd-53a9-be82-c8aaba639661/296ab206-6fbd-53a9-be82-c8aaba639661_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fc6a088167ec7489b9ae2973edf75109e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/5.jpg saved to cache
2026-03-27 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 296ab206-6fbd-53a9-be82-c8aaba639661
2026-03-27 16:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fc8310>
2026-03-27 16:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296ab206-6fbd-53a9-be82-c8aaba639661/296ab206-6fbd-53a9-be82-c8aaba639661_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fc6a088167ec7489b9ae2973edf75109e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/7.jpg saved to cache
2026-03-27 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 296ab206-6fbd-53a9-be82-c8aaba639661
2026-03-27 16:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9d390>
2026-03-27 16:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296ab206-6fbd-53a9-be82-c8aaba639661/296ab206-6fbd-53a9-be82-c8aaba639661_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fc6a088167ec7489b9ae2973edf75109e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/3.jpg saved to cache
2026-03-27 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 296ab206-6fbd-53a9-be82-c8aaba639661
2026-03-27 16:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c3690>
2026-03-27 16:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296ab206-6fbd-53a9-be82-c8aaba639661/296ab206-6fbd-53a9-be82-c8aaba639661_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fc6a088167ec7489b9ae2973edf75109e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/6.jpg saved to cache
2026-03-27 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 296ab206-6fbd-53a9-be82-c8aaba639661
2026-03-27 16:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de7ed0>
2026-03-27 16:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296ab206-6fbd-53a9-be82-c8aaba639661/296ab206-6fbd-53a9-be82-c8aaba639661_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fc6a088167ec7489b9ae2973edf75109e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/8.jpg saved to cache
2026-03-27 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 296ab206-6fbd-53a9-be82-c8aaba639661
2026-03-27 16:46:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 296ab206-6fbd-53a9-be82-c8aaba639661, skipping ID generation
2026-03-27 16:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 296ab206-6fbd-53a9-be82-c8aaba639661 with scrape type 1
2026-03-27 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 296ab206-6fbd-53a9-be82-c8aaba639661 sending to next pipeline
2026-03-27 16:46:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 296ab206-6fbd-53a9-be82-c8aaba639661, identifier: 1988233
2026-03-27 16:46:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 296ab206-6fbd-53a9-be82-c8aaba639661 with identifier: 1988233
2026-03-27 16:46:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 296ab206-6fbd-53a9-be82-c8aaba639661 with identifier: 1988233
2026-03-27 16:46:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 296ab206-6fbd-53a9-be82-c8aaba639661 with identifier: 1988233 to the API
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 32,
'color': 'GRIS HIGHLAND',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '296ab206-6fbd-53a9-be82-c8aaba639661',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 75102,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296ab206-6fbd-53a9-be82-c8aaba639661/296ab206-6fbd-53a9-be82-c8aaba639661_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296ab206-6fbd-53a9-be82-c8aaba639661/296ab206-6fbd-53a9-be82-c8aaba639661_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296ab206-6fbd-53a9-be82-c8aaba639661/296ab206-6fbd-53a9-be82-c8aaba639661_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426706,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296ab206-6fbd-53a9-be82-c8aaba639661/296ab206-6fbd-53a9-be82-c8aaba639661_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388493,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296ab206-6fbd-53a9-be82-c8aaba639661/296ab206-6fbd-53a9-be82-c8aaba639661_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344680,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296ab206-6fbd-53a9-be82-c8aaba639661/296ab206-6fbd-53a9-be82-c8aaba639661_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 366002,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296ab206-6fbd-53a9-be82-c8aaba639661/296ab206-6fbd-53a9-be82-c8aaba639661_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294850,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296ab206-6fbd-53a9-be82-c8aaba639661/296ab206-6fbd-53a9-be82-c8aaba639661_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660549,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/c6a088167ec7489b9ae2973edf75109e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CAPTUR Captur 1.6 E-Tech hybride rechargeable 160ch Intens',
'transmission': 'automatic',
'trim': 'Captur 1.6 E-Tech hybride rechargeable 160ch Intens',
'vin': None,
'year': 2021}
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988233%27 HTTP/1.1" 200 None
2026-03-27 16:46:13 [ayvens.fr] INFO: Saving data for 1988233: {'created_time': 1774629973.857618, 'last_price_update_time': 1774629973.857628, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988233') HTTP/1.1" 204 0
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F8ae76141b4984d329768b3a337982f91%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/3.jpg not downloaded yet
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F8ae76141b4984d329768b3a337982f91%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/4.jpg not downloaded yet
2026-03-27 16:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F8ae76141b4984d329768b3a337982f91%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/5.jpg not downloaded yet
2026-03-27 16:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F8ae76141b4984d329768b3a337982f91%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/6.jpg not downloaded yet
2026-03-27 16:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F8ae76141b4984d329768b3a337982f91%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/7.jpg not downloaded yet
2026-03-27 16:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F8ae76141b4984d329768b3a337982f91%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/8.jpg not downloaded yet
2026-03-27 16:46:14 [ayvens.fr] INFO: Found listing with ID: 1988236
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988236%27 HTTP/1.1" 200 None
2026-03-27 16:46:14 [ayvens.fr] INFO: Scrape type for 1988236: 1
2026-03-27 16:46:14 [ayvens.fr] INFO: Extracting data for car ID: 1988236
2026-03-27 16:46:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7fe8631-46ce-5485-b7fe-5a479990b52e with identifier: 1988236
2026-03-27 16:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7fe8631-46ce-5485-b7fe-5a479990b52e with scrape type 1
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a7fe8631-46ce-5485-b7fe-5a479990b52e
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F9646203089254b729e676a93a820582b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/1.jpg not downloaded yet
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F9646203089254b729e676a93a820582b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/2.jpg not downloaded yet
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590518850>
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e9e739d-d118-5c5c-898e-af5c7324a92a/1e9e739d-d118-5c5c-898e-af5c7324a92a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9156172f1e8e46659c64ba7289b39af7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/1.jpg saved to cache
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e9e739d-d118-5c5c-898e-af5c7324a92a
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905204d0>
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e9e739d-d118-5c5c-898e-af5c7324a92a/1e9e739d-d118-5c5c-898e-af5c7324a92a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9156172f1e8e46659c64ba7289b39af7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/5.jpg saved to cache
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e9e739d-d118-5c5c-898e-af5c7324a92a
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590aff310>
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e9e739d-d118-5c5c-898e-af5c7324a92a/1e9e739d-d118-5c5c-898e-af5c7324a92a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9156172f1e8e46659c64ba7289b39af7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/2.jpg saved to cache
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e9e739d-d118-5c5c-898e-af5c7324a92a
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F9646203089254b729e676a93a820582b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/3.jpg not downloaded yet
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590afffd0>
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e9e739d-d118-5c5c-898e-af5c7324a92a/1e9e739d-d118-5c5c-898e-af5c7324a92a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9156172f1e8e46659c64ba7289b39af7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/4.jpg saved to cache
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e9e739d-d118-5c5c-898e-af5c7324a92a
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfec50>
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e9e739d-d118-5c5c-898e-af5c7324a92a/1e9e739d-d118-5c5c-898e-af5c7324a92a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9156172f1e8e46659c64ba7289b39af7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/6.jpg saved to cache
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e9e739d-d118-5c5c-898e-af5c7324a92a
2026-03-27 16:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F9646203089254b729e676a93a820582b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/4.jpg not downloaded yet
2026-03-27 16:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b4b590>
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e9e739d-d118-5c5c-898e-af5c7324a92a/1e9e739d-d118-5c5c-898e-af5c7324a92a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9156172f1e8e46659c64ba7289b39af7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/3.jpg saved to cache
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e9e739d-d118-5c5c-898e-af5c7324a92a
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590af0d90>
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e9e739d-d118-5c5c-898e-af5c7324a92a/1e9e739d-d118-5c5c-898e-af5c7324a92a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9156172f1e8e46659c64ba7289b39af7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/7.jpg saved to cache
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e9e739d-d118-5c5c-898e-af5c7324a92a
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4ff10>
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e9e739d-d118-5c5c-898e-af5c7324a92a/1e9e739d-d118-5c5c-898e-af5c7324a92a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9156172f1e8e46659c64ba7289b39af7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/8.jpg saved to cache
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e9e739d-d118-5c5c-898e-af5c7324a92a
2026-03-27 16:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F9646203089254b729e676a93a820582b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/5.jpg not downloaded yet
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F9646203089254b729e676a93a820582b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/6.jpg not downloaded yet
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F9646203089254b729e676a93a820582b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/7.jpg not downloaded yet
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066c150>
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cac9db4-602f-5d26-a13c-cd286729c75c/1cac9db4-602f-5d26-a13c-cd286729c75c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F8ae76141b4984d329768b3a337982f91%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/1.jpg saved to cache
2026-03-27 16:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1cac9db4-602f-5d26-a13c-cd286729c75c
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4aed0>
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cac9db4-602f-5d26-a13c-cd286729c75c/1cac9db4-602f-5d26-a13c-cd286729c75c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F8ae76141b4984d329768b3a337982f91%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/3.jpg saved to cache
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1cac9db4-602f-5d26-a13c-cd286729c75c
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9e250>
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cac9db4-602f-5d26-a13c-cd286729c75c/1cac9db4-602f-5d26-a13c-cd286729c75c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F8ae76141b4984d329768b3a337982f91%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/5.jpg saved to cache
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1cac9db4-602f-5d26-a13c-cd286729c75c
2026-03-27 16:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F9646203089254b729e676a93a820582b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/8.jpg not downloaded yet
2026-03-27 16:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F9646203089254b729e676a93a820582b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/9.jpg not downloaded yet
2026-03-27 16:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df4950>
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cac9db4-602f-5d26-a13c-cd286729c75c/1cac9db4-602f-5d26-a13c-cd286729c75c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F8ae76141b4984d329768b3a337982f91%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/2.jpg saved to cache
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1cac9db4-602f-5d26-a13c-cd286729c75c
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e48d0>
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cac9db4-602f-5d26-a13c-cd286729c75c/1cac9db4-602f-5d26-a13c-cd286729c75c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F8ae76141b4984d329768b3a337982f91%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/4.jpg saved to cache
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1cac9db4-602f-5d26-a13c-cd286729c75c
2026-03-27 16:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F9646203089254b729e676a93a820582b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/10.jpg not downloaded yet
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd0e10>
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e9e739d-d118-5c5c-898e-af5c7324a92a/1e9e739d-d118-5c5c-898e-af5c7324a92a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9156172f1e8e46659c64ba7289b39af7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/10.jpg saved to cache
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e9e739d-d118-5c5c-898e-af5c7324a92a
2026-03-27 16:46:15 [ayvens.fr] INFO: Found listing with ID: 1988237
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988237%27 HTTP/1.1" 200 None
2026-03-27 16:46:15 [ayvens.fr] INFO: Scrape type for 1988237: 1
2026-03-27 16:46:15 [ayvens.fr] INFO: Extracting data for car ID: 1988237
2026-03-27 16:46:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 235bdeab-12e1-5100-b98d-d3c3ca59ee00 with identifier: 1988237
2026-03-27 16:46:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 235bdeab-12e1-5100-b98d-d3c3ca59ee00 with scrape type 1
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 235bdeab-12e1-5100-b98d-d3c3ca59ee00
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5557013f6293449fad5b0d4d4a5a1fbc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/1.jpg not downloaded yet
2026-03-27 16:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5557013f6293449fad5b0d4d4a5a1fbc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/2.jpg not downloaded yet
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f80390>
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e9e739d-d118-5c5c-898e-af5c7324a92a/1e9e739d-d118-5c5c-898e-af5c7324a92a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9156172f1e8e46659c64ba7289b39af7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/9.jpg saved to cache
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e9e739d-d118-5c5c-898e-af5c7324a92a
2026-03-27 16:46:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e9e739d-d118-5c5c-898e-af5c7324a92a, skipping ID generation
2026-03-27 16:46:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e9e739d-d118-5c5c-898e-af5c7324a92a with scrape type 1
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e9e739d-d118-5c5c-898e-af5c7324a92a sending to next pipeline
2026-03-27 16:46:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1e9e739d-d118-5c5c-898e-af5c7324a92a, identifier: 1988234
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e171d0>
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cac9db4-602f-5d26-a13c-cd286729c75c/1cac9db4-602f-5d26-a13c-cd286729c75c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F8ae76141b4984d329768b3a337982f91%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/7.jpg saved to cache
2026-03-27 16:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1cac9db4-602f-5d26-a13c-cd286729c75c
2026-03-27 16:46:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1e9e739d-d118-5c5c-898e-af5c7324a92a with identifier: 1988234
2026-03-27 16:46:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1e9e739d-d118-5c5c-898e-af5c7324a92a with identifier: 1988234
2026-03-27 16:46:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1e9e739d-d118-5c5c-898e-af5c7324a92a with identifier: 1988234 to the API
2026-03-27 16:46:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 161,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '1e9e739d-d118-5c5c-898e-af5c7324a92a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'X1',
'odometer': 28860,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e9e739d-d118-5c5c-898e-af5c7324a92a/1e9e739d-d118-5c5c-898e-af5c7324a92a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 594812,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e9e739d-d118-5c5c-898e-af5c7324a92a/1e9e739d-d118-5c5c-898e-af5c7324a92a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 594812,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e9e739d-d118-5c5c-898e-af5c7324a92a/1e9e739d-d118-5c5c-898e-af5c7324a92a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 771899,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e9e739d-d118-5c5c-898e-af5c7324a92a/1e9e739d-d118-5c5c-898e-af5c7324a92a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 695014,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e9e739d-d118-5c5c-898e-af5c7324a92a/1e9e739d-d118-5c5c-898e-af5c7324a92a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650098,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e9e739d-d118-5c5c-898e-af5c7324a92a/1e9e739d-d118-5c5c-898e-af5c7324a92a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 698227,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e9e739d-d118-5c5c-898e-af5c7324a92a/1e9e739d-d118-5c5c-898e-af5c7324a92a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 820475,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e9e739d-d118-5c5c-898e-af5c7324a92a/1e9e739d-d118-5c5c-898e-af5c7324a92a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 849519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e9e739d-d118-5c5c-898e-af5c7324a92a/1e9e739d-d118-5c5c-898e-af5c7324a92a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 927685,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e9e739d-d118-5c5c-898e-af5c7324a92a/1e9e739d-d118-5c5c-898e-af5c7324a92a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 718145,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9156172f1e8e46659c64ba7289b39af7/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-09',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 X1 xDrive20iA 178ch Lounge',
'transmission': 'automatic',
'trim': 'X1 xDrive20iA 178ch Lounge',
'vin': None,
'year': 2021}
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988234%27 HTTP/1.1" 200 None
2026-03-27 16:46:16 [ayvens.fr] INFO: Saving data for 1988234: {'created_time': 1774629976.100969, 'last_price_update_time': 1774629976.100981, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988234') HTTP/1.1" 204 0
2026-03-27 16:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5557013f6293449fad5b0d4d4a5a1fbc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/3.jpg not downloaded yet
2026-03-27 16:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b22f90>
2026-03-27 16:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cac9db4-602f-5d26-a13c-cd286729c75c/1cac9db4-602f-5d26-a13c-cd286729c75c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F8ae76141b4984d329768b3a337982f91%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/8.jpg saved to cache
2026-03-27 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1cac9db4-602f-5d26-a13c-cd286729c75c
2026-03-27 16:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590edb3d0>
2026-03-27 16:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cac9db4-602f-5d26-a13c-cd286729c75c/1cac9db4-602f-5d26-a13c-cd286729c75c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F8ae76141b4984d329768b3a337982f91%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/6.jpg saved to cache
2026-03-27 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1cac9db4-602f-5d26-a13c-cd286729c75c
2026-03-27 16:46:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1cac9db4-602f-5d26-a13c-cd286729c75c, skipping ID generation
2026-03-27 16:46:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cac9db4-602f-5d26-a13c-cd286729c75c with scrape type 1
2026-03-27 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1cac9db4-602f-5d26-a13c-cd286729c75c sending to next pipeline
2026-03-27 16:46:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1cac9db4-602f-5d26-a13c-cd286729c75c, identifier: 1988235
2026-03-27 16:46:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1cac9db4-602f-5d26-a13c-cd286729c75c with identifier: 1988235
2026-03-27 16:46:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1cac9db4-602f-5d26-a13c-cd286729c75c with identifier: 1988235
2026-03-27 16:46:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1cac9db4-602f-5d26-a13c-cd286729c75c with identifier: 1988235 to the API
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'BLANC ARCTIQUE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '1cac9db4-602f-5d26-a13c-cd286729c75c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'LEXUS',
'model': 'IS',
'odometer': 114411,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cac9db4-602f-5d26-a13c-cd286729c75c/1cac9db4-602f-5d26-a13c-cd286729c75c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314728,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cac9db4-602f-5d26-a13c-cd286729c75c/1cac9db4-602f-5d26-a13c-cd286729c75c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314728,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cac9db4-602f-5d26-a13c-cd286729c75c/1cac9db4-602f-5d26-a13c-cd286729c75c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279715,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cac9db4-602f-5d26-a13c-cd286729c75c/1cac9db4-602f-5d26-a13c-cd286729c75c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286701,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cac9db4-602f-5d26-a13c-cd286729c75c/1cac9db4-602f-5d26-a13c-cd286729c75c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254953,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cac9db4-602f-5d26-a13c-cd286729c75c/1cac9db4-602f-5d26-a13c-cd286729c75c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268006,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cac9db4-602f-5d26-a13c-cd286729c75c/1cac9db4-602f-5d26-a13c-cd286729c75c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213495,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cac9db4-602f-5d26-a13c-cd286729c75c/1cac9db4-602f-5d26-a13c-cd286729c75c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289514,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/8ae76141b4984d329768b3a337982f91/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-10',
'seats_number': 5,
'seller_name': None,
'title': 'LEXUS IS IS 300h Pack Business',
'transmission': 'automatic',
'trim': 'IS 300h Pack Business',
'vin': None,
'year': 2020}
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988235%27 HTTP/1.1" 200 None
2026-03-27 16:46:16 [ayvens.fr] INFO: Saving data for 1988235: {'created_time': 1774629976.724482, 'last_price_update_time': 1774629976.724497, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988235') HTTP/1.1" 204 0
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5557013f6293449fad5b0d4d4a5a1fbc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/4.jpg not downloaded yet
2026-03-27 16:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a09d0>
2026-03-27 16:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fe8631-46ce-5485-b7fe-5a479990b52e/a7fe8631-46ce-5485-b7fe-5a479990b52e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F9646203089254b729e676a93a820582b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/1.jpg saved to cache
2026-03-27 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7fe8631-46ce-5485-b7fe-5a479990b52e
2026-03-27 16:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066fd10>
2026-03-27 16:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fe8631-46ce-5485-b7fe-5a479990b52e/a7fe8631-46ce-5485-b7fe-5a479990b52e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F9646203089254b729e676a93a820582b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/2.jpg saved to cache
2026-03-27 16:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7fe8631-46ce-5485-b7fe-5a479990b52e
2026-03-27 16:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9f550>
2026-03-27 16:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fe8631-46ce-5485-b7fe-5a479990b52e/a7fe8631-46ce-5485-b7fe-5a479990b52e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F9646203089254b729e676a93a820582b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/3.jpg saved to cache
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7fe8631-46ce-5485-b7fe-5a479990b52e
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5557013f6293449fad5b0d4d4a5a1fbc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/5.jpg not downloaded yet
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5557013f6293449fad5b0d4d4a5a1fbc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/6.jpg not downloaded yet
2026-03-27 16:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5557013f6293449fad5b0d4d4a5a1fbc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/7.jpg not downloaded yet
2026-03-27 16:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5557013f6293449fad5b0d4d4a5a1fbc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/8.jpg not downloaded yet
2026-03-27 16:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5557013f6293449fad5b0d4d4a5a1fbc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/9.jpg not downloaded yet
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5557013f6293449fad5b0d4d4a5a1fbc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/10.jpg not downloaded yet
2026-03-27 16:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:17 [ayvens.fr] INFO: Found listing with ID: 1988238
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988238%27 HTTP/1.1" 200 None
2026-03-27 16:46:17 [ayvens.fr] INFO: Scrape type for 1988238: 1
2026-03-27 16:46:17 [ayvens.fr] INFO: Extracting data for car ID: 1988238
2026-03-27 16:46:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51c85c75-d0c5-5b0a-84ca-c368f9e3835e with identifier: 1988238
2026-03-27 16:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51c85c75-d0c5-5b0a-84ca-c368f9e3835e with scrape type 1
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 51c85c75-d0c5-5b0a-84ca-c368f9e3835e
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc2421c0390f14e61adcf02260aa56415%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/1.jpg not downloaded yet
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc2421c0390f14e61adcf02260aa56415%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/2.jpg not downloaded yet
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7fe10>
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fe8631-46ce-5485-b7fe-5a479990b52e/a7fe8631-46ce-5485-b7fe-5a479990b52e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F9646203089254b729e676a93a820582b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/4.jpg saved to cache
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7fe8631-46ce-5485-b7fe-5a479990b52e
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc2421c0390f14e61adcf02260aa56415%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/3.jpg not downloaded yet
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc2421c0390f14e61adcf02260aa56415%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/4.jpg not downloaded yet
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc2421c0390f14e61adcf02260aa56415%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/5.jpg not downloaded yet
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050ef90>
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fe8631-46ce-5485-b7fe-5a479990b52e/a7fe8631-46ce-5485-b7fe-5a479990b52e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F9646203089254b729e676a93a820582b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/5.jpg saved to cache
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7fe8631-46ce-5485-b7fe-5a479990b52e
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903dfbd0>
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fe8631-46ce-5485-b7fe-5a479990b52e/a7fe8631-46ce-5485-b7fe-5a479990b52e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F9646203089254b729e676a93a820582b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/6.jpg saved to cache
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7fe8631-46ce-5485-b7fe-5a479990b52e
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f80390>
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fe8631-46ce-5485-b7fe-5a479990b52e/a7fe8631-46ce-5485-b7fe-5a479990b52e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F9646203089254b729e676a93a820582b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/7.jpg saved to cache
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7fe8631-46ce-5485-b7fe-5a479990b52e
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903ddd50>
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fe8631-46ce-5485-b7fe-5a479990b52e/a7fe8631-46ce-5485-b7fe-5a479990b52e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F9646203089254b729e676a93a820582b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/8.jpg saved to cache
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7fe8631-46ce-5485-b7fe-5a479990b52e
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b07fd0>
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_235bdeab-12e1-5100-b98d-d3c3ca59ee00/235bdeab-12e1-5100-b98d-d3c3ca59ee00_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5557013f6293449fad5b0d4d4a5a1fbc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/1.jpg saved to cache
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 235bdeab-12e1-5100-b98d-d3c3ca59ee00
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903df8d0>
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fe8631-46ce-5485-b7fe-5a479990b52e/a7fe8631-46ce-5485-b7fe-5a479990b52e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F9646203089254b729e676a93a820582b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/10.jpg saved to cache
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a7fe8631-46ce-5485-b7fe-5a479990b52e
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d530d0>
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fe8631-46ce-5485-b7fe-5a479990b52e/a7fe8631-46ce-5485-b7fe-5a479990b52e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F9646203089254b729e676a93a820582b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/9.jpg saved to cache
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7fe8631-46ce-5485-b7fe-5a479990b52e
2026-03-27 16:46:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7fe8631-46ce-5485-b7fe-5a479990b52e, skipping ID generation
2026-03-27 16:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7fe8631-46ce-5485-b7fe-5a479990b52e with scrape type 1
2026-03-27 16:46:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7fe8631-46ce-5485-b7fe-5a479990b52e sending to next pipeline
2026-03-27 16:46:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a7fe8631-46ce-5485-b7fe-5a479990b52e, identifier: 1988236
2026-03-27 16:46:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a7fe8631-46ce-5485-b7fe-5a479990b52e with identifier: 1988236
2026-03-27 16:46:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a7fe8631-46ce-5485-b7fe-5a479990b52e with identifier: 1988236
2026-03-27 16:46:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a7fe8631-46ce-5485-b7fe-5a479990b52e with identifier: 1988236 to the API
2026-03-27 16:46:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'color': 'NOIR MYTHIC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'a7fe8631-46ce-5485-b7fe-5a479990b52e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'A3',
'odometer': 54681,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fe8631-46ce-5485-b7fe-5a479990b52e/a7fe8631-46ce-5485-b7fe-5a479990b52e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 508280,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fe8631-46ce-5485-b7fe-5a479990b52e/a7fe8631-46ce-5485-b7fe-5a479990b52e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 508280,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fe8631-46ce-5485-b7fe-5a479990b52e/a7fe8631-46ce-5485-b7fe-5a479990b52e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 718204,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fe8631-46ce-5485-b7fe-5a479990b52e/a7fe8631-46ce-5485-b7fe-5a479990b52e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 793262,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fe8631-46ce-5485-b7fe-5a479990b52e/a7fe8631-46ce-5485-b7fe-5a479990b52e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 950412,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fe8631-46ce-5485-b7fe-5a479990b52e/a7fe8631-46ce-5485-b7fe-5a479990b52e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 722916,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fe8631-46ce-5485-b7fe-5a479990b52e/a7fe8631-46ce-5485-b7fe-5a479990b52e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 782264,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fe8631-46ce-5485-b7fe-5a479990b52e/a7fe8631-46ce-5485-b7fe-5a479990b52e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 849306,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fe8631-46ce-5485-b7fe-5a479990b52e/a7fe8631-46ce-5485-b7fe-5a479990b52e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 921652,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fe8631-46ce-5485-b7fe-5a479990b52e/a7fe8631-46ce-5485-b7fe-5a479990b52e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 947219,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/9646203089254b729e676a93a820582b/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-05',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI A3 A3 Sportback 35 TFSI 150ch CoD Business line S tronic 7',
'transmission': 'automatic',
'trim': 'A3 Sportback 35 TFSI 150ch CoD Business line S tronic 7',
'vin': None,
'year': 2019}
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988236%27 HTTP/1.1" 200 None
2026-03-27 16:46:18 [ayvens.fr] INFO: Saving data for 1988236: {'created_time': 1774629978.347862, 'last_price_update_time': 1774629978.347873, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988236') HTTP/1.1" 204 0
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc2421c0390f14e61adcf02260aa56415%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/6.jpg not downloaded yet
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc2421c0390f14e61adcf02260aa56415%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/7.jpg not downloaded yet
2026-03-27 16:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc2421c0390f14e61adcf02260aa56415%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/8.jpg not downloaded yet
2026-03-27 16:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:18 [ayvens.fr] INFO: Found listing with ID: 1988239
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988239%27 HTTP/1.1" 200 None
2026-03-27 16:46:18 [ayvens.fr] INFO: Scrape type for 1988239: 1
2026-03-27 16:46:18 [ayvens.fr] INFO: Extracting data for car ID: 1988239
2026-03-27 16:46:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33a62510-8161-5c39-84c4-ae3a57680830 with identifier: 1988239
2026-03-27 16:46:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33a62510-8161-5c39-84c4-ae3a57680830 with scrape type 1
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 33a62510-8161-5c39-84c4-ae3a57680830
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe20ebfee732d42d6a904a117f52e8307%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/1.jpg not downloaded yet
2026-03-27 16:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe20ebfee732d42d6a904a117f52e8307%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/2.jpg not downloaded yet
2026-03-27 16:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe20ebfee732d42d6a904a117f52e8307%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/3.jpg not downloaded yet
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe20ebfee732d42d6a904a117f52e8307%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/4.jpg not downloaded yet
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe20ebfee732d42d6a904a117f52e8307%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/5.jpg not downloaded yet
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b528d0>
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_235bdeab-12e1-5100-b98d-d3c3ca59ee00/235bdeab-12e1-5100-b98d-d3c3ca59ee00_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5557013f6293449fad5b0d4d4a5a1fbc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/2.jpg saved to cache
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 235bdeab-12e1-5100-b98d-d3c3ca59ee00
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe20ebfee732d42d6a904a117f52e8307%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/6.jpg not downloaded yet
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590daff50>
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_235bdeab-12e1-5100-b98d-d3c3ca59ee00/235bdeab-12e1-5100-b98d-d3c3ca59ee00_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5557013f6293449fad5b0d4d4a5a1fbc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/4.jpg saved to cache
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 235bdeab-12e1-5100-b98d-d3c3ca59ee00
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4b110>
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_235bdeab-12e1-5100-b98d-d3c3ca59ee00/235bdeab-12e1-5100-b98d-d3c3ca59ee00_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5557013f6293449fad5b0d4d4a5a1fbc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/6.jpg saved to cache
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 235bdeab-12e1-5100-b98d-d3c3ca59ee00
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe20ebfee732d42d6a904a117f52e8307%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/7.jpg not downloaded yet
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe20ebfee732d42d6a904a117f52e8307%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/8.jpg not downloaded yet
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590696890>
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_235bdeab-12e1-5100-b98d-d3c3ca59ee00/235bdeab-12e1-5100-b98d-d3c3ca59ee00_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5557013f6293449fad5b0d4d4a5a1fbc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/7.jpg saved to cache
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 235bdeab-12e1-5100-b98d-d3c3ca59ee00
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2c7d0>
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_235bdeab-12e1-5100-b98d-d3c3ca59ee00/235bdeab-12e1-5100-b98d-d3c3ca59ee00_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5557013f6293449fad5b0d4d4a5a1fbc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/3.jpg saved to cache
2026-03-27 16:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 235bdeab-12e1-5100-b98d-d3c3ca59ee00
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591480090>
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_235bdeab-12e1-5100-b98d-d3c3ca59ee00/235bdeab-12e1-5100-b98d-d3c3ca59ee00_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5557013f6293449fad5b0d4d4a5a1fbc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/5.jpg saved to cache
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 235bdeab-12e1-5100-b98d-d3c3ca59ee00
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c8b10>
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_235bdeab-12e1-5100-b98d-d3c3ca59ee00/235bdeab-12e1-5100-b98d-d3c3ca59ee00_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5557013f6293449fad5b0d4d4a5a1fbc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/8.jpg saved to cache
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 235bdeab-12e1-5100-b98d-d3c3ca59ee00
2026-03-27 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:19 [ayvens.fr] INFO: Found listing with ID: 1988240
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988240%27 HTTP/1.1" 200 None
2026-03-27 16:46:19 [ayvens.fr] INFO: Scrape type for 1988240: 1
2026-03-27 16:46:19 [ayvens.fr] INFO: Extracting data for car ID: 1988240
2026-03-27 16:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efb34cfb-3642-5272-9992-9d4830b958ca with identifier: 1988240
2026-03-27 16:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb34cfb-3642-5272-9992-9d4830b958ca with scrape type 1
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item efb34cfb-3642-5272-9992-9d4830b958ca
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fcffa0a1520514aa2b1b9ced6ca4303a0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/1.jpg not downloaded yet
2026-03-27 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fcffa0a1520514aa2b1b9ced6ca4303a0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/2.jpg not downloaded yet
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fcffa0a1520514aa2b1b9ced6ca4303a0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/3.jpg not downloaded yet
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fcffa0a1520514aa2b1b9ced6ca4303a0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/4.jpg not downloaded yet
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fcffa0a1520514aa2b1b9ced6ca4303a0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/5.jpg not downloaded yet
2026-03-27 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fcffa0a1520514aa2b1b9ced6ca4303a0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/6.jpg not downloaded yet
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59287bdd0>
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51c85c75-d0c5-5b0a-84ca-c368f9e3835e/51c85c75-d0c5-5b0a-84ca-c368f9e3835e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc2421c0390f14e61adcf02260aa56415%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/6.jpg saved to cache
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 51c85c75-d0c5-5b0a-84ca-c368f9e3835e
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590520e10>
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51c85c75-d0c5-5b0a-84ca-c368f9e3835e/51c85c75-d0c5-5b0a-84ca-c368f9e3835e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc2421c0390f14e61adcf02260aa56415%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/5.jpg saved to cache
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51c85c75-d0c5-5b0a-84ca-c368f9e3835e
2026-03-27 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fcffa0a1520514aa2b1b9ced6ca4303a0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/7.jpg not downloaded yet
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fcffa0a1520514aa2b1b9ced6ca4303a0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/8.jpg not downloaded yet
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590afc0d0>
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51c85c75-d0c5-5b0a-84ca-c368f9e3835e/51c85c75-d0c5-5b0a-84ca-c368f9e3835e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc2421c0390f14e61adcf02260aa56415%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/3.jpg saved to cache
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51c85c75-d0c5-5b0a-84ca-c368f9e3835e
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c3950>
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51c85c75-d0c5-5b0a-84ca-c368f9e3835e/51c85c75-d0c5-5b0a-84ca-c368f9e3835e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc2421c0390f14e61adcf02260aa56415%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/2.jpg saved to cache
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51c85c75-d0c5-5b0a-84ca-c368f9e3835e
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9ee90>
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51c85c75-d0c5-5b0a-84ca-c368f9e3835e/51c85c75-d0c5-5b0a-84ca-c368f9e3835e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc2421c0390f14e61adcf02260aa56415%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/1.jpg saved to cache
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51c85c75-d0c5-5b0a-84ca-c368f9e3835e
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b22d50>
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51c85c75-d0c5-5b0a-84ca-c368f9e3835e/51c85c75-d0c5-5b0a-84ca-c368f9e3835e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc2421c0390f14e61adcf02260aa56415%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/4.jpg saved to cache
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51c85c75-d0c5-5b0a-84ca-c368f9e3835e
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe0e90>
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_235bdeab-12e1-5100-b98d-d3c3ca59ee00/235bdeab-12e1-5100-b98d-d3c3ca59ee00_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5557013f6293449fad5b0d4d4a5a1fbc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/10.jpg saved to cache
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 235bdeab-12e1-5100-b98d-d3c3ca59ee00
2026-03-27 16:46:19 [ayvens.fr] INFO: Found listing with ID: 1988241
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988241%27 HTTP/1.1" 200 None
2026-03-27 16:46:19 [ayvens.fr] INFO: Scrape type for 1988241: 1
2026-03-27 16:46:19 [ayvens.fr] INFO: Extracting data for car ID: 1988241
2026-03-27 16:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da1199cc-8562-5e2f-b728-70b86981d732 with identifier: 1988241
2026-03-27 16:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da1199cc-8562-5e2f-b728-70b86981d732 with scrape type 1
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item da1199cc-8562-5e2f-b728-70b86981d732
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F0272516a744a4f2c863bc6ffc210bcf7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/1.jpg not downloaded yet
2026-03-27 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F0272516a744a4f2c863bc6ffc210bcf7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/2.jpg not downloaded yet
2026-03-27 16:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b767d0>
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_235bdeab-12e1-5100-b98d-d3c3ca59ee00/235bdeab-12e1-5100-b98d-d3c3ca59ee00_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F5557013f6293449fad5b0d4d4a5a1fbc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/9.jpg saved to cache
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 235bdeab-12e1-5100-b98d-d3c3ca59ee00
2026-03-27 16:46:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 235bdeab-12e1-5100-b98d-d3c3ca59ee00, skipping ID generation
2026-03-27 16:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 235bdeab-12e1-5100-b98d-d3c3ca59ee00 with scrape type 1
2026-03-27 16:46:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 235bdeab-12e1-5100-b98d-d3c3ca59ee00 sending to next pipeline
2026-03-27 16:46:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 235bdeab-12e1-5100-b98d-d3c3ca59ee00, identifier: 1988237
2026-03-27 16:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F0272516a744a4f2c863bc6ffc210bcf7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/3.jpg not downloaded yet
2026-03-27 16:46:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 235bdeab-12e1-5100-b98d-d3c3ca59ee00 with identifier: 1988237
2026-03-27 16:46:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 235bdeab-12e1-5100-b98d-d3c3ca59ee00 with identifier: 1988237
2026-03-27 16:46:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 235bdeab-12e1-5100-b98d-d3c3ca59ee00 with identifier: 1988237 to the API
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '235bdeab-12e1-5100-b98d-d3c3ca59ee00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 67070,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_235bdeab-12e1-5100-b98d-d3c3ca59ee00/235bdeab-12e1-5100-b98d-d3c3ca59ee00_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 614715,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_235bdeab-12e1-5100-b98d-d3c3ca59ee00/235bdeab-12e1-5100-b98d-d3c3ca59ee00_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 614715,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_235bdeab-12e1-5100-b98d-d3c3ca59ee00/235bdeab-12e1-5100-b98d-d3c3ca59ee00_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 605358,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_235bdeab-12e1-5100-b98d-d3c3ca59ee00/235bdeab-12e1-5100-b98d-d3c3ca59ee00_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 687278,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_235bdeab-12e1-5100-b98d-d3c3ca59ee00/235bdeab-12e1-5100-b98d-d3c3ca59ee00_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 872958,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_235bdeab-12e1-5100-b98d-d3c3ca59ee00/235bdeab-12e1-5100-b98d-d3c3ca59ee00_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 656008,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_235bdeab-12e1-5100-b98d-d3c3ca59ee00/235bdeab-12e1-5100-b98d-d3c3ca59ee00_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 827944,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_235bdeab-12e1-5100-b98d-d3c3ca59ee00/235bdeab-12e1-5100-b98d-d3c3ca59ee00_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 828696,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_235bdeab-12e1-5100-b98d-d3c3ca59ee00/235bdeab-12e1-5100-b98d-d3c3ca59ee00_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 929747,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_235bdeab-12e1-5100-b98d-d3c3ca59ee00/235bdeab-12e1-5100-b98d-d3c3ca59ee00_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 800035,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/5557013f6293449fad5b0d4d4a5a1fbc/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 100ch S&S Allure Business',
'transmission': 'manual',
'trim': '2008 1.2 PureTech 100ch S&S Allure Business',
'vin': None,
'year': 2021}
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988237%27 HTTP/1.1" 200 None
2026-03-27 16:46:20 [ayvens.fr] INFO: Saving data for 1988237: {'created_time': 1774629980.467206, 'last_price_update_time': 1774629980.467219, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988237') HTTP/1.1" 204 0
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F0272516a744a4f2c863bc6ffc210bcf7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/4.jpg not downloaded yet
2026-03-27 16:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590595910>
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33a62510-8161-5c39-84c4-ae3a57680830/33a62510-8161-5c39-84c4-ae3a57680830_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe20ebfee732d42d6a904a117f52e8307%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/1.jpg saved to cache
2026-03-27 16:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33a62510-8161-5c39-84c4-ae3a57680830
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa9ed0>
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33a62510-8161-5c39-84c4-ae3a57680830/33a62510-8161-5c39-84c4-ae3a57680830_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe20ebfee732d42d6a904a117f52e8307%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/6.jpg saved to cache
2026-03-27 16:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 33a62510-8161-5c39-84c4-ae3a57680830
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae8e10>
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51c85c75-d0c5-5b0a-84ca-c368f9e3835e/51c85c75-d0c5-5b0a-84ca-c368f9e3835e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc2421c0390f14e61adcf02260aa56415%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/7.jpg saved to cache
2026-03-27 16:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 51c85c75-d0c5-5b0a-84ca-c368f9e3835e
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e2e10>
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33a62510-8161-5c39-84c4-ae3a57680830/33a62510-8161-5c39-84c4-ae3a57680830_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe20ebfee732d42d6a904a117f52e8307%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/5.jpg saved to cache
2026-03-27 16:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 33a62510-8161-5c39-84c4-ae3a57680830
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b1a8d0>
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33a62510-8161-5c39-84c4-ae3a57680830/33a62510-8161-5c39-84c4-ae3a57680830_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe20ebfee732d42d6a904a117f52e8307%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/4.jpg saved to cache
2026-03-27 16:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 33a62510-8161-5c39-84c4-ae3a57680830
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c0c50>
2026-03-27 16:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33a62510-8161-5c39-84c4-ae3a57680830/33a62510-8161-5c39-84c4-ae3a57680830_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe20ebfee732d42d6a904a117f52e8307%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/3.jpg saved to cache
2026-03-27 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 33a62510-8161-5c39-84c4-ae3a57680830
2026-03-27 16:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050c3d0>
2026-03-27 16:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51c85c75-d0c5-5b0a-84ca-c368f9e3835e/51c85c75-d0c5-5b0a-84ca-c368f9e3835e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc2421c0390f14e61adcf02260aa56415%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/8.jpg saved to cache
2026-03-27 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 51c85c75-d0c5-5b0a-84ca-c368f9e3835e
2026-03-27 16:46:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51c85c75-d0c5-5b0a-84ca-c368f9e3835e, skipping ID generation
2026-03-27 16:46:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51c85c75-d0c5-5b0a-84ca-c368f9e3835e with scrape type 1
2026-03-27 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51c85c75-d0c5-5b0a-84ca-c368f9e3835e sending to next pipeline
2026-03-27 16:46:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 51c85c75-d0c5-5b0a-84ca-c368f9e3835e, identifier: 1988238
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F0272516a744a4f2c863bc6ffc210bcf7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/5.jpg not downloaded yet
2026-03-27 16:46:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 51c85c75-d0c5-5b0a-84ca-c368f9e3835e with identifier: 1988238
2026-03-27 16:46:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 51c85c75-d0c5-5b0a-84ca-c368f9e3835e with identifier: 1988238
2026-03-27 16:46:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 51c85c75-d0c5-5b0a-84ca-c368f9e3835e with identifier: 1988238 to the API
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '51c85c75-d0c5-5b0a-84ca-c368f9e3835e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'CORSA',
'odometer': 56492,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51c85c75-d0c5-5b0a-84ca-c368f9e3835e/51c85c75-d0c5-5b0a-84ca-c368f9e3835e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 455445,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51c85c75-d0c5-5b0a-84ca-c368f9e3835e/51c85c75-d0c5-5b0a-84ca-c368f9e3835e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 455445,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51c85c75-d0c5-5b0a-84ca-c368f9e3835e/51c85c75-d0c5-5b0a-84ca-c368f9e3835e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492381,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51c85c75-d0c5-5b0a-84ca-c368f9e3835e/51c85c75-d0c5-5b0a-84ca-c368f9e3835e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 467616,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51c85c75-d0c5-5b0a-84ca-c368f9e3835e/51c85c75-d0c5-5b0a-84ca-c368f9e3835e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345655,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51c85c75-d0c5-5b0a-84ca-c368f9e3835e/51c85c75-d0c5-5b0a-84ca-c368f9e3835e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450706,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51c85c75-d0c5-5b0a-84ca-c368f9e3835e/51c85c75-d0c5-5b0a-84ca-c368f9e3835e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51c85c75-d0c5-5b0a-84ca-c368f9e3835e/51c85c75-d0c5-5b0a-84ca-c368f9e3835e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 507482,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c2421c0390f14e61adcf02260aa56415/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL CORSA Corsa 1.4 90ch Enjoy Start/Stop 5p',
'transmission': 'manual',
'trim': 'Corsa 1.4 90ch Enjoy Start/Stop 5p',
'vin': None,
'year': 2019}
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988238%27 HTTP/1.1" 200 None
2026-03-27 16:46:21 [ayvens.fr] INFO: Saving data for 1988238: {'created_time': 1774629981.619124, 'last_price_update_time': 1774629981.619135, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988238') HTTP/1.1" 204 0
2026-03-27 16:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F0272516a744a4f2c863bc6ffc210bcf7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/6.jpg not downloaded yet
2026-03-27 16:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d58750>
2026-03-27 16:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33a62510-8161-5c39-84c4-ae3a57680830/33a62510-8161-5c39-84c4-ae3a57680830_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe20ebfee732d42d6a904a117f52e8307%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/2.jpg saved to cache
2026-03-27 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 33a62510-8161-5c39-84c4-ae3a57680830
2026-03-27 16:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F0272516a744a4f2c863bc6ffc210bcf7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/7.jpg not downloaded yet
2026-03-27 16:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F0272516a744a4f2c863bc6ffc210bcf7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/8.jpg not downloaded yet
2026-03-27 16:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d759d0>
2026-03-27 16:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb34cfb-3642-5272-9992-9d4830b958ca/efb34cfb-3642-5272-9992-9d4830b958ca_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fcffa0a1520514aa2b1b9ced6ca4303a0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/3.jpg saved to cache
2026-03-27 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item efb34cfb-3642-5272-9992-9d4830b958ca
2026-03-27 16:46:21 [ayvens.fr] INFO: Found listing with ID: 1988242
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988242%27 HTTP/1.1" 200 None
2026-03-27 16:46:21 [ayvens.fr] INFO: Scrape type for 1988242: 1
2026-03-27 16:46:21 [ayvens.fr] INFO: Extracting data for car ID: 1988242
2026-03-27 16:46:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe25d21a-5a78-52af-be4c-00ab100b0f46 with identifier: 1988242
2026-03-27 16:46:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe25d21a-5a78-52af-be4c-00ab100b0f46 with scrape type 1
2026-03-27 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item fe25d21a-5a78-52af-be4c-00ab100b0f46
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F5f35dbfcccea44dcbb20f7f733b5a716%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/1.jpg not downloaded yet
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F5f35dbfcccea44dcbb20f7f733b5a716%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/2.jpg not downloaded yet
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F5f35dbfcccea44dcbb20f7f733b5a716%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/3.jpg not downloaded yet
2026-03-27 16:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590645f50>
2026-03-27 16:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33a62510-8161-5c39-84c4-ae3a57680830/33a62510-8161-5c39-84c4-ae3a57680830_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe20ebfee732d42d6a904a117f52e8307%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/7.jpg saved to cache
2026-03-27 16:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 33a62510-8161-5c39-84c4-ae3a57680830
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efdbd0>
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb34cfb-3642-5272-9992-9d4830b958ca/efb34cfb-3642-5272-9992-9d4830b958ca_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fcffa0a1520514aa2b1b9ced6ca4303a0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/2.jpg saved to cache
2026-03-27 16:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item efb34cfb-3642-5272-9992-9d4830b958ca
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b68cd0>
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb34cfb-3642-5272-9992-9d4830b958ca/efb34cfb-3642-5272-9992-9d4830b958ca_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fcffa0a1520514aa2b1b9ced6ca4303a0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/1.jpg saved to cache
2026-03-27 16:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efb34cfb-3642-5272-9992-9d4830b958ca
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efef90>
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb34cfb-3642-5272-9992-9d4830b958ca/efb34cfb-3642-5272-9992-9d4830b958ca_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fcffa0a1520514aa2b1b9ced6ca4303a0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/4.jpg saved to cache
2026-03-27 16:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item efb34cfb-3642-5272-9992-9d4830b958ca
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a3850>
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb34cfb-3642-5272-9992-9d4830b958ca/efb34cfb-3642-5272-9992-9d4830b958ca_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fcffa0a1520514aa2b1b9ced6ca4303a0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/5.jpg saved to cache
2026-03-27 16:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item efb34cfb-3642-5272-9992-9d4830b958ca
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa3310>
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33a62510-8161-5c39-84c4-ae3a57680830/33a62510-8161-5c39-84c4-ae3a57680830_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe20ebfee732d42d6a904a117f52e8307%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/8.jpg saved to cache
2026-03-27 16:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 33a62510-8161-5c39-84c4-ae3a57680830
2026-03-27 16:46:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33a62510-8161-5c39-84c4-ae3a57680830, skipping ID generation
2026-03-27 16:46:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33a62510-8161-5c39-84c4-ae3a57680830 with scrape type 1
2026-03-27 16:46:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33a62510-8161-5c39-84c4-ae3a57680830 sending to next pipeline
2026-03-27 16:46:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 33a62510-8161-5c39-84c4-ae3a57680830, identifier: 1988239
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae8850>
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb34cfb-3642-5272-9992-9d4830b958ca/efb34cfb-3642-5272-9992-9d4830b958ca_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fcffa0a1520514aa2b1b9ced6ca4303a0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/6.jpg saved to cache
2026-03-27 16:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item efb34cfb-3642-5272-9992-9d4830b958ca
2026-03-27 16:46:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 33a62510-8161-5c39-84c4-ae3a57680830 with identifier: 1988239
2026-03-27 16:46:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 33a62510-8161-5c39-84c4-ae3a57680830 with identifier: 1988239
2026-03-27 16:46:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 33a62510-8161-5c39-84c4-ae3a57680830 with identifier: 1988239 to the API
2026-03-27 16:46:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': 'NOIR ETOILE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '33a62510-8161-5c39-84c4-ae3a57680830',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 87289,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33a62510-8161-5c39-84c4-ae3a57680830/33a62510-8161-5c39-84c4-ae3a57680830_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 465316,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33a62510-8161-5c39-84c4-ae3a57680830/33a62510-8161-5c39-84c4-ae3a57680830_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 465316,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33a62510-8161-5c39-84c4-ae3a57680830/33a62510-8161-5c39-84c4-ae3a57680830_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438848,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33a62510-8161-5c39-84c4-ae3a57680830/33a62510-8161-5c39-84c4-ae3a57680830_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352120,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33a62510-8161-5c39-84c4-ae3a57680830/33a62510-8161-5c39-84c4-ae3a57680830_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379797,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33a62510-8161-5c39-84c4-ae3a57680830/33a62510-8161-5c39-84c4-ae3a57680830_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379536,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33a62510-8161-5c39-84c4-ae3a57680830/33a62510-8161-5c39-84c4-ae3a57680830_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33a62510-8161-5c39-84c4-ae3a57680830/33a62510-8161-5c39-84c4-ae3a57680830_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 590698,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e20ebfee732d42d6a904a117f52e8307/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CAPTUR Captur 1.3 TCe mild hybrid 140ch Techno',
'transmission': 'manual',
'trim': 'Captur 1.3 TCe mild hybrid 140ch Techno',
'vin': None,
'year': 2023}
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988239%27 HTTP/1.1" 200 None
2026-03-27 16:46:23 [ayvens.fr] INFO: Saving data for 1988239: {'created_time': 1774629983.757166, 'last_price_update_time': 1774629983.757177, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988239') HTTP/1.1" 204 0
2026-03-27 16:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F5f35dbfcccea44dcbb20f7f733b5a716%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/4.jpg not downloaded yet
2026-03-27 16:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F5f35dbfcccea44dcbb20f7f733b5a716%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/5.jpg not downloaded yet
2026-03-27 16:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F5f35dbfcccea44dcbb20f7f733b5a716%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/6.jpg not downloaded yet
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F5f35dbfcccea44dcbb20f7f733b5a716%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/7.jpg not downloaded yet
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F5f35dbfcccea44dcbb20f7f733b5a716%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/8.jpg not downloaded yet
2026-03-27 16:46:23 [ayvens.fr] INFO: Found listing with ID: 1988243
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988243%27 HTTP/1.1" 200 None
2026-03-27 16:46:23 [ayvens.fr] INFO: Scrape type for 1988243: 1
2026-03-27 16:46:23 [ayvens.fr] INFO: Extracting data for car ID: 1988243
2026-03-27 16:46:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f85a3d51-0555-5850-b206-0759c849f32f with identifier: 1988243
2026-03-27 16:46:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f85a3d51-0555-5850-b206-0759c849f32f with scrape type 1
2026-03-27 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f85a3d51-0555-5850-b206-0759c849f32f
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F46abc90dc50140669efbec60aa152cce%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/1.jpg not downloaded yet
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F46abc90dc50140669efbec60aa152cce%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/2.jpg not downloaded yet
2026-03-27 16:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590514810>
2026-03-27 16:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb34cfb-3642-5272-9992-9d4830b958ca/efb34cfb-3642-5272-9992-9d4830b958ca_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fcffa0a1520514aa2b1b9ced6ca4303a0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/8.jpg saved to cache
2026-03-27 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item efb34cfb-3642-5272-9992-9d4830b958ca
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee3850>
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da1199cc-8562-5e2f-b728-70b86981d732/da1199cc-8562-5e2f-b728-70b86981d732_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F0272516a744a4f2c863bc6ffc210bcf7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/1.jpg saved to cache
2026-03-27 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da1199cc-8562-5e2f-b728-70b86981d732
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5912083d0>
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da1199cc-8562-5e2f-b728-70b86981d732/da1199cc-8562-5e2f-b728-70b86981d732_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F0272516a744a4f2c863bc6ffc210bcf7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/6.jpg saved to cache
2026-03-27 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da1199cc-8562-5e2f-b728-70b86981d732
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b68f50>
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb34cfb-3642-5272-9992-9d4830b958ca/efb34cfb-3642-5272-9992-9d4830b958ca_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fcffa0a1520514aa2b1b9ced6ca4303a0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/7.jpg saved to cache
2026-03-27 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item efb34cfb-3642-5272-9992-9d4830b958ca
2026-03-27 16:46:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efb34cfb-3642-5272-9992-9d4830b958ca, skipping ID generation
2026-03-27 16:46:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb34cfb-3642-5272-9992-9d4830b958ca with scrape type 1
2026-03-27 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efb34cfb-3642-5272-9992-9d4830b958ca sending to next pipeline
2026-03-27 16:46:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: efb34cfb-3642-5272-9992-9d4830b958ca, identifier: 1988240
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592d55d90>
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da1199cc-8562-5e2f-b728-70b86981d732/da1199cc-8562-5e2f-b728-70b86981d732_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F0272516a744a4f2c863bc6ffc210bcf7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/4.jpg saved to cache
2026-03-27 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da1199cc-8562-5e2f-b728-70b86981d732
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59120a1d0>
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da1199cc-8562-5e2f-b728-70b86981d732/da1199cc-8562-5e2f-b728-70b86981d732_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F0272516a744a4f2c863bc6ffc210bcf7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/2.jpg saved to cache
2026-03-27 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da1199cc-8562-5e2f-b728-70b86981d732
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591105550>
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da1199cc-8562-5e2f-b728-70b86981d732/da1199cc-8562-5e2f-b728-70b86981d732_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F0272516a744a4f2c863bc6ffc210bcf7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/3.jpg saved to cache
2026-03-27 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da1199cc-8562-5e2f-b728-70b86981d732
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de5290>
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da1199cc-8562-5e2f-b728-70b86981d732/da1199cc-8562-5e2f-b728-70b86981d732_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F0272516a744a4f2c863bc6ffc210bcf7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/5.jpg saved to cache
2026-03-27 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da1199cc-8562-5e2f-b728-70b86981d732
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F46abc90dc50140669efbec60aa152cce%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/3.jpg not downloaded yet
2026-03-27 16:46:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: efb34cfb-3642-5272-9992-9d4830b958ca with identifier: 1988240
2026-03-27 16:46:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: efb34cfb-3642-5272-9992-9d4830b958ca with identifier: 1988240
2026-03-27 16:46:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: efb34cfb-3642-5272-9992-9d4830b958ca with identifier: 1988240 to the API
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'GRIS SCHISTE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'efb34cfb-3642-5272-9992-9d4830b958ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 109037,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb34cfb-3642-5272-9992-9d4830b958ca/efb34cfb-3642-5272-9992-9d4830b958ca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406837,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb34cfb-3642-5272-9992-9d4830b958ca/efb34cfb-3642-5272-9992-9d4830b958ca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406837,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb34cfb-3642-5272-9992-9d4830b958ca/efb34cfb-3642-5272-9992-9d4830b958ca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319637,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb34cfb-3642-5272-9992-9d4830b958ca/efb34cfb-3642-5272-9992-9d4830b958ca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350379,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb34cfb-3642-5272-9992-9d4830b958ca/efb34cfb-3642-5272-9992-9d4830b958ca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279094,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb34cfb-3642-5272-9992-9d4830b958ca/efb34cfb-3642-5272-9992-9d4830b958ca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323523,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb34cfb-3642-5272-9992-9d4830b958ca/efb34cfb-3642-5272-9992-9d4830b958ca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279232,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb34cfb-3642-5272-9992-9d4830b958ca/efb34cfb-3642-5272-9992-9d4830b958ca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346169,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/cffa0a1520514aa2b1b9ced6ca4303a0/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.0 TCe 90ch Evolution',
'transmission': 'manual',
'trim': 'Clio 1.0 TCe 90ch Evolution',
'vin': None,
'year': 2023}
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988240%27 HTTP/1.1" 200 None
2026-03-27 16:46:24 [ayvens.fr] INFO: Saving data for 1988240: {'created_time': 1774629984.9861, 'last_price_update_time': 1774629984.986111, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988240') HTTP/1.1" 204 0
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F46abc90dc50140669efbec60aa152cce%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/4.jpg not downloaded yet
2026-03-27 16:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F46abc90dc50140669efbec60aa152cce%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/5.jpg not downloaded yet
2026-03-27 16:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F46abc90dc50140669efbec60aa152cce%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/6.jpg not downloaded yet
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F46abc90dc50140669efbec60aa152cce%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/7.jpg not downloaded yet
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F46abc90dc50140669efbec60aa152cce%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/8.jpg not downloaded yet
2026-03-27 16:46:25 [ayvens.fr] INFO: Found listing with ID: 1988244
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988244%27 HTTP/1.1" 200 None
2026-03-27 16:46:25 [ayvens.fr] INFO: Scrape type for 1988244: 1
2026-03-27 16:46:25 [ayvens.fr] INFO: Extracting data for car ID: 1988244
2026-03-27 16:46:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78caa060-b3d7-5dad-b410-f5eaaa8a859c with identifier: 1988244
2026-03-27 16:46:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78caa060-b3d7-5dad-b410-f5eaaa8a859c with scrape type 1
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 78caa060-b3d7-5dad-b410-f5eaaa8a859c
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fed4bb35d34b443a5a3368c2ba46ede9e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/1.jpg not downloaded yet
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fed4bb35d34b443a5a3368c2ba46ede9e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/2.jpg not downloaded yet
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d0cd0>
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe25d21a-5a78-52af-be4c-00ab100b0f46/fe25d21a-5a78-52af-be4c-00ab100b0f46_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F5f35dbfcccea44dcbb20f7f733b5a716%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/4.jpg saved to cache
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe25d21a-5a78-52af-be4c-00ab100b0f46
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590675410>
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da1199cc-8562-5e2f-b728-70b86981d732/da1199cc-8562-5e2f-b728-70b86981d732_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F0272516a744a4f2c863bc6ffc210bcf7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/7.jpg saved to cache
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da1199cc-8562-5e2f-b728-70b86981d732
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efdcd0>
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da1199cc-8562-5e2f-b728-70b86981d732/da1199cc-8562-5e2f-b728-70b86981d732_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F0272516a744a4f2c863bc6ffc210bcf7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/8.jpg saved to cache
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da1199cc-8562-5e2f-b728-70b86981d732
2026-03-27 16:46:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da1199cc-8562-5e2f-b728-70b86981d732, skipping ID generation
2026-03-27 16:46:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da1199cc-8562-5e2f-b728-70b86981d732 with scrape type 1
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da1199cc-8562-5e2f-b728-70b86981d732 sending to next pipeline
2026-03-27 16:46:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: da1199cc-8562-5e2f-b728-70b86981d732, identifier: 1988241
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f622d0>
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe25d21a-5a78-52af-be4c-00ab100b0f46/fe25d21a-5a78-52af-be4c-00ab100b0f46_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F5f35dbfcccea44dcbb20f7f733b5a716%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/2.jpg saved to cache
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe25d21a-5a78-52af-be4c-00ab100b0f46
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de6c90>
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe25d21a-5a78-52af-be4c-00ab100b0f46/fe25d21a-5a78-52af-be4c-00ab100b0f46_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F5f35dbfcccea44dcbb20f7f733b5a716%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/3.jpg saved to cache
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe25d21a-5a78-52af-be4c-00ab100b0f46
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066ad50>
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe25d21a-5a78-52af-be4c-00ab100b0f46/fe25d21a-5a78-52af-be4c-00ab100b0f46_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F5f35dbfcccea44dcbb20f7f733b5a716%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/1.jpg saved to cache
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe25d21a-5a78-52af-be4c-00ab100b0f46
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efe710>
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe25d21a-5a78-52af-be4c-00ab100b0f46/fe25d21a-5a78-52af-be4c-00ab100b0f46_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F5f35dbfcccea44dcbb20f7f733b5a716%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/6.jpg saved to cache
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fe25d21a-5a78-52af-be4c-00ab100b0f46
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fed4bb35d34b443a5a3368c2ba46ede9e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/3.jpg not downloaded yet
2026-03-27 16:46:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: da1199cc-8562-5e2f-b728-70b86981d732 with identifier: 1988241
2026-03-27 16:46:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: da1199cc-8562-5e2f-b728-70b86981d732 with identifier: 1988241
2026-03-27 16:46:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: da1199cc-8562-5e2f-b728-70b86981d732 with identifier: 1988241 to the API
2026-03-27 16:46:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'QUANTUM BLUE M',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': 'da1199cc-8562-5e2f-b728-70b86981d732',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'SMART',
'model': '1',
'odometer': 10702,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1199cc-8562-5e2f-b728-70b86981d732/da1199cc-8562-5e2f-b728-70b86981d732_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353665,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1199cc-8562-5e2f-b728-70b86981d732/da1199cc-8562-5e2f-b728-70b86981d732_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353665,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1199cc-8562-5e2f-b728-70b86981d732/da1199cc-8562-5e2f-b728-70b86981d732_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1199cc-8562-5e2f-b728-70b86981d732/da1199cc-8562-5e2f-b728-70b86981d732_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397953,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1199cc-8562-5e2f-b728-70b86981d732/da1199cc-8562-5e2f-b728-70b86981d732_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311668,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1199cc-8562-5e2f-b728-70b86981d732/da1199cc-8562-5e2f-b728-70b86981d732_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263431,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1199cc-8562-5e2f-b728-70b86981d732/da1199cc-8562-5e2f-b728-70b86981d732_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360935,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1199cc-8562-5e2f-b728-70b86981d732/da1199cc-8562-5e2f-b728-70b86981d732_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288667,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/0272516a744a4f2c863bc6ffc210bcf7/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-18',
'seats_number': 5,
'seller_name': None,
'title': 'SMART 1 #1 272ch 66kWh Pro+',
'transmission': 'automatic',
'trim': '#1 272ch 66kWh Pro+',
'vin': None,
'year': 2023}
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988241%27 HTTP/1.1" 200 None
2026-03-27 16:46:26 [ayvens.fr] INFO: Saving data for 1988241: {'created_time': 1774629986.63143, 'last_price_update_time': 1774629986.631441, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988241') HTTP/1.1" 204 0
2026-03-27 16:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591181e90>
2026-03-27 16:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe25d21a-5a78-52af-be4c-00ab100b0f46/fe25d21a-5a78-52af-be4c-00ab100b0f46_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F5f35dbfcccea44dcbb20f7f733b5a716%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/5.jpg saved to cache
2026-03-27 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe25d21a-5a78-52af-be4c-00ab100b0f46
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fed4bb35d34b443a5a3368c2ba46ede9e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/4.jpg not downloaded yet
2026-03-27 16:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fed4bb35d34b443a5a3368c2ba46ede9e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/5.jpg not downloaded yet
2026-03-27 16:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fed4bb35d34b443a5a3368c2ba46ede9e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/6.jpg not downloaded yet
2026-03-27 16:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fed4bb35d34b443a5a3368c2ba46ede9e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/7.jpg not downloaded yet
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fed4bb35d34b443a5a3368c2ba46ede9e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/8.jpg not downloaded yet
2026-03-27 16:46:26 [ayvens.fr] INFO: Found listing with ID: 1988245
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988245%27 HTTP/1.1" 200 None
2026-03-27 16:46:26 [ayvens.fr] INFO: Scrape type for 1988245: 1
2026-03-27 16:46:26 [ayvens.fr] INFO: Extracting data for car ID: 1988245
2026-03-27 16:46:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fe931bb-fbd7-5f8d-86b7-47433e1b89be with identifier: 1988245
2026-03-27 16:46:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fe931bb-fbd7-5f8d-86b7-47433e1b89be with scrape type 1
2026-03-27 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7fe931bb-fbd7-5f8d-86b7-47433e1b89be
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fa94d101b3491480f9b5802bfc5ed2f8e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/1.jpg not downloaded yet
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fa94d101b3491480f9b5802bfc5ed2f8e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/2.jpg not downloaded yet
2026-03-27 16:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590af1d90>
2026-03-27 16:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe25d21a-5a78-52af-be4c-00ab100b0f46/fe25d21a-5a78-52af-be4c-00ab100b0f46_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F5f35dbfcccea44dcbb20f7f733b5a716%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/8.jpg saved to cache
2026-03-27 16:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fe25d21a-5a78-52af-be4c-00ab100b0f46
2026-03-27 16:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590512090>
2026-03-27 16:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe25d21a-5a78-52af-be4c-00ab100b0f46/fe25d21a-5a78-52af-be4c-00ab100b0f46_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F5f35dbfcccea44dcbb20f7f733b5a716%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/7.jpg saved to cache
2026-03-27 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fe25d21a-5a78-52af-be4c-00ab100b0f46
2026-03-27 16:46:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe25d21a-5a78-52af-be4c-00ab100b0f46, skipping ID generation
2026-03-27 16:46:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe25d21a-5a78-52af-be4c-00ab100b0f46 with scrape type 1
2026-03-27 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe25d21a-5a78-52af-be4c-00ab100b0f46 sending to next pipeline
2026-03-27 16:46:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: fe25d21a-5a78-52af-be4c-00ab100b0f46, identifier: 1988242
2026-03-27 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fa94d101b3491480f9b5802bfc5ed2f8e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/3.jpg not downloaded yet
2026-03-27 16:46:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: fe25d21a-5a78-52af-be4c-00ab100b0f46 with identifier: 1988242
2026-03-27 16:46:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: fe25d21a-5a78-52af-be4c-00ab100b0f46 with identifier: 1988242
2026-03-27 16:46:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: fe25d21a-5a78-52af-be4c-00ab100b0f46 with identifier: 1988242 to the API
2026-03-27 16:46:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'fe25d21a-5a78-52af-be4c-00ab100b0f46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 130106,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe25d21a-5a78-52af-be4c-00ab100b0f46/fe25d21a-5a78-52af-be4c-00ab100b0f46_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423877,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe25d21a-5a78-52af-be4c-00ab100b0f46/fe25d21a-5a78-52af-be4c-00ab100b0f46_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423877,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe25d21a-5a78-52af-be4c-00ab100b0f46/fe25d21a-5a78-52af-be4c-00ab100b0f46_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438007,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe25d21a-5a78-52af-be4c-00ab100b0f46/fe25d21a-5a78-52af-be4c-00ab100b0f46_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359857,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe25d21a-5a78-52af-be4c-00ab100b0f46/fe25d21a-5a78-52af-be4c-00ab100b0f46_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331902,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe25d21a-5a78-52af-be4c-00ab100b0f46/fe25d21a-5a78-52af-be4c-00ab100b0f46_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337700,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe25d21a-5a78-52af-be4c-00ab100b0f46/fe25d21a-5a78-52af-be4c-00ab100b0f46_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374778,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe25d21a-5a78-52af-be4c-00ab100b0f46/fe25d21a-5a78-52af-be4c-00ab100b0f46_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311786,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/5f35dbfcccea44dcbb20f7f733b5a716/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-01',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE Megane Estate 1.5 Blue dCi 115ch Business',
'transmission': 'manual',
'trim': 'Megane Estate 1.5 Blue dCi 115ch Business',
'vin': None,
'year': 2021}
2026-03-27 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988242%27 HTTP/1.1" 200 None
2026-03-27 16:46:27 [ayvens.fr] INFO: Saving data for 1988242: {'created_time': 1774629987.996409, 'last_price_update_time': 1774629987.996423, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988242') HTTP/1.1" 204 0
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fa94d101b3491480f9b5802bfc5ed2f8e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/4.jpg not downloaded yet
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f10310>
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85a3d51-0555-5850-b206-0759c849f32f/f85a3d51-0555-5850-b206-0759c849f32f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F46abc90dc50140669efbec60aa152cce%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/2.jpg saved to cache
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f85a3d51-0555-5850-b206-0759c849f32f
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591112e50>
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85a3d51-0555-5850-b206-0759c849f32f/f85a3d51-0555-5850-b206-0759c849f32f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F46abc90dc50140669efbec60aa152cce%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/6.jpg saved to cache
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f85a3d51-0555-5850-b206-0759c849f32f
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de7690>
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85a3d51-0555-5850-b206-0759c849f32f/f85a3d51-0555-5850-b206-0759c849f32f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F46abc90dc50140669efbec60aa152cce%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/5.jpg saved to cache
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f85a3d51-0555-5850-b206-0759c849f32f
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f10310>
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85a3d51-0555-5850-b206-0759c849f32f/f85a3d51-0555-5850-b206-0759c849f32f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F46abc90dc50140669efbec60aa152cce%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/1.jpg saved to cache
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f85a3d51-0555-5850-b206-0759c849f32f
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590daee10>
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85a3d51-0555-5850-b206-0759c849f32f/f85a3d51-0555-5850-b206-0759c849f32f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F46abc90dc50140669efbec60aa152cce%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/3.jpg saved to cache
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f85a3d51-0555-5850-b206-0759c849f32f
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b69850>
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85a3d51-0555-5850-b206-0759c849f32f/f85a3d51-0555-5850-b206-0759c849f32f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F46abc90dc50140669efbec60aa152cce%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/4.jpg saved to cache
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f85a3d51-0555-5850-b206-0759c849f32f
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fa94d101b3491480f9b5802bfc5ed2f8e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/5.jpg not downloaded yet
2026-03-27 16:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fa94d101b3491480f9b5802bfc5ed2f8e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/6.jpg not downloaded yet
2026-03-27 16:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fa94d101b3491480f9b5802bfc5ed2f8e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/7.jpg not downloaded yet
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fa94d101b3491480f9b5802bfc5ed2f8e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/8.jpg not downloaded yet
2026-03-27 16:46:28 [ayvens.fr] INFO: Found listing with ID: 1988246
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988246%27 HTTP/1.1" 200 None
2026-03-27 16:46:28 [ayvens.fr] INFO: Scrape type for 1988246: 1
2026-03-27 16:46:28 [ayvens.fr] INFO: Extracting data for car ID: 1988246
2026-03-27 16:46:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 169643d8-17d4-519b-9068-0a50e861cd2b with identifier: 1988246
2026-03-27 16:46:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 169643d8-17d4-519b-9068-0a50e861cd2b with scrape type 1
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 169643d8-17d4-519b-9068-0a50e861cd2b
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd1df93253afc4c8082bd560e9152e96c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/1.jpg not downloaded yet
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd1df93253afc4c8082bd560e9152e96c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/2.jpg not downloaded yet
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd1df93253afc4c8082bd560e9152e96c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/3.jpg not downloaded yet
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905b0ed0>
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85a3d51-0555-5850-b206-0759c849f32f/f85a3d51-0555-5850-b206-0759c849f32f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F46abc90dc50140669efbec60aa152cce%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/7.jpg saved to cache
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f85a3d51-0555-5850-b206-0759c849f32f
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0c890>
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78caa060-b3d7-5dad-b410-f5eaaa8a859c/78caa060-b3d7-5dad-b410-f5eaaa8a859c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fed4bb35d34b443a5a3368c2ba46ede9e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/6.jpg saved to cache
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 78caa060-b3d7-5dad-b410-f5eaaa8a859c
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd1df93253afc4c8082bd560e9152e96c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/4.jpg not downloaded yet
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c95d0>
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78caa060-b3d7-5dad-b410-f5eaaa8a859c/78caa060-b3d7-5dad-b410-f5eaaa8a859c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fed4bb35d34b443a5a3368c2ba46ede9e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/5.jpg saved to cache
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 78caa060-b3d7-5dad-b410-f5eaaa8a859c
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903cf3d0>
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78caa060-b3d7-5dad-b410-f5eaaa8a859c/78caa060-b3d7-5dad-b410-f5eaaa8a859c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fed4bb35d34b443a5a3368c2ba46ede9e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/4.jpg saved to cache
2026-03-27 16:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 78caa060-b3d7-5dad-b410-f5eaaa8a859c
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590603f90>
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85a3d51-0555-5850-b206-0759c849f32f/f85a3d51-0555-5850-b206-0759c849f32f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F46abc90dc50140669efbec60aa152cce%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/8.jpg saved to cache
2026-03-27 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f85a3d51-0555-5850-b206-0759c849f32f
2026-03-27 16:46:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f85a3d51-0555-5850-b206-0759c849f32f, skipping ID generation
2026-03-27 16:46:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f85a3d51-0555-5850-b206-0759c849f32f with scrape type 1
2026-03-27 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f85a3d51-0555-5850-b206-0759c849f32f sending to next pipeline
2026-03-27 16:46:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f85a3d51-0555-5850-b206-0759c849f32f, identifier: 1988243
2026-03-27 16:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592ca7f90>
2026-03-27 16:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78caa060-b3d7-5dad-b410-f5eaaa8a859c/78caa060-b3d7-5dad-b410-f5eaaa8a859c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fed4bb35d34b443a5a3368c2ba46ede9e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/2.jpg saved to cache
2026-03-27 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 78caa060-b3d7-5dad-b410-f5eaaa8a859c
2026-03-27 16:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905b0950>
2026-03-27 16:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78caa060-b3d7-5dad-b410-f5eaaa8a859c/78caa060-b3d7-5dad-b410-f5eaaa8a859c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fed4bb35d34b443a5a3368c2ba46ede9e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/1.jpg saved to cache
2026-03-27 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78caa060-b3d7-5dad-b410-f5eaaa8a859c
2026-03-27 16:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d0510>
2026-03-27 16:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78caa060-b3d7-5dad-b410-f5eaaa8a859c/78caa060-b3d7-5dad-b410-f5eaaa8a859c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fed4bb35d34b443a5a3368c2ba46ede9e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/3.jpg saved to cache
2026-03-27 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 78caa060-b3d7-5dad-b410-f5eaaa8a859c
2026-03-27 16:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd1df93253afc4c8082bd560e9152e96c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/5.jpg not downloaded yet
2026-03-27 16:46:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f85a3d51-0555-5850-b206-0759c849f32f with identifier: 1988243
2026-03-27 16:46:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f85a3d51-0555-5850-b206-0759c849f32f with identifier: 1988243
2026-03-27 16:46:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f85a3d51-0555-5850-b206-0759c849f32f with identifier: 1988243 to the API
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'GRIS ELECTROCLASH',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'f85a3d51-0555-5850-b206-0759c849f32f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 53703,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85a3d51-0555-5850-b206-0759c849f32f/f85a3d51-0555-5850-b206-0759c849f32f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457057,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85a3d51-0555-5850-b206-0759c849f32f/f85a3d51-0555-5850-b206-0759c849f32f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457057,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85a3d51-0555-5850-b206-0759c849f32f/f85a3d51-0555-5850-b206-0759c849f32f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485738,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85a3d51-0555-5850-b206-0759c849f32f/f85a3d51-0555-5850-b206-0759c849f32f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 498937,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85a3d51-0555-5850-b206-0759c849f32f/f85a3d51-0555-5850-b206-0759c849f32f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 455259,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85a3d51-0555-5850-b206-0759c849f32f/f85a3d51-0555-5850-b206-0759c849f32f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85a3d51-0555-5850-b206-0759c849f32f/f85a3d51-0555-5850-b206-0759c849f32f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381865,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85a3d51-0555-5850-b206-0759c849f32f/f85a3d51-0555-5850-b206-0759c849f32f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585499,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/46abc90dc50140669efbec60aa152cce/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-04',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 1.0 70ch BSG S&S Lounge',
'transmission': 'manual',
'trim': '500 1.0 70ch BSG S&S Lounge',
'vin': None,
'year': 2020}
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988243%27 HTTP/1.1" 200 None
2026-03-27 16:46:29 [ayvens.fr] INFO: Saving data for 1988243: {'created_time': 1774629989.786255, 'last_price_update_time': 1774629989.786266, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988243') HTTP/1.1" 204 0
2026-03-27 16:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd1df93253afc4c8082bd560e9152e96c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/6.jpg not downloaded yet
2026-03-27 16:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd1df93253afc4c8082bd560e9152e96c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/7.jpg not downloaded yet
2026-03-27 16:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0d710>
2026-03-27 16:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78caa060-b3d7-5dad-b410-f5eaaa8a859c/78caa060-b3d7-5dad-b410-f5eaaa8a859c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fed4bb35d34b443a5a3368c2ba46ede9e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/8.jpg saved to cache
2026-03-27 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 78caa060-b3d7-5dad-b410-f5eaaa8a859c
2026-03-27 16:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd1df93253afc4c8082bd560e9152e96c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/8.jpg not downloaded yet
2026-03-27 16:46:29 [ayvens.fr] INFO: Found listing with ID: 1988247
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988247%27 HTTP/1.1" 200 None
2026-03-27 16:46:29 [ayvens.fr] INFO: Scrape type for 1988247: 1
2026-03-27 16:46:29 [ayvens.fr] INFO: Extracting data for car ID: 1988247
2026-03-27 16:46:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e80be3c-8640-54f2-9ad7-267cc7eec608 with identifier: 1988247
2026-03-27 16:46:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e80be3c-8640-54f2-9ad7-267cc7eec608 with scrape type 1
2026-03-27 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7e80be3c-8640-54f2-9ad7-267cc7eec608
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fb388f5bfa6e44d329f65aa67d5cc9eda%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/1.jpg not downloaded yet
2026-03-27 16:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591110110>
2026-03-27 16:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78caa060-b3d7-5dad-b410-f5eaaa8a859c/78caa060-b3d7-5dad-b410-f5eaaa8a859c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fed4bb35d34b443a5a3368c2ba46ede9e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/7.jpg saved to cache
2026-03-27 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 78caa060-b3d7-5dad-b410-f5eaaa8a859c
2026-03-27 16:46:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78caa060-b3d7-5dad-b410-f5eaaa8a859c, skipping ID generation
2026-03-27 16:46:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78caa060-b3d7-5dad-b410-f5eaaa8a859c with scrape type 1
2026-03-27 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78caa060-b3d7-5dad-b410-f5eaaa8a859c sending to next pipeline
2026-03-27 16:46:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 78caa060-b3d7-5dad-b410-f5eaaa8a859c, identifier: 1988244
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4b250>
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fe931bb-fbd7-5f8d-86b7-47433e1b89be/7fe931bb-fbd7-5f8d-86b7-47433e1b89be_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fa94d101b3491480f9b5802bfc5ed2f8e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/2.jpg saved to cache
2026-03-27 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7fe931bb-fbd7-5f8d-86b7-47433e1b89be
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590655410>
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fe931bb-fbd7-5f8d-86b7-47433e1b89be/7fe931bb-fbd7-5f8d-86b7-47433e1b89be_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fa94d101b3491480f9b5802bfc5ed2f8e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/3.jpg saved to cache
2026-03-27 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7fe931bb-fbd7-5f8d-86b7-47433e1b89be
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590668bd0>
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fe931bb-fbd7-5f8d-86b7-47433e1b89be/7fe931bb-fbd7-5f8d-86b7-47433e1b89be_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fa94d101b3491480f9b5802bfc5ed2f8e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/1.jpg saved to cache
2026-03-27 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7fe931bb-fbd7-5f8d-86b7-47433e1b89be
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfc690>
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fe931bb-fbd7-5f8d-86b7-47433e1b89be/7fe931bb-fbd7-5f8d-86b7-47433e1b89be_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fa94d101b3491480f9b5802bfc5ed2f8e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/4.jpg saved to cache
2026-03-27 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7fe931bb-fbd7-5f8d-86b7-47433e1b89be
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590effcd0>
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fe931bb-fbd7-5f8d-86b7-47433e1b89be/7fe931bb-fbd7-5f8d-86b7-47433e1b89be_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fa94d101b3491480f9b5802bfc5ed2f8e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/5.jpg saved to cache
2026-03-27 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7fe931bb-fbd7-5f8d-86b7-47433e1b89be
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fb388f5bfa6e44d329f65aa67d5cc9eda%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/2.jpg not downloaded yet
2026-03-27 16:46:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 78caa060-b3d7-5dad-b410-f5eaaa8a859c with identifier: 1988244
2026-03-27 16:46:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 78caa060-b3d7-5dad-b410-f5eaaa8a859c with identifier: 1988244
2026-03-27 16:46:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 78caa060-b3d7-5dad-b410-f5eaaa8a859c with identifier: 1988244 to the API
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'GRIS SOLAR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid',
'id': '78caa060-b3d7-5dad-b410-f5eaaa8a859c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'KUGA',
'odometer': 35341,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78caa060-b3d7-5dad-b410-f5eaaa8a859c/78caa060-b3d7-5dad-b410-f5eaaa8a859c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 500270,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78caa060-b3d7-5dad-b410-f5eaaa8a859c/78caa060-b3d7-5dad-b410-f5eaaa8a859c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 500270,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78caa060-b3d7-5dad-b410-f5eaaa8a859c/78caa060-b3d7-5dad-b410-f5eaaa8a859c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 484678,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78caa060-b3d7-5dad-b410-f5eaaa8a859c/78caa060-b3d7-5dad-b410-f5eaaa8a859c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403544,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78caa060-b3d7-5dad-b410-f5eaaa8a859c/78caa060-b3d7-5dad-b410-f5eaaa8a859c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412926,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78caa060-b3d7-5dad-b410-f5eaaa8a859c/78caa060-b3d7-5dad-b410-f5eaaa8a859c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376174,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78caa060-b3d7-5dad-b410-f5eaaa8a859c/78caa060-b3d7-5dad-b410-f5eaaa8a859c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340150,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78caa060-b3d7-5dad-b410-f5eaaa8a859c/78caa060-b3d7-5dad-b410-f5eaaa8a859c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446971,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/ed4bb35d34b443a5a3368c2ba46ede9e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-16',
'seats_number': 5,
'seller_name': None,
'title': 'FORD KUGA Kuga 2.5 Duratec 190ch FHEV E85 ST-Line BVA',
'transmission': 'automatic',
'trim': 'Kuga 2.5 Duratec 190ch FHEV E85 ST-Line BVA',
'vin': None,
'year': 2024}
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988244%27 HTTP/1.1" 200 None
2026-03-27 16:46:30 [ayvens.fr] INFO: Saving data for 1988244: {'created_time': 1774629990.836713, 'last_price_update_time': 1774629990.836726, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988244') HTTP/1.1" 204 0
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fb388f5bfa6e44d329f65aa67d5cc9eda%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/3.jpg not downloaded yet
2026-03-27 16:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fb388f5bfa6e44d329f65aa67d5cc9eda%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/4.jpg not downloaded yet
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b65790>
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fe931bb-fbd7-5f8d-86b7-47433e1b89be/7fe931bb-fbd7-5f8d-86b7-47433e1b89be_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fa94d101b3491480f9b5802bfc5ed2f8e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/6.jpg saved to cache
2026-03-27 16:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7fe931bb-fbd7-5f8d-86b7-47433e1b89be
2026-03-27 16:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fb388f5bfa6e44d329f65aa67d5cc9eda%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/5.jpg not downloaded yet
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fb388f5bfa6e44d329f65aa67d5cc9eda%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/6.jpg not downloaded yet
2026-03-27 16:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590590290>
2026-03-27 16:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fe931bb-fbd7-5f8d-86b7-47433e1b89be/7fe931bb-fbd7-5f8d-86b7-47433e1b89be_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fa94d101b3491480f9b5802bfc5ed2f8e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/8.jpg saved to cache
2026-03-27 16:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7fe931bb-fbd7-5f8d-86b7-47433e1b89be
2026-03-27 16:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59064e410>
2026-03-27 16:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_169643d8-17d4-519b-9068-0a50e861cd2b/169643d8-17d4-519b-9068-0a50e861cd2b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd1df93253afc4c8082bd560e9152e96c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/1.jpg saved to cache
2026-03-27 16:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 169643d8-17d4-519b-9068-0a50e861cd2b
2026-03-27 16:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7c910>
2026-03-27 16:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fe931bb-fbd7-5f8d-86b7-47433e1b89be/7fe931bb-fbd7-5f8d-86b7-47433e1b89be_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fa94d101b3491480f9b5802bfc5ed2f8e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/7.jpg saved to cache
2026-03-27 16:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7fe931bb-fbd7-5f8d-86b7-47433e1b89be
2026-03-27 16:46:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7fe931bb-fbd7-5f8d-86b7-47433e1b89be, skipping ID generation
2026-03-27 16:46:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fe931bb-fbd7-5f8d-86b7-47433e1b89be with scrape type 1
2026-03-27 16:46:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7fe931bb-fbd7-5f8d-86b7-47433e1b89be sending to next pipeline
2026-03-27 16:46:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7fe931bb-fbd7-5f8d-86b7-47433e1b89be, identifier: 1988245
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fb388f5bfa6e44d329f65aa67d5cc9eda%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/7.jpg not downloaded yet
2026-03-27 16:46:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7fe931bb-fbd7-5f8d-86b7-47433e1b89be with identifier: 1988245
2026-03-27 16:46:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7fe931bb-fbd7-5f8d-86b7-47433e1b89be with identifier: 1988245
2026-03-27 16:46:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7fe931bb-fbd7-5f8d-86b7-47433e1b89be with identifier: 1988245 to the API
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 23,
'color': 'BLEU DENIM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '7fe931bb-fbd7-5f8d-86b7-47433e1b89be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'CLASSE A',
'odometer': 61180,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fe931bb-fbd7-5f8d-86b7-47433e1b89be/7fe931bb-fbd7-5f8d-86b7-47433e1b89be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416723,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fe931bb-fbd7-5f8d-86b7-47433e1b89be/7fe931bb-fbd7-5f8d-86b7-47433e1b89be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416723,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fe931bb-fbd7-5f8d-86b7-47433e1b89be/7fe931bb-fbd7-5f8d-86b7-47433e1b89be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309827,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fe931bb-fbd7-5f8d-86b7-47433e1b89be/7fe931bb-fbd7-5f8d-86b7-47433e1b89be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344103,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fe931bb-fbd7-5f8d-86b7-47433e1b89be/7fe931bb-fbd7-5f8d-86b7-47433e1b89be_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332288,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fe931bb-fbd7-5f8d-86b7-47433e1b89be/7fe931bb-fbd7-5f8d-86b7-47433e1b89be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401843,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fe931bb-fbd7-5f8d-86b7-47433e1b89be/7fe931bb-fbd7-5f8d-86b7-47433e1b89be_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290341,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fe931bb-fbd7-5f8d-86b7-47433e1b89be/7fe931bb-fbd7-5f8d-86b7-47433e1b89be_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349360,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/a94d101b3491480f9b5802bfc5ed2f8e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-25',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ CLASSE A Classe A 250 e 160+102ch Business Line '
'8G-DCT 8cv',
'transmission': 'automatic',
'trim': 'Classe A 250 e 160+102ch Business Line 8G-DCT 8cv',
'vin': None,
'year': 2021}
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988245%27 HTTP/1.1" 200 None
2026-03-27 16:46:31 [ayvens.fr] INFO: Saving data for 1988245: {'created_time': 1774629991.799773, 'last_price_update_time': 1774629991.799784, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988245') HTTP/1.1" 204 0
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fb388f5bfa6e44d329f65aa67d5cc9eda%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/8.jpg not downloaded yet
2026-03-27 16:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0a590>
2026-03-27 16:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_169643d8-17d4-519b-9068-0a50e861cd2b/169643d8-17d4-519b-9068-0a50e861cd2b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd1df93253afc4c8082bd560e9152e96c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/2.jpg saved to cache
2026-03-27 16:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 169643d8-17d4-519b-9068-0a50e861cd2b
2026-03-27 16:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b1a810>
2026-03-27 16:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_169643d8-17d4-519b-9068-0a50e861cd2b/169643d8-17d4-519b-9068-0a50e861cd2b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd1df93253afc4c8082bd560e9152e96c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/6.jpg saved to cache
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 169643d8-17d4-519b-9068-0a50e861cd2b
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903dc350>
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_169643d8-17d4-519b-9068-0a50e861cd2b/169643d8-17d4-519b-9068-0a50e861cd2b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd1df93253afc4c8082bd560e9152e96c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/4.jpg saved to cache
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 169643d8-17d4-519b-9068-0a50e861cd2b
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b2bad0>
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_169643d8-17d4-519b-9068-0a50e861cd2b/169643d8-17d4-519b-9068-0a50e861cd2b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd1df93253afc4c8082bd560e9152e96c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/5.jpg saved to cache
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 169643d8-17d4-519b-9068-0a50e861cd2b
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591431510>
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_169643d8-17d4-519b-9068-0a50e861cd2b/169643d8-17d4-519b-9068-0a50e861cd2b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd1df93253afc4c8082bd560e9152e96c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/3.jpg saved to cache
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 169643d8-17d4-519b-9068-0a50e861cd2b
2026-03-27 16:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:32 [ayvens.fr] INFO: Found listing with ID: 1988248
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988248%27 HTTP/1.1" 200 None
2026-03-27 16:46:32 [ayvens.fr] INFO: Scrape type for 1988248: 1
2026-03-27 16:46:32 [ayvens.fr] INFO: Extracting data for car ID: 1988248
2026-03-27 16:46:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30a5f7cc-3c64-5086-afd1-2ea38b41540c with identifier: 1988248
2026-03-27 16:46:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30a5f7cc-3c64-5086-afd1-2ea38b41540c with scrape type 1
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 30a5f7cc-3c64-5086-afd1-2ea38b41540c
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff3a0fd607e144485b8250316bb7aab6e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/1.jpg not downloaded yet
2026-03-27 16:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff3a0fd607e144485b8250316bb7aab6e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/2.jpg not downloaded yet
2026-03-27 16:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff3a0fd607e144485b8250316bb7aab6e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/3.jpg not downloaded yet
2026-03-27 16:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff3a0fd607e144485b8250316bb7aab6e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/4.jpg not downloaded yet
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff3a0fd607e144485b8250316bb7aab6e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/5.jpg not downloaded yet
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff3a0fd607e144485b8250316bb7aab6e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/6.jpg not downloaded yet
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ad45d0>
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_169643d8-17d4-519b-9068-0a50e861cd2b/169643d8-17d4-519b-9068-0a50e861cd2b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd1df93253afc4c8082bd560e9152e96c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/7.jpg saved to cache
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 169643d8-17d4-519b-9068-0a50e861cd2b
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff3a0fd607e144485b8250316bb7aab6e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/7.jpg not downloaded yet
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff3a0fd607e144485b8250316bb7aab6e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/8.jpg not downloaded yet
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f325d0>
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_169643d8-17d4-519b-9068-0a50e861cd2b/169643d8-17d4-519b-9068-0a50e861cd2b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd1df93253afc4c8082bd560e9152e96c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/8.jpg saved to cache
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 169643d8-17d4-519b-9068-0a50e861cd2b
2026-03-27 16:46:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 169643d8-17d4-519b-9068-0a50e861cd2b, skipping ID generation
2026-03-27 16:46:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 169643d8-17d4-519b-9068-0a50e861cd2b with scrape type 1
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 169643d8-17d4-519b-9068-0a50e861cd2b sending to next pipeline
2026-03-27 16:46:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 169643d8-17d4-519b-9068-0a50e861cd2b, identifier: 1988246
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4c150>
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e80be3c-8640-54f2-9ad7-267cc7eec608/7e80be3c-8640-54f2-9ad7-267cc7eec608_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fb388f5bfa6e44d329f65aa67d5cc9eda%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/4.jpg saved to cache
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7e80be3c-8640-54f2-9ad7-267cc7eec608
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ab89d0>
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e80be3c-8640-54f2-9ad7-267cc7eec608/7e80be3c-8640-54f2-9ad7-267cc7eec608_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fb388f5bfa6e44d329f65aa67d5cc9eda%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/3.jpg saved to cache
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e80be3c-8640-54f2-9ad7-267cc7eec608
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590daca90>
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e80be3c-8640-54f2-9ad7-267cc7eec608/7e80be3c-8640-54f2-9ad7-267cc7eec608_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fb388f5bfa6e44d329f65aa67d5cc9eda%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/2.jpg saved to cache
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e80be3c-8640-54f2-9ad7-267cc7eec608
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6d410>
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e80be3c-8640-54f2-9ad7-267cc7eec608/7e80be3c-8640-54f2-9ad7-267cc7eec608_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fb388f5bfa6e44d329f65aa67d5cc9eda%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/1.jpg saved to cache
2026-03-27 16:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e80be3c-8640-54f2-9ad7-267cc7eec608
2026-03-27 16:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 169643d8-17d4-519b-9068-0a50e861cd2b with identifier: 1988246
2026-03-27 16:46:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 169643d8-17d4-519b-9068-0a50e861cd2b with identifier: 1988246
2026-03-27 16:46:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 169643d8-17d4-519b-9068-0a50e861cd2b with identifier: 1988246 to the API
2026-03-27 16:46:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '169643d8-17d4-519b-9068-0a50e861cd2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 3',
'odometer': 122577,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169643d8-17d4-519b-9068-0a50e861cd2b/169643d8-17d4-519b-9068-0a50e861cd2b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 390368,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169643d8-17d4-519b-9068-0a50e861cd2b/169643d8-17d4-519b-9068-0a50e861cd2b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 390368,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169643d8-17d4-519b-9068-0a50e861cd2b/169643d8-17d4-519b-9068-0a50e861cd2b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415627,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169643d8-17d4-519b-9068-0a50e861cd2b/169643d8-17d4-519b-9068-0a50e861cd2b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363559,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169643d8-17d4-519b-9068-0a50e861cd2b/169643d8-17d4-519b-9068-0a50e861cd2b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347228,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169643d8-17d4-519b-9068-0a50e861cd2b/169643d8-17d4-519b-9068-0a50e861cd2b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385127,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169643d8-17d4-519b-9068-0a50e861cd2b/169643d8-17d4-519b-9068-0a50e861cd2b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250570,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169643d8-17d4-519b-9068-0a50e861cd2b/169643d8-17d4-519b-9068-0a50e861cd2b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287562,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d1df93253afc4c8082bd560e9152e96c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-01',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 3 Serie 3 318dA MH 150ch Business Design',
'transmission': 'automatic',
'trim': 'Serie 3 318dA MH 150ch Business Design',
'vin': None,
'year': 2022}
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988246%27 HTTP/1.1" 200 None
2026-03-27 16:46:33 [ayvens.fr] INFO: Saving data for 1988246: {'created_time': 1774629993.427712, 'last_price_update_time': 1774629993.427722, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988246') HTTP/1.1" 204 0
2026-03-27 16:46:33 [ayvens.fr] INFO: Found listing with ID: 1988249
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988249%27 HTTP/1.1" 200 None
2026-03-27 16:46:33 [ayvens.fr] INFO: Scrape type for 1988249: 1
2026-03-27 16:46:33 [ayvens.fr] INFO: Extracting data for car ID: 1988249
2026-03-27 16:46:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f66f89cd-f175-56f9-bc50-e6cb453f2c49 with identifier: 1988249
2026-03-27 16:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f66f89cd-f175-56f9-bc50-e6cb453f2c49 with scrape type 1
2026-03-27 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f66f89cd-f175-56f9-bc50-e6cb453f2c49
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fce909e8f2e7740fb90773e2730bad269%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/1.jpg not downloaded yet
2026-03-27 16:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590677ad0>
2026-03-27 16:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e80be3c-8640-54f2-9ad7-267cc7eec608/7e80be3c-8640-54f2-9ad7-267cc7eec608_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fb388f5bfa6e44d329f65aa67d5cc9eda%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/5.jpg saved to cache
2026-03-27 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7e80be3c-8640-54f2-9ad7-267cc7eec608
2026-03-27 16:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa1710>
2026-03-27 16:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e80be3c-8640-54f2-9ad7-267cc7eec608/7e80be3c-8640-54f2-9ad7-267cc7eec608_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fb388f5bfa6e44d329f65aa67d5cc9eda%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/6.jpg saved to cache
2026-03-27 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7e80be3c-8640-54f2-9ad7-267cc7eec608
2026-03-27 16:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fce909e8f2e7740fb90773e2730bad269%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/2.jpg not downloaded yet
2026-03-27 16:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906940d0>
2026-03-27 16:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e80be3c-8640-54f2-9ad7-267cc7eec608/7e80be3c-8640-54f2-9ad7-267cc7eec608_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fb388f5bfa6e44d329f65aa67d5cc9eda%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/7.jpg saved to cache
2026-03-27 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7e80be3c-8640-54f2-9ad7-267cc7eec608
2026-03-27 16:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fce909e8f2e7740fb90773e2730bad269%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/3.jpg not downloaded yet
2026-03-27 16:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fce909e8f2e7740fb90773e2730bad269%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/4.jpg not downloaded yet
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fce909e8f2e7740fb90773e2730bad269%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/5.jpg not downloaded yet
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fce909e8f2e7740fb90773e2730bad269%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/6.jpg not downloaded yet
2026-03-27 16:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b48ad0>
2026-03-27 16:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e80be3c-8640-54f2-9ad7-267cc7eec608/7e80be3c-8640-54f2-9ad7-267cc7eec608_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fb388f5bfa6e44d329f65aa67d5cc9eda%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/8.jpg saved to cache
2026-03-27 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7e80be3c-8640-54f2-9ad7-267cc7eec608
2026-03-27 16:46:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e80be3c-8640-54f2-9ad7-267cc7eec608, skipping ID generation
2026-03-27 16:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e80be3c-8640-54f2-9ad7-267cc7eec608 with scrape type 1
2026-03-27 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e80be3c-8640-54f2-9ad7-267cc7eec608 sending to next pipeline
2026-03-27 16:46:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7e80be3c-8640-54f2-9ad7-267cc7eec608, identifier: 1988247
2026-03-27 16:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b43e50>
2026-03-27 16:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30a5f7cc-3c64-5086-afd1-2ea38b41540c/30a5f7cc-3c64-5086-afd1-2ea38b41540c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff3a0fd607e144485b8250316bb7aab6e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/1.jpg saved to cache
2026-03-27 16:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30a5f7cc-3c64-5086-afd1-2ea38b41540c
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fce909e8f2e7740fb90773e2730bad269%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/7.jpg not downloaded yet
2026-03-27 16:46:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7e80be3c-8640-54f2-9ad7-267cc7eec608 with identifier: 1988247
2026-03-27 16:46:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7e80be3c-8640-54f2-9ad7-267cc7eec608 with identifier: 1988247
2026-03-27 16:46:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7e80be3c-8640-54f2-9ad7-267cc7eec608 with identifier: 1988247 to the API
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '7e80be3c-8640-54f2-9ad7-267cc7eec608',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 115981,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e80be3c-8640-54f2-9ad7-267cc7eec608/7e80be3c-8640-54f2-9ad7-267cc7eec608_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 498026,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e80be3c-8640-54f2-9ad7-267cc7eec608/7e80be3c-8640-54f2-9ad7-267cc7eec608_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 498026,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e80be3c-8640-54f2-9ad7-267cc7eec608/7e80be3c-8640-54f2-9ad7-267cc7eec608_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 469828,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e80be3c-8640-54f2-9ad7-267cc7eec608/7e80be3c-8640-54f2-9ad7-267cc7eec608_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398167,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e80be3c-8640-54f2-9ad7-267cc7eec608/7e80be3c-8640-54f2-9ad7-267cc7eec608_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434203,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e80be3c-8640-54f2-9ad7-267cc7eec608/7e80be3c-8640-54f2-9ad7-267cc7eec608_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 427882,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e80be3c-8640-54f2-9ad7-267cc7eec608/7e80be3c-8640-54f2-9ad7-267cc7eec608_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 234236,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e80be3c-8640-54f2-9ad7-267cc7eec608/7e80be3c-8640-54f2-9ad7-267cc7eec608_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373976,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/b388f5bfa6e44d329f65aa67d5cc9eda/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-18',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 PureTech 110ch Shine S&S EAT6',
'transmission': 'automatic',
'trim': 'C3 PureTech 110ch Shine S&S EAT6',
'vin': None,
'year': 2020}
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988247%27 HTTP/1.1" 200 None
2026-03-27 16:46:34 [ayvens.fr] INFO: Saving data for 1988247: {'created_time': 1774629994.406104, 'last_price_update_time': 1774629994.406115, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988247') HTTP/1.1" 204 0
2026-03-27 16:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fce909e8f2e7740fb90773e2730bad269%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/8.jpg not downloaded yet
2026-03-27 16:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066add0>
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30a5f7cc-3c64-5086-afd1-2ea38b41540c/30a5f7cc-3c64-5086-afd1-2ea38b41540c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff3a0fd607e144485b8250316bb7aab6e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/2.jpg saved to cache
2026-03-27 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30a5f7cc-3c64-5086-afd1-2ea38b41540c
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c9d10>
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30a5f7cc-3c64-5086-afd1-2ea38b41540c/30a5f7cc-3c64-5086-afd1-2ea38b41540c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff3a0fd607e144485b8250316bb7aab6e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/4.jpg saved to cache
2026-03-27 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30a5f7cc-3c64-5086-afd1-2ea38b41540c
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b880d0>
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30a5f7cc-3c64-5086-afd1-2ea38b41540c/30a5f7cc-3c64-5086-afd1-2ea38b41540c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff3a0fd607e144485b8250316bb7aab6e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/3.jpg saved to cache
2026-03-27 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30a5f7cc-3c64-5086-afd1-2ea38b41540c
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590aea010>
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30a5f7cc-3c64-5086-afd1-2ea38b41540c/30a5f7cc-3c64-5086-afd1-2ea38b41540c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff3a0fd607e144485b8250316bb7aab6e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/6.jpg saved to cache
2026-03-27 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30a5f7cc-3c64-5086-afd1-2ea38b41540c
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2ca10>
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30a5f7cc-3c64-5086-afd1-2ea38b41540c/30a5f7cc-3c64-5086-afd1-2ea38b41540c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff3a0fd607e144485b8250316bb7aab6e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/5.jpg saved to cache
2026-03-27 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30a5f7cc-3c64-5086-afd1-2ea38b41540c
2026-03-27 16:46:34 [ayvens.fr] INFO: Found listing with ID: 1988250
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988250%27 HTTP/1.1" 200 None
2026-03-27 16:46:34 [ayvens.fr] INFO: Scrape type for 1988250: 1
2026-03-27 16:46:34 [ayvens.fr] INFO: Extracting data for car ID: 1988250
2026-03-27 16:46:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5dd5a9c-e220-51b5-a8a6-c897fdc4d730 with identifier: 1988250
2026-03-27 16:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5dd5a9c-e220-51b5-a8a6-c897fdc4d730 with scrape type 1
2026-03-27 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f5dd5a9c-e220-51b5-a8a6-c897fdc4d730
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F2fe1ed4b47df453fa6c7998085f0f64c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/1.jpg not downloaded yet
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5914451d0>
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30a5f7cc-3c64-5086-afd1-2ea38b41540c/30a5f7cc-3c64-5086-afd1-2ea38b41540c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff3a0fd607e144485b8250316bb7aab6e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/8.jpg saved to cache
2026-03-27 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30a5f7cc-3c64-5086-afd1-2ea38b41540c
2026-03-27 16:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F2fe1ed4b47df453fa6c7998085f0f64c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/2.jpg not downloaded yet
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591446510>
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30a5f7cc-3c64-5086-afd1-2ea38b41540c/30a5f7cc-3c64-5086-afd1-2ea38b41540c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff3a0fd607e144485b8250316bb7aab6e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/7.jpg saved to cache
2026-03-27 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30a5f7cc-3c64-5086-afd1-2ea38b41540c
2026-03-27 16:46:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30a5f7cc-3c64-5086-afd1-2ea38b41540c, skipping ID generation
2026-03-27 16:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30a5f7cc-3c64-5086-afd1-2ea38b41540c with scrape type 1
2026-03-27 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30a5f7cc-3c64-5086-afd1-2ea38b41540c sending to next pipeline
2026-03-27 16:46:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 30a5f7cc-3c64-5086-afd1-2ea38b41540c, identifier: 1988248
2026-03-27 16:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 30a5f7cc-3c64-5086-afd1-2ea38b41540c with identifier: 1988248
2026-03-27 16:46:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 30a5f7cc-3c64-5086-afd1-2ea38b41540c with identifier: 1988248
2026-03-27 16:46:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 30a5f7cc-3c64-5086-afd1-2ea38b41540c with identifier: 1988248 to the API
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': 'BLEU ABYSSE UNI',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid',
'id': '30a5f7cc-3c64-5086-afd1-2ea38b41540c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'PUMA',
'odometer': 109547,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30a5f7cc-3c64-5086-afd1-2ea38b41540c/30a5f7cc-3c64-5086-afd1-2ea38b41540c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370553,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30a5f7cc-3c64-5086-afd1-2ea38b41540c/30a5f7cc-3c64-5086-afd1-2ea38b41540c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370553,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30a5f7cc-3c64-5086-afd1-2ea38b41540c/30a5f7cc-3c64-5086-afd1-2ea38b41540c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398653,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30a5f7cc-3c64-5086-afd1-2ea38b41540c/30a5f7cc-3c64-5086-afd1-2ea38b41540c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305269,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30a5f7cc-3c64-5086-afd1-2ea38b41540c/30a5f7cc-3c64-5086-afd1-2ea38b41540c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345847,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30a5f7cc-3c64-5086-afd1-2ea38b41540c/30a5f7cc-3c64-5086-afd1-2ea38b41540c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341188,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30a5f7cc-3c64-5086-afd1-2ea38b41540c/30a5f7cc-3c64-5086-afd1-2ea38b41540c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 266588,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30a5f7cc-3c64-5086-afd1-2ea38b41540c/30a5f7cc-3c64-5086-afd1-2ea38b41540c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250272,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f3a0fd607e144485b8250316bb7aab6e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'FORD PUMA Puma 1.0 Flexifuel 125ch S&S mHEV Titanium Business',
'transmission': 'manual',
'trim': 'Puma 1.0 Flexifuel 125ch S&S mHEV Titanium Business',
'vin': None,
'year': 2023}
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988248%27 HTTP/1.1" 200 None
2026-03-27 16:46:35 [ayvens.fr] INFO: Saving data for 1988248: {'created_time': 1774629995.519889, 'last_price_update_time': 1774629995.519904, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988248') HTTP/1.1" 204 0
2026-03-27 16:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F2fe1ed4b47df453fa6c7998085f0f64c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/3.jpg not downloaded yet
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ad7b10>
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f66f89cd-f175-56f9-bc50-e6cb453f2c49/f66f89cd-f175-56f9-bc50-e6cb453f2c49_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fce909e8f2e7740fb90773e2730bad269%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/4.jpg saved to cache
2026-03-27 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f66f89cd-f175-56f9-bc50-e6cb453f2c49
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d97950>
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f66f89cd-f175-56f9-bc50-e6cb453f2c49/f66f89cd-f175-56f9-bc50-e6cb453f2c49_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fce909e8f2e7740fb90773e2730bad269%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/3.jpg saved to cache
2026-03-27 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f66f89cd-f175-56f9-bc50-e6cb453f2c49
2026-03-27 16:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F2fe1ed4b47df453fa6c7998085f0f64c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/4.jpg not downloaded yet
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59067f510>
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f66f89cd-f175-56f9-bc50-e6cb453f2c49/f66f89cd-f175-56f9-bc50-e6cb453f2c49_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fce909e8f2e7740fb90773e2730bad269%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/2.jpg saved to cache
2026-03-27 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f66f89cd-f175-56f9-bc50-e6cb453f2c49
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b1210>
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f66f89cd-f175-56f9-bc50-e6cb453f2c49/f66f89cd-f175-56f9-bc50-e6cb453f2c49_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fce909e8f2e7740fb90773e2730bad269%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/1.jpg saved to cache
2026-03-27 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f66f89cd-f175-56f9-bc50-e6cb453f2c49
2026-03-27 16:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F2fe1ed4b47df453fa6c7998085f0f64c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/5.jpg not downloaded yet
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a10d0>
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f66f89cd-f175-56f9-bc50-e6cb453f2c49/f66f89cd-f175-56f9-bc50-e6cb453f2c49_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fce909e8f2e7740fb90773e2730bad269%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/5.jpg saved to cache
2026-03-27 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f66f89cd-f175-56f9-bc50-e6cb453f2c49
2026-03-27 16:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F2fe1ed4b47df453fa6c7998085f0f64c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/6.jpg not downloaded yet
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a0690>
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f66f89cd-f175-56f9-bc50-e6cb453f2c49/f66f89cd-f175-56f9-bc50-e6cb453f2c49_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fce909e8f2e7740fb90773e2730bad269%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/6.jpg saved to cache
2026-03-27 16:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f66f89cd-f175-56f9-bc50-e6cb453f2c49
2026-03-27 16:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F2fe1ed4b47df453fa6c7998085f0f64c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/7.jpg not downloaded yet
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F2fe1ed4b47df453fa6c7998085f0f64c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/8.jpg not downloaded yet
2026-03-27 16:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fab910>
2026-03-27 16:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f66f89cd-f175-56f9-bc50-e6cb453f2c49/f66f89cd-f175-56f9-bc50-e6cb453f2c49_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fce909e8f2e7740fb90773e2730bad269%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/8.jpg saved to cache
2026-03-27 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f66f89cd-f175-56f9-bc50-e6cb453f2c49
2026-03-27 16:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa9490>
2026-03-27 16:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f66f89cd-f175-56f9-bc50-e6cb453f2c49/f66f89cd-f175-56f9-bc50-e6cb453f2c49_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fce909e8f2e7740fb90773e2730bad269%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/7.jpg saved to cache
2026-03-27 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f66f89cd-f175-56f9-bc50-e6cb453f2c49
2026-03-27 16:46:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f66f89cd-f175-56f9-bc50-e6cb453f2c49, skipping ID generation
2026-03-27 16:46:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f66f89cd-f175-56f9-bc50-e6cb453f2c49 with scrape type 1
2026-03-27 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f66f89cd-f175-56f9-bc50-e6cb453f2c49 sending to next pipeline
2026-03-27 16:46:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f66f89cd-f175-56f9-bc50-e6cb453f2c49, identifier: 1988249
2026-03-27 16:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f66f89cd-f175-56f9-bc50-e6cb453f2c49 with identifier: 1988249
2026-03-27 16:46:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f66f89cd-f175-56f9-bc50-e6cb453f2c49 with identifier: 1988249
2026-03-27 16:46:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f66f89cd-f175-56f9-bc50-e6cb453f2c49 with identifier: 1988249 to the API
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 137,
'color': 'SKYCRAPERGRAU',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'f66f89cd-f175-56f9-bc50-e6cb453f2c49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 1',
'odometer': 59710,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f66f89cd-f175-56f9-bc50-e6cb453f2c49/f66f89cd-f175-56f9-bc50-e6cb453f2c49_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405441,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f66f89cd-f175-56f9-bc50-e6cb453f2c49/f66f89cd-f175-56f9-bc50-e6cb453f2c49_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405441,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f66f89cd-f175-56f9-bc50-e6cb453f2c49/f66f89cd-f175-56f9-bc50-e6cb453f2c49_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342498,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f66f89cd-f175-56f9-bc50-e6cb453f2c49/f66f89cd-f175-56f9-bc50-e6cb453f2c49_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336100,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f66f89cd-f175-56f9-bc50-e6cb453f2c49/f66f89cd-f175-56f9-bc50-e6cb453f2c49_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310470,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f66f89cd-f175-56f9-bc50-e6cb453f2c49/f66f89cd-f175-56f9-bc50-e6cb453f2c49_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326543,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f66f89cd-f175-56f9-bc50-e6cb453f2c49/f66f89cd-f175-56f9-bc50-e6cb453f2c49_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326910,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f66f89cd-f175-56f9-bc50-e6cb453f2c49/f66f89cd-f175-56f9-bc50-e6cb453f2c49_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321280,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/ce909e8f2e7740fb90773e2730bad269/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-24',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 1 Serie 1 118iA 136ch M Sport DKG7',
'transmission': 'automatic',
'trim': 'Serie 1 118iA 136ch M Sport DKG7',
'vin': None,
'year': 2023}
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988249%27 HTTP/1.1" 200 None
2026-03-27 16:46:36 [ayvens.fr] INFO: Saving data for 1988249: {'created_time': 1774629996.74233, 'last_price_update_time': 1774629996.742342, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988249') HTTP/1.1" 204 0
2026-03-27 16:46:36 [ayvens.fr] INFO: Found listing with ID: 1988251
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988251%27 HTTP/1.1" 200 None
2026-03-27 16:46:36 [ayvens.fr] INFO: Scrape type for 1988251: 1
2026-03-27 16:46:36 [ayvens.fr] INFO: Extracting data for car ID: 1988251
2026-03-27 16:46:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29 with identifier: 1988251
2026-03-27 16:46:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29 with scrape type 1
2026-03-27 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F2346288e4cdf47e38604e92f67c33cab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/1.jpg not downloaded yet
2026-03-27 16:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F2346288e4cdf47e38604e92f67c33cab%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/2.jpg not downloaded yet
2026-03-27 16:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591052bd0>
2026-03-27 16:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5dd5a9c-e220-51b5-a8a6-c897fdc4d730/f5dd5a9c-e220-51b5-a8a6-c897fdc4d730_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F2fe1ed4b47df453fa6c7998085f0f64c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/1.jpg saved to cache
2026-03-27 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5dd5a9c-e220-51b5-a8a6-c897fdc4d730
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F2346288e4cdf47e38604e92f67c33cab%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/3.jpg not downloaded yet
2026-03-27 16:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F2346288e4cdf47e38604e92f67c33cab%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/4.jpg not downloaded yet
2026-03-27 16:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590593290>
2026-03-27 16:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5dd5a9c-e220-51b5-a8a6-c897fdc4d730/f5dd5a9c-e220-51b5-a8a6-c897fdc4d730_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F2fe1ed4b47df453fa6c7998085f0f64c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/2.jpg saved to cache
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5dd5a9c-e220-51b5-a8a6-c897fdc4d730
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F2346288e4cdf47e38604e92f67c33cab%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/5.jpg not downloaded yet
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F2346288e4cdf47e38604e92f67c33cab%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/6.jpg not downloaded yet
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b6ad10>
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5dd5a9c-e220-51b5-a8a6-c897fdc4d730/f5dd5a9c-e220-51b5-a8a6-c897fdc4d730_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F2fe1ed4b47df453fa6c7998085f0f64c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/3.jpg saved to cache
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5dd5a9c-e220-51b5-a8a6-c897fdc4d730
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae0e10>
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5dd5a9c-e220-51b5-a8a6-c897fdc4d730/f5dd5a9c-e220-51b5-a8a6-c897fdc4d730_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F2fe1ed4b47df453fa6c7998085f0f64c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/4.jpg saved to cache
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5dd5a9c-e220-51b5-a8a6-c897fdc4d730
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc48d0>
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5dd5a9c-e220-51b5-a8a6-c897fdc4d730/f5dd5a9c-e220-51b5-a8a6-c897fdc4d730_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F2fe1ed4b47df453fa6c7998085f0f64c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/5.jpg saved to cache
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5dd5a9c-e220-51b5-a8a6-c897fdc4d730
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a9090>
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5dd5a9c-e220-51b5-a8a6-c897fdc4d730/f5dd5a9c-e220-51b5-a8a6-c897fdc4d730_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F2fe1ed4b47df453fa6c7998085f0f64c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/6.jpg saved to cache
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5dd5a9c-e220-51b5-a8a6-c897fdc4d730
2026-03-27 16:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F2346288e4cdf47e38604e92f67c33cab%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/7.jpg not downloaded yet
2026-03-27 16:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F2346288e4cdf47e38604e92f67c33cab%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/8.jpg not downloaded yet
2026-03-27 16:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:37 [ayvens.fr] INFO: Found listing with ID: 1988252
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988252%27 HTTP/1.1" 200 None
2026-03-27 16:46:37 [ayvens.fr] INFO: Scrape type for 1988252: 1
2026-03-27 16:46:37 [ayvens.fr] INFO: Extracting data for car ID: 1988252
2026-03-27 16:46:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13cc69d3-971f-531c-9e85-f9b9801988c0 with identifier: 1988252
2026-03-27 16:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13cc69d3-971f-531c-9e85-f9b9801988c0 with scrape type 1
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 13cc69d3-971f-531c-9e85-f9b9801988c0
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F612e9f9cb1bb4801bbfa2f95333ad682%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/1.jpg not downloaded yet
2026-03-27 16:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F612e9f9cb1bb4801bbfa2f95333ad682%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/2.jpg not downloaded yet
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F612e9f9cb1bb4801bbfa2f95333ad682%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/3.jpg not downloaded yet
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F612e9f9cb1bb4801bbfa2f95333ad682%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/4.jpg not downloaded yet
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590668950>
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5dd5a9c-e220-51b5-a8a6-c897fdc4d730/f5dd5a9c-e220-51b5-a8a6-c897fdc4d730_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F2fe1ed4b47df453fa6c7998085f0f64c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/7.jpg saved to cache
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5dd5a9c-e220-51b5-a8a6-c897fdc4d730
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0e390>
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5dd5a9c-e220-51b5-a8a6-c897fdc4d730/f5dd5a9c-e220-51b5-a8a6-c897fdc4d730_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F2fe1ed4b47df453fa6c7998085f0f64c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/8.jpg saved to cache
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5dd5a9c-e220-51b5-a8a6-c897fdc4d730
2026-03-27 16:46:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5dd5a9c-e220-51b5-a8a6-c897fdc4d730, skipping ID generation
2026-03-27 16:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5dd5a9c-e220-51b5-a8a6-c897fdc4d730 with scrape type 1
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5dd5a9c-e220-51b5-a8a6-c897fdc4d730 sending to next pipeline
2026-03-27 16:46:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f5dd5a9c-e220-51b5-a8a6-c897fdc4d730, identifier: 1988250
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F612e9f9cb1bb4801bbfa2f95333ad682%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/5.jpg not downloaded yet
2026-03-27 16:46:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f5dd5a9c-e220-51b5-a8a6-c897fdc4d730 with identifier: 1988250
2026-03-27 16:46:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f5dd5a9c-e220-51b5-a8a6-c897fdc4d730 with identifier: 1988250
2026-03-27 16:46:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f5dd5a9c-e220-51b5-a8a6-c897fdc4d730 with identifier: 1988250 to the API
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 53,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'f5dd5a9c-e220-51b5-a8a6-c897fdc4d730',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'X3',
'odometer': 127196,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5dd5a9c-e220-51b5-a8a6-c897fdc4d730/f5dd5a9c-e220-51b5-a8a6-c897fdc4d730_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 551543,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5dd5a9c-e220-51b5-a8a6-c897fdc4d730/f5dd5a9c-e220-51b5-a8a6-c897fdc4d730_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 551543,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5dd5a9c-e220-51b5-a8a6-c897fdc4d730/f5dd5a9c-e220-51b5-a8a6-c897fdc4d730_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505563,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5dd5a9c-e220-51b5-a8a6-c897fdc4d730/f5dd5a9c-e220-51b5-a8a6-c897fdc4d730_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525214,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5dd5a9c-e220-51b5-a8a6-c897fdc4d730/f5dd5a9c-e220-51b5-a8a6-c897fdc4d730_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 503501,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5dd5a9c-e220-51b5-a8a6-c897fdc4d730/f5dd5a9c-e220-51b5-a8a6-c897fdc4d730_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398996,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5dd5a9c-e220-51b5-a8a6-c897fdc4d730/f5dd5a9c-e220-51b5-a8a6-c897fdc4d730_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362150,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5dd5a9c-e220-51b5-a8a6-c897fdc4d730/f5dd5a9c-e220-51b5-a8a6-c897fdc4d730_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301906,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/2fe1ed4b47df453fa6c7998085f0f64c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-09',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 X3 xDrive30eA 292ch xLine',
'transmission': 'automatic',
'trim': 'X3 xDrive30eA 292ch xLine',
'vin': None,
'year': 2020}
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988250%27 HTTP/1.1" 200 None
2026-03-27 16:46:38 [ayvens.fr] INFO: Saving data for 1988250: {'created_time': 1774629998.081621, 'last_price_update_time': 1774629998.081633, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988250') HTTP/1.1" 204 0
2026-03-27 16:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b2e50>
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29/e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F2346288e4cdf47e38604e92f67c33cab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/1.jpg saved to cache
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59067ced0>
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29/e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F2346288e4cdf47e38604e92f67c33cab%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/2.jpg saved to cache
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29
2026-03-27 16:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F612e9f9cb1bb4801bbfa2f95333ad682%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/6.jpg not downloaded yet
2026-03-27 16:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b8bfd0>
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29/e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F2346288e4cdf47e38604e92f67c33cab%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/3.jpg saved to cache
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066a8d0>
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29/e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F2346288e4cdf47e38604e92f67c33cab%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/4.jpg saved to cache
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F612e9f9cb1bb4801bbfa2f95333ad682%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/7.jpg not downloaded yet
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590695790>
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29/e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F2346288e4cdf47e38604e92f67c33cab%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/5.jpg saved to cache
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29
2026-03-27 16:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F612e9f9cb1bb4801bbfa2f95333ad682%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/8.jpg not downloaded yet
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051d650>
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29/e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F2346288e4cdf47e38604e92f67c33cab%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/7.jpg saved to cache
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ad7a50>
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29/e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F2346288e4cdf47e38604e92f67c33cab%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/6.jpg saved to cache
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29
2026-03-27 16:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:38 [ayvens.fr] INFO: Found listing with ID: 1988253
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988253%27 HTTP/1.1" 200 None
2026-03-27 16:46:38 [ayvens.fr] INFO: Scrape type for 1988253: 1
2026-03-27 16:46:38 [ayvens.fr] INFO: Extracting data for car ID: 1988253
2026-03-27 16:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daebfa27-e3d9-5f92-b902-03a1545f6427 with identifier: 1988253
2026-03-27 16:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daebfa27-e3d9-5f92-b902-03a1545f6427 with scrape type 1
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item daebfa27-e3d9-5f92-b902-03a1545f6427
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252Fa70ba15507bc4182a9e050fcef2d3095%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/1.jpg not downloaded yet
2026-03-27 16:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252Fa70ba15507bc4182a9e050fcef2d3095%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/2.jpg not downloaded yet
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59067d590>
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cc69d3-971f-531c-9e85-f9b9801988c0/13cc69d3-971f-531c-9e85-f9b9801988c0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F612e9f9cb1bb4801bbfa2f95333ad682%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/1.jpg saved to cache
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13cc69d3-971f-531c-9e85-f9b9801988c0
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ddb8d0>
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29/e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F2346288e4cdf47e38604e92f67c33cab%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/8.jpg saved to cache
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29
2026-03-27 16:46:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29, skipping ID generation
2026-03-27 16:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29 with scrape type 1
2026-03-27 16:46:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29 sending to next pipeline
2026-03-27 16:46:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29, identifier: 1988251
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59064fb10>
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cc69d3-971f-531c-9e85-f9b9801988c0/13cc69d3-971f-531c-9e85-f9b9801988c0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F612e9f9cb1bb4801bbfa2f95333ad682%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/2.jpg saved to cache
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13cc69d3-971f-531c-9e85-f9b9801988c0
2026-03-27 16:46:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29 with identifier: 1988251
2026-03-27 16:46:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29 with identifier: 1988251
2026-03-27 16:46:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29 with identifier: 1988251 to the API
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'GRIS SCHISTE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': 'e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE E-TECH',
'odometer': 85663,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29/e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289161,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29/e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289161,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29/e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309410,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29/e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292925,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29/e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331512,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29/e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284526,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29/e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276333,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29/e910ec73-1aaf-5edd-94d0-d8d7c9e7ce29_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383749,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/2346288e4cdf47e38604e92f67c33cab/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-06',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE E-TECH Megane E-Tech Electric EV60 130ch Evolution '
'ER optimum charge -C',
'transmission': 'automatic',
'trim': 'Megane E-Tech Electric EV60 130ch Evolution ER optimum charge -C',
'vin': None,
'year': 2023}
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988251%27 HTTP/1.1" 200 None
2026-03-27 16:46:39 [ayvens.fr] INFO: Saving data for 1988251: {'created_time': 1774629999.411298, 'last_price_update_time': 1774629999.411309, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988251') HTTP/1.1" 204 0
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252Fa70ba15507bc4182a9e050fcef2d3095%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/3.jpg not downloaded yet
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592c41fd0>
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cc69d3-971f-531c-9e85-f9b9801988c0/13cc69d3-971f-531c-9e85-f9b9801988c0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F612e9f9cb1bb4801bbfa2f95333ad682%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/3.jpg saved to cache
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13cc69d3-971f-531c-9e85-f9b9801988c0
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6c050>
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cc69d3-971f-531c-9e85-f9b9801988c0/13cc69d3-971f-531c-9e85-f9b9801988c0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F612e9f9cb1bb4801bbfa2f95333ad682%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/4.jpg saved to cache
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13cc69d3-971f-531c-9e85-f9b9801988c0
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df75d0>
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cc69d3-971f-531c-9e85-f9b9801988c0/13cc69d3-971f-531c-9e85-f9b9801988c0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F612e9f9cb1bb4801bbfa2f95333ad682%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/5.jpg saved to cache
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13cc69d3-971f-531c-9e85-f9b9801988c0
2026-03-27 16:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252Fa70ba15507bc4182a9e050fcef2d3095%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/4.jpg not downloaded yet
2026-03-27 16:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252Fa70ba15507bc4182a9e050fcef2d3095%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/5.jpg not downloaded yet
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252Fa70ba15507bc4182a9e050fcef2d3095%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/6.jpg not downloaded yet
2026-03-27 16:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252Fa70ba15507bc4182a9e050fcef2d3095%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/7.jpg not downloaded yet
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252Fa70ba15507bc4182a9e050fcef2d3095%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/8.jpg not downloaded yet
2026-03-27 16:46:39 [ayvens.fr] INFO: Found listing with ID: 1988254
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988254%27 HTTP/1.1" 200 None
2026-03-27 16:46:39 [ayvens.fr] INFO: Scrape type for 1988254: 1
2026-03-27 16:46:39 [ayvens.fr] INFO: Extracting data for car ID: 1988254
2026-03-27 16:46:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ded8fecf-160b-5cc6-8cad-1b2fae88a8c9 with identifier: 1988254
2026-03-27 16:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ded8fecf-160b-5cc6-8cad-1b2fae88a8c9 with scrape type 1
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ded8fecf-160b-5cc6-8cad-1b2fae88a8c9
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6c37534932404a0f95c9e26a92f22402%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/1.jpg not downloaded yet
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6c37534932404a0f95c9e26a92f22402%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/2.jpg not downloaded yet
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b36150>
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cc69d3-971f-531c-9e85-f9b9801988c0/13cc69d3-971f-531c-9e85-f9b9801988c0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F612e9f9cb1bb4801bbfa2f95333ad682%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/6.jpg saved to cache
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13cc69d3-971f-531c-9e85-f9b9801988c0
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051d450>
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cc69d3-971f-531c-9e85-f9b9801988c0/13cc69d3-971f-531c-9e85-f9b9801988c0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F612e9f9cb1bb4801bbfa2f95333ad682%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/7.jpg saved to cache
2026-03-27 16:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13cc69d3-971f-531c-9e85-f9b9801988c0
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe2f10>
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cc69d3-971f-531c-9e85-f9b9801988c0/13cc69d3-971f-531c-9e85-f9b9801988c0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F612e9f9cb1bb4801bbfa2f95333ad682%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/8.jpg saved to cache
2026-03-27 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13cc69d3-971f-531c-9e85-f9b9801988c0
2026-03-27 16:46:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13cc69d3-971f-531c-9e85-f9b9801988c0, skipping ID generation
2026-03-27 16:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13cc69d3-971f-531c-9e85-f9b9801988c0 with scrape type 1
2026-03-27 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13cc69d3-971f-531c-9e85-f9b9801988c0 sending to next pipeline
2026-03-27 16:46:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 13cc69d3-971f-531c-9e85-f9b9801988c0, identifier: 1988252
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6c37534932404a0f95c9e26a92f22402%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/3.jpg not downloaded yet
2026-03-27 16:46:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 13cc69d3-971f-531c-9e85-f9b9801988c0 with identifier: 1988252
2026-03-27 16:46:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 13cc69d3-971f-531c-9e85-f9b9801988c0 with identifier: 1988252
2026-03-27 16:46:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 13cc69d3-971f-531c-9e85-f9b9801988c0 with identifier: 1988252 to the API
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 128,
'color': 'GRIS CASSIOP',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '13cc69d3-971f-531c-9e85-f9b9801988c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 95261,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cc69d3-971f-531c-9e85-f9b9801988c0/13cc69d3-971f-531c-9e85-f9b9801988c0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358931,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cc69d3-971f-531c-9e85-f9b9801988c0/13cc69d3-971f-531c-9e85-f9b9801988c0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358931,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cc69d3-971f-531c-9e85-f9b9801988c0/13cc69d3-971f-531c-9e85-f9b9801988c0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414708,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cc69d3-971f-531c-9e85-f9b9801988c0/13cc69d3-971f-531c-9e85-f9b9801988c0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365535,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cc69d3-971f-531c-9e85-f9b9801988c0/13cc69d3-971f-531c-9e85-f9b9801988c0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260732,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cc69d3-971f-531c-9e85-f9b9801988c0/13cc69d3-971f-531c-9e85-f9b9801988c0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376428,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cc69d3-971f-531c-9e85-f9b9801988c0/13cc69d3-971f-531c-9e85-f9b9801988c0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298322,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cc69d3-971f-531c-9e85-f9b9801988c0/13cc69d3-971f-531c-9e85-f9b9801988c0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325328,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/612e9f9cb1bb4801bbfa2f95333ad682/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-15',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CAPTUR Captur 1.3 TCe 130ch FAP Intens',
'transmission': 'manual',
'trim': 'Captur 1.3 TCe 130ch FAP Intens',
'vin': None,
'year': 2019}
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988252%27 HTTP/1.1" 200 None
2026-03-27 16:46:40 [ayvens.fr] INFO: Saving data for 1988252: {'created_time': 1774630000.483965, 'last_price_update_time': 1774630000.483977, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988252') HTTP/1.1" 204 0
2026-03-27 16:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6c37534932404a0f95c9e26a92f22402%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/4.jpg not downloaded yet
2026-03-27 16:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590590a10>
2026-03-27 16:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daebfa27-e3d9-5f92-b902-03a1545f6427/daebfa27-e3d9-5f92-b902-03a1545f6427_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252Fa70ba15507bc4182a9e050fcef2d3095%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/1.jpg saved to cache
2026-03-27 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item daebfa27-e3d9-5f92-b902-03a1545f6427
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6c37534932404a0f95c9e26a92f22402%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/5.jpg not downloaded yet
2026-03-27 16:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6c37534932404a0f95c9e26a92f22402%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/6.jpg not downloaded yet
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6c37534932404a0f95c9e26a92f22402%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/7.jpg not downloaded yet
2026-03-27 16:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591112250>
2026-03-27 16:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daebfa27-e3d9-5f92-b902-03a1545f6427/daebfa27-e3d9-5f92-b902-03a1545f6427_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252Fa70ba15507bc4182a9e050fcef2d3095%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/3.jpg saved to cache
2026-03-27 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item daebfa27-e3d9-5f92-b902-03a1545f6427
2026-03-27 16:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fab210>
2026-03-27 16:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daebfa27-e3d9-5f92-b902-03a1545f6427/daebfa27-e3d9-5f92-b902-03a1545f6427_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252Fa70ba15507bc4182a9e050fcef2d3095%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/4.jpg saved to cache
2026-03-27 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item daebfa27-e3d9-5f92-b902-03a1545f6427
2026-03-27 16:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6d010>
2026-03-27 16:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daebfa27-e3d9-5f92-b902-03a1545f6427/daebfa27-e3d9-5f92-b902-03a1545f6427_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252Fa70ba15507bc4182a9e050fcef2d3095%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/2.jpg saved to cache
2026-03-27 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item daebfa27-e3d9-5f92-b902-03a1545f6427
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6c37534932404a0f95c9e26a92f22402%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/8.jpg not downloaded yet
2026-03-27 16:46:40 [ayvens.fr] INFO: Found listing with ID: 1988255
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988255%27 HTTP/1.1" 200 None
2026-03-27 16:46:40 [ayvens.fr] INFO: Scrape type for 1988255: 1
2026-03-27 16:46:40 [ayvens.fr] INFO: Extracting data for car ID: 1988255
2026-03-27 16:46:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc07c2d8-a356-51c8-a110-096382c5aa21 with identifier: 1988255
2026-03-27 16:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc07c2d8-a356-51c8-a110-096382c5aa21 with scrape type 1
2026-03-27 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item dc07c2d8-a356-51c8-a110-096382c5aa21
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F6cc4cc50eb3c43bc82df68db05493ed0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/1.jpg not downloaded yet
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b04450>
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daebfa27-e3d9-5f92-b902-03a1545f6427/daebfa27-e3d9-5f92-b902-03a1545f6427_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252Fa70ba15507bc4182a9e050fcef2d3095%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/5.jpg saved to cache
2026-03-27 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item daebfa27-e3d9-5f92-b902-03a1545f6427
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590511090>
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daebfa27-e3d9-5f92-b902-03a1545f6427/daebfa27-e3d9-5f92-b902-03a1545f6427_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252Fa70ba15507bc4182a9e050fcef2d3095%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/6.jpg saved to cache
2026-03-27 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item daebfa27-e3d9-5f92-b902-03a1545f6427
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe2e10>
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daebfa27-e3d9-5f92-b902-03a1545f6427/daebfa27-e3d9-5f92-b902-03a1545f6427_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252Fa70ba15507bc4182a9e050fcef2d3095%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/8.jpg saved to cache
2026-03-27 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item daebfa27-e3d9-5f92-b902-03a1545f6427
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b66450>
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daebfa27-e3d9-5f92-b902-03a1545f6427/daebfa27-e3d9-5f92-b902-03a1545f6427_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffa-%252Fa70ba15507bc4182a9e050fcef2d3095%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/7.jpg saved to cache
2026-03-27 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item daebfa27-e3d9-5f92-b902-03a1545f6427
2026-03-27 16:46:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: daebfa27-e3d9-5f92-b902-03a1545f6427, skipping ID generation
2026-03-27 16:46:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daebfa27-e3d9-5f92-b902-03a1545f6427 with scrape type 1
2026-03-27 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item daebfa27-e3d9-5f92-b902-03a1545f6427 sending to next pipeline
2026-03-27 16:46:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: daebfa27-e3d9-5f92-b902-03a1545f6427, identifier: 1988253
2026-03-27 16:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F6cc4cc50eb3c43bc82df68db05493ed0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/2.jpg not downloaded yet
2026-03-27 16:46:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: daebfa27-e3d9-5f92-b902-03a1545f6427 with identifier: 1988253
2026-03-27 16:46:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: daebfa27-e3d9-5f92-b902-03a1545f6427 with identifier: 1988253
2026-03-27 16:46:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: daebfa27-e3d9-5f92-b902-03a1545f6427 with identifier: 1988253 to the API
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 135,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'daebfa27-e3d9-5f92-b902-03a1545f6427',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'C-HR',
'odometer': 88608,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daebfa27-e3d9-5f92-b902-03a1545f6427/daebfa27-e3d9-5f92-b902-03a1545f6427_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296528,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daebfa27-e3d9-5f92-b902-03a1545f6427/daebfa27-e3d9-5f92-b902-03a1545f6427_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296528,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daebfa27-e3d9-5f92-b902-03a1545f6427/daebfa27-e3d9-5f92-b902-03a1545f6427_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346386,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daebfa27-e3d9-5f92-b902-03a1545f6427/daebfa27-e3d9-5f92-b902-03a1545f6427_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324273,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daebfa27-e3d9-5f92-b902-03a1545f6427/daebfa27-e3d9-5f92-b902-03a1545f6427_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374638,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daebfa27-e3d9-5f92-b902-03a1545f6427/daebfa27-e3d9-5f92-b902-03a1545f6427_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317416,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daebfa27-e3d9-5f92-b902-03a1545f6427/daebfa27-e3d9-5f92-b902-03a1545f6427_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333668,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daebfa27-e3d9-5f92-b902-03a1545f6427/daebfa27-e3d9-5f92-b902-03a1545f6427_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328257,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fa-/a70ba15507bc4182a9e050fcef2d3095/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-22',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA C-HR C-HR 1.2 Turbo 116ch Dynamic Business 2WD',
'transmission': 'manual',
'trim': 'C-HR 1.2 Turbo 116ch Dynamic Business 2WD',
'vin': None,
'year': 2018}
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988253%27 HTTP/1.1" 200 None
2026-03-27 16:46:41 [ayvens.fr] INFO: Saving data for 1988253: {'created_time': 1774630001.737644, 'last_price_update_time': 1774630001.737656, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988253') HTTP/1.1" 204 0
2026-03-27 16:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F6cc4cc50eb3c43bc82df68db05493ed0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/3.jpg not downloaded yet
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59285ae90>
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ded8fecf-160b-5cc6-8cad-1b2fae88a8c9/ded8fecf-160b-5cc6-8cad-1b2fae88a8c9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6c37534932404a0f95c9e26a92f22402%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/1.jpg saved to cache
2026-03-27 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ded8fecf-160b-5cc6-8cad-1b2fae88a8c9
2026-03-27 16:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F6cc4cc50eb3c43bc82df68db05493ed0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/4.jpg not downloaded yet
2026-03-27 16:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F6cc4cc50eb3c43bc82df68db05493ed0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/5.jpg not downloaded yet
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591050ad0>
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ded8fecf-160b-5cc6-8cad-1b2fae88a8c9/ded8fecf-160b-5cc6-8cad-1b2fae88a8c9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6c37534932404a0f95c9e26a92f22402%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/2.jpg saved to cache
2026-03-27 16:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ded8fecf-160b-5cc6-8cad-1b2fae88a8c9
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903cfed0>
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ded8fecf-160b-5cc6-8cad-1b2fae88a8c9/ded8fecf-160b-5cc6-8cad-1b2fae88a8c9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6c37534932404a0f95c9e26a92f22402%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/4.jpg saved to cache
2026-03-27 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ded8fecf-160b-5cc6-8cad-1b2fae88a8c9
2026-03-27 16:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590668fd0>
2026-03-27 16:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ded8fecf-160b-5cc6-8cad-1b2fae88a8c9/ded8fecf-160b-5cc6-8cad-1b2fae88a8c9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6c37534932404a0f95c9e26a92f22402%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/5.jpg saved to cache
2026-03-27 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ded8fecf-160b-5cc6-8cad-1b2fae88a8c9
2026-03-27 16:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591003c50>
2026-03-27 16:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ded8fecf-160b-5cc6-8cad-1b2fae88a8c9/ded8fecf-160b-5cc6-8cad-1b2fae88a8c9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6c37534932404a0f95c9e26a92f22402%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/3.jpg saved to cache
2026-03-27 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ded8fecf-160b-5cc6-8cad-1b2fae88a8c9
2026-03-27 16:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F6cc4cc50eb3c43bc82df68db05493ed0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/6.jpg not downloaded yet
2026-03-27 16:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065e610>
2026-03-27 16:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ded8fecf-160b-5cc6-8cad-1b2fae88a8c9/ded8fecf-160b-5cc6-8cad-1b2fae88a8c9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6c37534932404a0f95c9e26a92f22402%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/6.jpg saved to cache
2026-03-27 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ded8fecf-160b-5cc6-8cad-1b2fae88a8c9
2026-03-27 16:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590657b10>
2026-03-27 16:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ded8fecf-160b-5cc6-8cad-1b2fae88a8c9/ded8fecf-160b-5cc6-8cad-1b2fae88a8c9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6c37534932404a0f95c9e26a92f22402%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/7.jpg saved to cache
2026-03-27 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ded8fecf-160b-5cc6-8cad-1b2fae88a8c9
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F6cc4cc50eb3c43bc82df68db05493ed0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/7.jpg not downloaded yet
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F6cc4cc50eb3c43bc82df68db05493ed0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/8.jpg not downloaded yet
2026-03-27 16:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590656a90>
2026-03-27 16:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ded8fecf-160b-5cc6-8cad-1b2fae88a8c9/ded8fecf-160b-5cc6-8cad-1b2fae88a8c9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6c37534932404a0f95c9e26a92f22402%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/8.jpg saved to cache
2026-03-27 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ded8fecf-160b-5cc6-8cad-1b2fae88a8c9
2026-03-27 16:46:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ded8fecf-160b-5cc6-8cad-1b2fae88a8c9, skipping ID generation
2026-03-27 16:46:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ded8fecf-160b-5cc6-8cad-1b2fae88a8c9 with scrape type 1
2026-03-27 16:46:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ded8fecf-160b-5cc6-8cad-1b2fae88a8c9 sending to next pipeline
2026-03-27 16:46:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ded8fecf-160b-5cc6-8cad-1b2fae88a8c9, identifier: 1988254
2026-03-27 16:46:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ded8fecf-160b-5cc6-8cad-1b2fae88a8c9 with identifier: 1988254
2026-03-27 16:46:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ded8fecf-160b-5cc6-8cad-1b2fae88a8c9 with identifier: 1988254
2026-03-27 16:46:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ded8fecf-160b-5cc6-8cad-1b2fae88a8c9 with identifier: 1988254 to the API
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'GRIS SOLAR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'ded8fecf-160b-5cc6-8cad-1b2fae88a8c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'KUGA',
'odometer': 91558,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ded8fecf-160b-5cc6-8cad-1b2fae88a8c9/ded8fecf-160b-5cc6-8cad-1b2fae88a8c9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306936,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ded8fecf-160b-5cc6-8cad-1b2fae88a8c9/ded8fecf-160b-5cc6-8cad-1b2fae88a8c9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306936,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ded8fecf-160b-5cc6-8cad-1b2fae88a8c9/ded8fecf-160b-5cc6-8cad-1b2fae88a8c9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327467,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ded8fecf-160b-5cc6-8cad-1b2fae88a8c9/ded8fecf-160b-5cc6-8cad-1b2fae88a8c9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310013,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ded8fecf-160b-5cc6-8cad-1b2fae88a8c9/ded8fecf-160b-5cc6-8cad-1b2fae88a8c9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307159,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ded8fecf-160b-5cc6-8cad-1b2fae88a8c9/ded8fecf-160b-5cc6-8cad-1b2fae88a8c9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305084,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ded8fecf-160b-5cc6-8cad-1b2fae88a8c9/ded8fecf-160b-5cc6-8cad-1b2fae88a8c9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341315,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ded8fecf-160b-5cc6-8cad-1b2fae88a8c9/ded8fecf-160b-5cc6-8cad-1b2fae88a8c9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304660,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6c37534932404a0f95c9e26a92f22402/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-13',
'seats_number': 5,
'seller_name': None,
'title': 'FORD KUGA Kuga 2.5 Duratec 190ch FHEV Titanium BVA i-AWD',
'transmission': 'automatic',
'trim': 'Kuga 2.5 Duratec 190ch FHEV Titanium BVA i-AWD',
'vin': None,
'year': 2022}
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988254%27 HTTP/1.1" 200 None
2026-03-27 16:46:43 [ayvens.fr] INFO: Saving data for 1988254: {'created_time': 1774630003.031342, 'last_price_update_time': 1774630003.031359, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988254') HTTP/1.1" 204 0
2026-03-27 16:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:43 [ayvens.fr] INFO: Found listing with ID: 1988256
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988256%27 HTTP/1.1" 200 None
2026-03-27 16:46:43 [ayvens.fr] INFO: Scrape type for 1988256: 1
2026-03-27 16:46:43 [ayvens.fr] INFO: Extracting data for car ID: 1988256
2026-03-27 16:46:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24834c0c-02b7-5386-876f-68a9cf9d8cf7 with identifier: 1988256
2026-03-27 16:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24834c0c-02b7-5386-876f-68a9cf9d8cf7 with scrape type 1
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 24834c0c-02b7-5386-876f-68a9cf9d8cf7
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7cb3689c16184b328287c76ecade36aa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/1.jpg not downloaded yet
2026-03-27 16:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7cb3689c16184b328287c76ecade36aa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/2.jpg not downloaded yet
2026-03-27 16:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7cb3689c16184b328287c76ecade36aa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/3.jpg not downloaded yet
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7cb3689c16184b328287c76ecade36aa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/4.jpg not downloaded yet
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7cb3689c16184b328287c76ecade36aa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/5.jpg not downloaded yet
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f80e90>
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc07c2d8-a356-51c8-a110-096382c5aa21/dc07c2d8-a356-51c8-a110-096382c5aa21_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F6cc4cc50eb3c43bc82df68db05493ed0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/1.jpg saved to cache
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc07c2d8-a356-51c8-a110-096382c5aa21
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ab8450>
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc07c2d8-a356-51c8-a110-096382c5aa21/dc07c2d8-a356-51c8-a110-096382c5aa21_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F6cc4cc50eb3c43bc82df68db05493ed0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/2.jpg saved to cache
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc07c2d8-a356-51c8-a110-096382c5aa21
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051e110>
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc07c2d8-a356-51c8-a110-096382c5aa21/dc07c2d8-a356-51c8-a110-096382c5aa21_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F6cc4cc50eb3c43bc82df68db05493ed0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/3.jpg saved to cache
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc07c2d8-a356-51c8-a110-096382c5aa21
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7cb3689c16184b328287c76ecade36aa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/6.jpg not downloaded yet
2026-03-27 16:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7cb3689c16184b328287c76ecade36aa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/7.jpg not downloaded yet
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ab8cd0>
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc07c2d8-a356-51c8-a110-096382c5aa21/dc07c2d8-a356-51c8-a110-096382c5aa21_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F6cc4cc50eb3c43bc82df68db05493ed0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/4.jpg saved to cache
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc07c2d8-a356-51c8-a110-096382c5aa21
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051fed0>
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc07c2d8-a356-51c8-a110-096382c5aa21/dc07c2d8-a356-51c8-a110-096382c5aa21_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F6cc4cc50eb3c43bc82df68db05493ed0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/6.jpg saved to cache
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc07c2d8-a356-51c8-a110-096382c5aa21
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065ec50>
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc07c2d8-a356-51c8-a110-096382c5aa21/dc07c2d8-a356-51c8-a110-096382c5aa21_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F6cc4cc50eb3c43bc82df68db05493ed0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/5.jpg saved to cache
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc07c2d8-a356-51c8-a110-096382c5aa21
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7cb3689c16184b328287c76ecade36aa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/8.jpg not downloaded yet
2026-03-27 16:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae1290>
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc07c2d8-a356-51c8-a110-096382c5aa21/dc07c2d8-a356-51c8-a110-096382c5aa21_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F6cc4cc50eb3c43bc82df68db05493ed0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/7.jpg saved to cache
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc07c2d8-a356-51c8-a110-096382c5aa21
2026-03-27 16:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:43 [ayvens.fr] INFO: Found listing with ID: 1988257
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988257%27 HTTP/1.1" 200 None
2026-03-27 16:46:43 [ayvens.fr] INFO: Scrape type for 1988257: 1
2026-03-27 16:46:43 [ayvens.fr] INFO: Extracting data for car ID: 1988257
2026-03-27 16:46:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95370895-83bd-5e66-995c-3e015a0f89a1 with identifier: 1988257
2026-03-27 16:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95370895-83bd-5e66-995c-3e015a0f89a1 with scrape type 1
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 95370895-83bd-5e66-995c-3e015a0f89a1
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8cf0dd4ad53542ec80d15455bac9b6b3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/1.jpg not downloaded yet
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8cf0dd4ad53542ec80d15455bac9b6b3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/2.jpg not downloaded yet
2026-03-27 16:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8cf0dd4ad53542ec80d15455bac9b6b3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/3.jpg not downloaded yet
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa1150>
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24834c0c-02b7-5386-876f-68a9cf9d8cf7/24834c0c-02b7-5386-876f-68a9cf9d8cf7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7cb3689c16184b328287c76ecade36aa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/1.jpg saved to cache
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24834c0c-02b7-5386-876f-68a9cf9d8cf7
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591111210>
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24834c0c-02b7-5386-876f-68a9cf9d8cf7/24834c0c-02b7-5386-876f-68a9cf9d8cf7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7cb3689c16184b328287c76ecade36aa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/2.jpg saved to cache
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24834c0c-02b7-5386-876f-68a9cf9d8cf7
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6c650>
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24834c0c-02b7-5386-876f-68a9cf9d8cf7/24834c0c-02b7-5386-876f-68a9cf9d8cf7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7cb3689c16184b328287c76ecade36aa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/3.jpg saved to cache
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24834c0c-02b7-5386-876f-68a9cf9d8cf7
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8cf0dd4ad53542ec80d15455bac9b6b3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/4.jpg not downloaded yet
2026-03-27 16:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8cf0dd4ad53542ec80d15455bac9b6b3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/5.jpg not downloaded yet
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d94110>
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc07c2d8-a356-51c8-a110-096382c5aa21/dc07c2d8-a356-51c8-a110-096382c5aa21_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F6cc4cc50eb3c43bc82df68db05493ed0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/8.jpg saved to cache
2026-03-27 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc07c2d8-a356-51c8-a110-096382c5aa21
2026-03-27 16:46:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc07c2d8-a356-51c8-a110-096382c5aa21, skipping ID generation
2026-03-27 16:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc07c2d8-a356-51c8-a110-096382c5aa21 with scrape type 1
2026-03-27 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc07c2d8-a356-51c8-a110-096382c5aa21 sending to next pipeline
2026-03-27 16:46:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: dc07c2d8-a356-51c8-a110-096382c5aa21, identifier: 1988255
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906952d0>
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24834c0c-02b7-5386-876f-68a9cf9d8cf7/24834c0c-02b7-5386-876f-68a9cf9d8cf7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7cb3689c16184b328287c76ecade36aa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/4.jpg saved to cache
2026-03-27 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24834c0c-02b7-5386-876f-68a9cf9d8cf7
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc7c10>
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24834c0c-02b7-5386-876f-68a9cf9d8cf7/24834c0c-02b7-5386-876f-68a9cf9d8cf7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7cb3689c16184b328287c76ecade36aa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/5.jpg saved to cache
2026-03-27 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24834c0c-02b7-5386-876f-68a9cf9d8cf7
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8cf0dd4ad53542ec80d15455bac9b6b3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/6.jpg not downloaded yet
2026-03-27 16:46:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: dc07c2d8-a356-51c8-a110-096382c5aa21 with identifier: 1988255
2026-03-27 16:46:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: dc07c2d8-a356-51c8-a110-096382c5aa21 with identifier: 1988255
2026-03-27 16:46:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: dc07c2d8-a356-51c8-a110-096382c5aa21 with identifier: 1988255 to the API
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'GRIS NUIT',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': 'dc07c2d8-a356-51c8-a110-096382c5aa21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'MODEL 3',
'odometer': 54278,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc07c2d8-a356-51c8-a110-096382c5aa21/dc07c2d8-a356-51c8-a110-096382c5aa21_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421567,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc07c2d8-a356-51c8-a110-096382c5aa21/dc07c2d8-a356-51c8-a110-096382c5aa21_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421567,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc07c2d8-a356-51c8-a110-096382c5aa21/dc07c2d8-a356-51c8-a110-096382c5aa21_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421743,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc07c2d8-a356-51c8-a110-096382c5aa21/dc07c2d8-a356-51c8-a110-096382c5aa21_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359731,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc07c2d8-a356-51c8-a110-096382c5aa21/dc07c2d8-a356-51c8-a110-096382c5aa21_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 270905,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc07c2d8-a356-51c8-a110-096382c5aa21/dc07c2d8-a356-51c8-a110-096382c5aa21_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302536,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc07c2d8-a356-51c8-a110-096382c5aa21/dc07c2d8-a356-51c8-a110-096382c5aa21_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215009,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc07c2d8-a356-51c8-a110-096382c5aa21/dc07c2d8-a356-51c8-a110-096382c5aa21_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173717,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/6cc4cc50eb3c43bc82df68db05493ed0/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA MODEL 3 Model 3 Standard RWD Plus',
'transmission': 'automatic',
'trim': 'Model 3 Standard RWD Plus',
'vin': None,
'year': 2021}
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988255%27 HTTP/1.1" 200 None
2026-03-27 16:46:44 [ayvens.fr] INFO: Saving data for 1988255: {'created_time': 1774630004.65626, 'last_price_update_time': 1774630004.656272, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988255') HTTP/1.1" 204 0
2026-03-27 16:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8cf0dd4ad53542ec80d15455bac9b6b3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/7.jpg not downloaded yet
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae1490>
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24834c0c-02b7-5386-876f-68a9cf9d8cf7/24834c0c-02b7-5386-876f-68a9cf9d8cf7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7cb3689c16184b328287c76ecade36aa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/6.jpg saved to cache
2026-03-27 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 24834c0c-02b7-5386-876f-68a9cf9d8cf7
2026-03-27 16:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8cf0dd4ad53542ec80d15455bac9b6b3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/8.jpg not downloaded yet
2026-03-27 16:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:44 [ayvens.fr] INFO: Found listing with ID: 1988258
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988258%27 HTTP/1.1" 200 None
2026-03-27 16:46:44 [ayvens.fr] INFO: Scrape type for 1988258: 1
2026-03-27 16:46:44 [ayvens.fr] INFO: Extracting data for car ID: 1988258
2026-03-27 16:46:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20bfb532-2576-548a-be44-92dbb3ec9070 with identifier: 1988258
2026-03-27 16:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20bfb532-2576-548a-be44-92dbb3ec9070 with scrape type 1
2026-03-27 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 20bfb532-2576-548a-be44-92dbb3ec9070
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fev-%252F27633e719f4247f4b988e86e3e830069%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/1.jpg not downloaded yet
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903ccc50>
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24834c0c-02b7-5386-876f-68a9cf9d8cf7/24834c0c-02b7-5386-876f-68a9cf9d8cf7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7cb3689c16184b328287c76ecade36aa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/8.jpg saved to cache
2026-03-27 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24834c0c-02b7-5386-876f-68a9cf9d8cf7
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904fe2d0>
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24834c0c-02b7-5386-876f-68a9cf9d8cf7/24834c0c-02b7-5386-876f-68a9cf9d8cf7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7cb3689c16184b328287c76ecade36aa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/7.jpg saved to cache
2026-03-27 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24834c0c-02b7-5386-876f-68a9cf9d8cf7
2026-03-27 16:46:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24834c0c-02b7-5386-876f-68a9cf9d8cf7, skipping ID generation
2026-03-27 16:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24834c0c-02b7-5386-876f-68a9cf9d8cf7 with scrape type 1
2026-03-27 16:46:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24834c0c-02b7-5386-876f-68a9cf9d8cf7 sending to next pipeline
2026-03-27 16:46:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 24834c0c-02b7-5386-876f-68a9cf9d8cf7, identifier: 1988256
2026-03-27 16:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fev-%252F27633e719f4247f4b988e86e3e830069%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/2.jpg not downloaded yet
2026-03-27 16:46:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 24834c0c-02b7-5386-876f-68a9cf9d8cf7 with identifier: 1988256
2026-03-27 16:46:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 24834c0c-02b7-5386-876f-68a9cf9d8cf7 with identifier: 1988256
2026-03-27 16:46:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 24834c0c-02b7-5386-876f-68a9cf9d8cf7 with identifier: 1988256 to the API
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 49,
'color': 'GRIS S',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '24834c0c-02b7-5386-876f-68a9cf9d8cf7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'GLC',
'odometer': 65946,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24834c0c-02b7-5386-876f-68a9cf9d8cf7/24834c0c-02b7-5386-876f-68a9cf9d8cf7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301903,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24834c0c-02b7-5386-876f-68a9cf9d8cf7/24834c0c-02b7-5386-876f-68a9cf9d8cf7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301903,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24834c0c-02b7-5386-876f-68a9cf9d8cf7/24834c0c-02b7-5386-876f-68a9cf9d8cf7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322092,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24834c0c-02b7-5386-876f-68a9cf9d8cf7/24834c0c-02b7-5386-876f-68a9cf9d8cf7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329225,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24834c0c-02b7-5386-876f-68a9cf9d8cf7/24834c0c-02b7-5386-876f-68a9cf9d8cf7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389336,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24834c0c-02b7-5386-876f-68a9cf9d8cf7/24834c0c-02b7-5386-876f-68a9cf9d8cf7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329071,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24834c0c-02b7-5386-876f-68a9cf9d8cf7/24834c0c-02b7-5386-876f-68a9cf9d8cf7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333504,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24834c0c-02b7-5386-876f-68a9cf9d8cf7/24834c0c-02b7-5386-876f-68a9cf9d8cf7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342958,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/7cb3689c16184b328287c76ecade36aa/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-10',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ GLC GLC 300 e 211+122ch Avantgarde Line 4Matic '
'9G-Tronic',
'transmission': 'automatic',
'trim': 'GLC 300 e 211+122ch Avantgarde Line 4Matic 9G-Tronic',
'vin': None,
'year': 2020}
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988256%27 HTTP/1.1" 200 None
2026-03-27 16:46:45 [ayvens.fr] INFO: Saving data for 1988256: {'created_time': 1774630005.556745, 'last_price_update_time': 1774630005.556759, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988256') HTTP/1.1" 204 0
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fev-%252F27633e719f4247f4b988e86e3e830069%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/3.jpg not downloaded yet
2026-03-27 16:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc64d0>
2026-03-27 16:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95370895-83bd-5e66-995c-3e015a0f89a1/95370895-83bd-5e66-995c-3e015a0f89a1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8cf0dd4ad53542ec80d15455bac9b6b3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/1.jpg saved to cache
2026-03-27 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95370895-83bd-5e66-995c-3e015a0f89a1
2026-03-27 16:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5914318d0>
2026-03-27 16:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95370895-83bd-5e66-995c-3e015a0f89a1/95370895-83bd-5e66-995c-3e015a0f89a1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8cf0dd4ad53542ec80d15455bac9b6b3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/3.jpg saved to cache
2026-03-27 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95370895-83bd-5e66-995c-3e015a0f89a1
2026-03-27 16:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b0550>
2026-03-27 16:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95370895-83bd-5e66-995c-3e015a0f89a1/95370895-83bd-5e66-995c-3e015a0f89a1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8cf0dd4ad53542ec80d15455bac9b6b3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/2.jpg saved to cache
2026-03-27 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95370895-83bd-5e66-995c-3e015a0f89a1
2026-03-27 16:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fev-%252F27633e719f4247f4b988e86e3e830069%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/4.jpg not downloaded yet
2026-03-27 16:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fev-%252F27633e719f4247f4b988e86e3e830069%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/5.jpg not downloaded yet
2026-03-27 16:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fev-%252F27633e719f4247f4b988e86e3e830069%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/6.jpg not downloaded yet
2026-03-27 16:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fev-%252F27633e719f4247f4b988e86e3e830069%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/7.jpg not downloaded yet
2026-03-27 16:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065db10>
2026-03-27 16:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95370895-83bd-5e66-995c-3e015a0f89a1/95370895-83bd-5e66-995c-3e015a0f89a1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8cf0dd4ad53542ec80d15455bac9b6b3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/5.jpg saved to cache
2026-03-27 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95370895-83bd-5e66-995c-3e015a0f89a1
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fev-%252F27633e719f4247f4b988e86e3e830069%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/8.jpg not downloaded yet
2026-03-27 16:46:45 [ayvens.fr] INFO: Found listing with ID: 1988259
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988259%27 HTTP/1.1" 200 None
2026-03-27 16:46:45 [ayvens.fr] INFO: Scrape type for 1988259: 1
2026-03-27 16:46:45 [ayvens.fr] INFO: Extracting data for car ID: 1988259
2026-03-27 16:46:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9606dbb-795d-5250-9965-824f9a58b058 with identifier: 1988259
2026-03-27 16:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9606dbb-795d-5250-9965-824f9a58b058 with scrape type 1
2026-03-27 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e9606dbb-795d-5250-9965-824f9a58b058
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F7ed7fe549d3844d19cd9606eaf3a4a1f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/1.jpg not downloaded yet
2026-03-27 16:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905aa410>
2026-03-27 16:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95370895-83bd-5e66-995c-3e015a0f89a1/95370895-83bd-5e66-995c-3e015a0f89a1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8cf0dd4ad53542ec80d15455bac9b6b3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/4.jpg saved to cache
2026-03-27 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95370895-83bd-5e66-995c-3e015a0f89a1
2026-03-27 16:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b1b590>
2026-03-27 16:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95370895-83bd-5e66-995c-3e015a0f89a1/95370895-83bd-5e66-995c-3e015a0f89a1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8cf0dd4ad53542ec80d15455bac9b6b3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/6.jpg saved to cache
2026-03-27 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95370895-83bd-5e66-995c-3e015a0f89a1
2026-03-27 16:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe18d0>
2026-03-27 16:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95370895-83bd-5e66-995c-3e015a0f89a1/95370895-83bd-5e66-995c-3e015a0f89a1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8cf0dd4ad53542ec80d15455bac9b6b3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/7.jpg saved to cache
2026-03-27 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95370895-83bd-5e66-995c-3e015a0f89a1
2026-03-27 16:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591053050>
2026-03-27 16:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20bfb532-2576-548a-be44-92dbb3ec9070/20bfb532-2576-548a-be44-92dbb3ec9070_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fev-%252F27633e719f4247f4b988e86e3e830069%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/1.jpg saved to cache
2026-03-27 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20bfb532-2576-548a-be44-92dbb3ec9070
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F7ed7fe549d3844d19cd9606eaf3a4a1f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/2.jpg not downloaded yet
2026-03-27 16:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59067e990>
2026-03-27 16:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95370895-83bd-5e66-995c-3e015a0f89a1/95370895-83bd-5e66-995c-3e015a0f89a1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8cf0dd4ad53542ec80d15455bac9b6b3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/8.jpg saved to cache
2026-03-27 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95370895-83bd-5e66-995c-3e015a0f89a1
2026-03-27 16:46:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95370895-83bd-5e66-995c-3e015a0f89a1, skipping ID generation
2026-03-27 16:46:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95370895-83bd-5e66-995c-3e015a0f89a1 with scrape type 1
2026-03-27 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95370895-83bd-5e66-995c-3e015a0f89a1 sending to next pipeline
2026-03-27 16:46:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 95370895-83bd-5e66-995c-3e015a0f89a1, identifier: 1988257
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F7ed7fe549d3844d19cd9606eaf3a4a1f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/3.jpg not downloaded yet
2026-03-27 16:46:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 95370895-83bd-5e66-995c-3e015a0f89a1 with identifier: 1988257
2026-03-27 16:46:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 95370895-83bd-5e66-995c-3e015a0f89a1 with identifier: 1988257
2026-03-27 16:46:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 95370895-83bd-5e66-995c-3e015a0f89a1 with identifier: 1988257 to the API
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '95370895-83bd-5e66-995c-3e015a0f89a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'E-208',
'odometer': 67843,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95370895-83bd-5e66-995c-3e015a0f89a1/95370895-83bd-5e66-995c-3e015a0f89a1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 489409,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95370895-83bd-5e66-995c-3e015a0f89a1/95370895-83bd-5e66-995c-3e015a0f89a1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 489409,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95370895-83bd-5e66-995c-3e015a0f89a1/95370895-83bd-5e66-995c-3e015a0f89a1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381878,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95370895-83bd-5e66-995c-3e015a0f89a1/95370895-83bd-5e66-995c-3e015a0f89a1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302532,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95370895-83bd-5e66-995c-3e015a0f89a1/95370895-83bd-5e66-995c-3e015a0f89a1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352888,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95370895-83bd-5e66-995c-3e015a0f89a1/95370895-83bd-5e66-995c-3e015a0f89a1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287674,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95370895-83bd-5e66-995c-3e015a0f89a1/95370895-83bd-5e66-995c-3e015a0f89a1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293604,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95370895-83bd-5e66-995c-3e015a0f89a1/95370895-83bd-5e66-995c-3e015a0f89a1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393070,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/8cf0dd4ad53542ec80d15455bac9b6b3/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-23',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT E-208 208 e-208 136ch Active Pack',
'transmission': 'automatic',
'trim': '208 e-208 136ch Active Pack',
'vin': None,
'year': 2023}
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988257%27 HTTP/1.1" 200 None
2026-03-27 16:46:46 [ayvens.fr] INFO: Saving data for 1988257: {'created_time': 1774630006.965734, 'last_price_update_time': 1774630006.965746, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988257') HTTP/1.1" 204 0
2026-03-27 16:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F7ed7fe549d3844d19cd9606eaf3a4a1f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/4.jpg not downloaded yet
2026-03-27 16:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F7ed7fe549d3844d19cd9606eaf3a4a1f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/5.jpg not downloaded yet
2026-03-27 16:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F7ed7fe549d3844d19cd9606eaf3a4a1f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/6.jpg not downloaded yet
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F7ed7fe549d3844d19cd9606eaf3a4a1f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/7.jpg not downloaded yet
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F7ed7fe549d3844d19cd9606eaf3a4a1f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/8.jpg not downloaded yet
2026-03-27 16:46:47 [ayvens.fr] INFO: Found listing with ID: 1988260
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988260%27 HTTP/1.1" 200 None
2026-03-27 16:46:47 [ayvens.fr] INFO: Scrape type for 1988260: 1
2026-03-27 16:46:47 [ayvens.fr] INFO: Extracting data for car ID: 1988260
2026-03-27 16:46:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2 with identifier: 1988260
2026-03-27 16:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2 with scrape type 1
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fe36ef54fe98d4278b87906b0bdfdbbb1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/1.jpg not downloaded yet
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fe36ef54fe98d4278b87906b0bdfdbbb1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/2.jpg not downloaded yet
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fe36ef54fe98d4278b87906b0bdfdbbb1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/3.jpg not downloaded yet
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905169d0>
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20bfb532-2576-548a-be44-92dbb3ec9070/20bfb532-2576-548a-be44-92dbb3ec9070_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fev-%252F27633e719f4247f4b988e86e3e830069%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/2.jpg saved to cache
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 20bfb532-2576-548a-be44-92dbb3ec9070
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfded0>
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20bfb532-2576-548a-be44-92dbb3ec9070/20bfb532-2576-548a-be44-92dbb3ec9070_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fev-%252F27633e719f4247f4b988e86e3e830069%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/3.jpg saved to cache
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 20bfb532-2576-548a-be44-92dbb3ec9070
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904d4a90>
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20bfb532-2576-548a-be44-92dbb3ec9070/20bfb532-2576-548a-be44-92dbb3ec9070_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fev-%252F27633e719f4247f4b988e86e3e830069%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/4.jpg saved to cache
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 20bfb532-2576-548a-be44-92dbb3ec9070
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590523710>
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20bfb532-2576-548a-be44-92dbb3ec9070/20bfb532-2576-548a-be44-92dbb3ec9070_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fev-%252F27633e719f4247f4b988e86e3e830069%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/6.jpg saved to cache
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 20bfb532-2576-548a-be44-92dbb3ec9070
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efeb10>
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20bfb532-2576-548a-be44-92dbb3ec9070/20bfb532-2576-548a-be44-92dbb3ec9070_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fev-%252F27633e719f4247f4b988e86e3e830069%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/5.jpg saved to cache
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 20bfb532-2576-548a-be44-92dbb3ec9070
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903ddf10>
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20bfb532-2576-548a-be44-92dbb3ec9070/20bfb532-2576-548a-be44-92dbb3ec9070_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fev-%252F27633e719f4247f4b988e86e3e830069%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/7.jpg saved to cache
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 20bfb532-2576-548a-be44-92dbb3ec9070
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fe36ef54fe98d4278b87906b0bdfdbbb1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/4.jpg not downloaded yet
2026-03-27 16:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4b810>
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20bfb532-2576-548a-be44-92dbb3ec9070/20bfb532-2576-548a-be44-92dbb3ec9070_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fev-%252F27633e719f4247f4b988e86e3e830069%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/8.jpg saved to cache
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 20bfb532-2576-548a-be44-92dbb3ec9070
2026-03-27 16:46:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20bfb532-2576-548a-be44-92dbb3ec9070, skipping ID generation
2026-03-27 16:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20bfb532-2576-548a-be44-92dbb3ec9070 with scrape type 1
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20bfb532-2576-548a-be44-92dbb3ec9070 sending to next pipeline
2026-03-27 16:46:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 20bfb532-2576-548a-be44-92dbb3ec9070, identifier: 1988258
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fe36ef54fe98d4278b87906b0bdfdbbb1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/5.jpg not downloaded yet
2026-03-27 16:46:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 20bfb532-2576-548a-be44-92dbb3ec9070 with identifier: 1988258
2026-03-27 16:46:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 20bfb532-2576-548a-be44-92dbb3ec9070 with identifier: 1988258
2026-03-27 16:46:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 20bfb532-2576-548a-be44-92dbb3ec9070 with identifier: 1988258 to the API
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'BLEU CAVANSITE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '20bfb532-2576-548a-be44-92dbb3ec9070',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'CLASSE A',
'odometer': 74198,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20bfb532-2576-548a-be44-92dbb3ec9070/20bfb532-2576-548a-be44-92dbb3ec9070_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314698,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20bfb532-2576-548a-be44-92dbb3ec9070/20bfb532-2576-548a-be44-92dbb3ec9070_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314698,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20bfb532-2576-548a-be44-92dbb3ec9070/20bfb532-2576-548a-be44-92dbb3ec9070_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348361,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20bfb532-2576-548a-be44-92dbb3ec9070/20bfb532-2576-548a-be44-92dbb3ec9070_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382168,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20bfb532-2576-548a-be44-92dbb3ec9070/20bfb532-2576-548a-be44-92dbb3ec9070_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376359,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20bfb532-2576-548a-be44-92dbb3ec9070/20bfb532-2576-548a-be44-92dbb3ec9070_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316424,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20bfb532-2576-548a-be44-92dbb3ec9070/20bfb532-2576-548a-be44-92dbb3ec9070_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318984,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20bfb532-2576-548a-be44-92dbb3ec9070/20bfb532-2576-548a-be44-92dbb3ec9070_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318165,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ev-/27633e719f4247f4b988e86e3e830069/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-08',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ CLASSE A Classe A 180 136ch Business Line 7G-DCT',
'transmission': 'automatic',
'trim': 'Classe A 180 136ch Business Line 7G-DCT',
'vin': None,
'year': 2018}
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988258%27 HTTP/1.1" 200 None
2026-03-27 16:46:48 [ayvens.fr] INFO: Saving data for 1988258: {'created_time': 1774630008.552598, 'last_price_update_time': 1774630008.55261, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988258') HTTP/1.1" 204 0
2026-03-27 16:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fe36ef54fe98d4278b87906b0bdfdbbb1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/6.jpg not downloaded yet
2026-03-27 16:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abdd10>
2026-03-27 16:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9606dbb-795d-5250-9965-824f9a58b058/e9606dbb-795d-5250-9965-824f9a58b058_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F7ed7fe549d3844d19cd9606eaf3a4a1f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/1.jpg saved to cache
2026-03-27 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9606dbb-795d-5250-9965-824f9a58b058
2026-03-27 16:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fe36ef54fe98d4278b87906b0bdfdbbb1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/7.jpg not downloaded yet
2026-03-27 16:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591445c50>
2026-03-27 16:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9606dbb-795d-5250-9965-824f9a58b058/e9606dbb-795d-5250-9965-824f9a58b058_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F7ed7fe549d3844d19cd9606eaf3a4a1f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/2.jpg saved to cache
2026-03-27 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9606dbb-795d-5250-9965-824f9a58b058
2026-03-27 16:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de7f50>
2026-03-27 16:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9606dbb-795d-5250-9965-824f9a58b058/e9606dbb-795d-5250-9965-824f9a58b058_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F7ed7fe549d3844d19cd9606eaf3a4a1f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/4.jpg saved to cache
2026-03-27 16:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9606dbb-795d-5250-9965-824f9a58b058
2026-03-27 16:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591113ed0>
2026-03-27 16:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9606dbb-795d-5250-9965-824f9a58b058/e9606dbb-795d-5250-9965-824f9a58b058_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F7ed7fe549d3844d19cd9606eaf3a4a1f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/6.jpg saved to cache
2026-03-27 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9606dbb-795d-5250-9965-824f9a58b058
2026-03-27 16:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa1250>
2026-03-27 16:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9606dbb-795d-5250-9965-824f9a58b058/e9606dbb-795d-5250-9965-824f9a58b058_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F7ed7fe549d3844d19cd9606eaf3a4a1f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/7.jpg saved to cache
2026-03-27 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9606dbb-795d-5250-9965-824f9a58b058
2026-03-27 16:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fe36ef54fe98d4278b87906b0bdfdbbb1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/8.jpg not downloaded yet
2026-03-27 16:46:49 [ayvens.fr] INFO: Found listing with ID: 1988261
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988261%27 HTTP/1.1" 200 None
2026-03-27 16:46:49 [ayvens.fr] INFO: Scrape type for 1988261: 1
2026-03-27 16:46:49 [ayvens.fr] INFO: Extracting data for car ID: 1988261
2026-03-27 16:46:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0435a57a-07ff-5421-bc68-95fe214ea7b0 with identifier: 1988261
2026-03-27 16:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0435a57a-07ff-5421-bc68-95fe214ea7b0 with scrape type 1
2026-03-27 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0435a57a-07ff-5421-bc68-95fe214ea7b0
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb6d1b99cdff749eeae53fd8b0da4ecd1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/1.jpg not downloaded yet
2026-03-27 16:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591001110>
2026-03-27 16:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9606dbb-795d-5250-9965-824f9a58b058/e9606dbb-795d-5250-9965-824f9a58b058_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F7ed7fe549d3844d19cd9606eaf3a4a1f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/3.jpg saved to cache
2026-03-27 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9606dbb-795d-5250-9965-824f9a58b058
2026-03-27 16:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590af2010>
2026-03-27 16:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9606dbb-795d-5250-9965-824f9a58b058/e9606dbb-795d-5250-9965-824f9a58b058_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F7ed7fe549d3844d19cd9606eaf3a4a1f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/8.jpg saved to cache
2026-03-27 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9606dbb-795d-5250-9965-824f9a58b058
2026-03-27 16:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa2c90>
2026-03-27 16:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9606dbb-795d-5250-9965-824f9a58b058/e9606dbb-795d-5250-9965-824f9a58b058_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F7ed7fe549d3844d19cd9606eaf3a4a1f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/5.jpg saved to cache
2026-03-27 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9606dbb-795d-5250-9965-824f9a58b058
2026-03-27 16:46:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9606dbb-795d-5250-9965-824f9a58b058, skipping ID generation
2026-03-27 16:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9606dbb-795d-5250-9965-824f9a58b058 with scrape type 1
2026-03-27 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9606dbb-795d-5250-9965-824f9a58b058 sending to next pipeline
2026-03-27 16:46:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e9606dbb-795d-5250-9965-824f9a58b058, identifier: 1988259
2026-03-27 16:46:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e9606dbb-795d-5250-9965-824f9a58b058 with identifier: 1988259
2026-03-27 16:46:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e9606dbb-795d-5250-9965-824f9a58b058 with identifier: 1988259
2026-03-27 16:46:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e9606dbb-795d-5250-9965-824f9a58b058 with identifier: 1988259 to the API
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'e9606dbb-795d-5250-9965-824f9a58b058',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 15987,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9606dbb-795d-5250-9965-824f9a58b058/e9606dbb-795d-5250-9965-824f9a58b058_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347523,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9606dbb-795d-5250-9965-824f9a58b058/e9606dbb-795d-5250-9965-824f9a58b058_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347523,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9606dbb-795d-5250-9965-824f9a58b058/e9606dbb-795d-5250-9965-824f9a58b058_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368783,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9606dbb-795d-5250-9965-824f9a58b058/e9606dbb-795d-5250-9965-824f9a58b058_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340589,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9606dbb-795d-5250-9965-824f9a58b058/e9606dbb-795d-5250-9965-824f9a58b058_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418471,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9606dbb-795d-5250-9965-824f9a58b058/e9606dbb-795d-5250-9965-824f9a58b058_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324459,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9606dbb-795d-5250-9965-824f9a58b058/e9606dbb-795d-5250-9965-824f9a58b058_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301370,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9606dbb-795d-5250-9965-824f9a58b058/e9606dbb-795d-5250-9965-824f9a58b058_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339214,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/7ed7fe549d3844d19cd9606eaf3a4a1f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.2 PureTech 75ch S&S Style',
'transmission': 'manual',
'trim': '208 1.2 PureTech 75ch S&S Style',
'vin': None,
'year': 2023}
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988259%27 HTTP/1.1" 200 None
2026-03-27 16:46:49 [ayvens.fr] INFO: Saving data for 1988259: {'created_time': 1774630009.872657, 'last_price_update_time': 1774630009.872671, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988259') HTTP/1.1" 204 0
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb6d1b99cdff749eeae53fd8b0da4ecd1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/2.jpg not downloaded yet
2026-03-27 16:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903ce7d0>
2026-03-27 16:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2/5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fe36ef54fe98d4278b87906b0bdfdbbb1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/1.jpg saved to cache
2026-03-27 16:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2
2026-03-27 16:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb6d1b99cdff749eeae53fd8b0da4ecd1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/3.jpg not downloaded yet
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb6d1b99cdff749eeae53fd8b0da4ecd1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/4.jpg not downloaded yet
2026-03-27 16:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb6d1b99cdff749eeae53fd8b0da4ecd1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/5.jpg not downloaded yet
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b50490>
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2/5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fe36ef54fe98d4278b87906b0bdfdbbb1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/2.jpg saved to cache
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa3e50>
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2/5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fe36ef54fe98d4278b87906b0bdfdbbb1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/3.jpg saved to cache
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb6d1b99cdff749eeae53fd8b0da4ecd1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/6.jpg not downloaded yet
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb6d1b99cdff749eeae53fd8b0da4ecd1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/7.jpg not downloaded yet
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b69d50>
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2/5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fe36ef54fe98d4278b87906b0bdfdbbb1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/4.jpg saved to cache
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590696150>
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2/5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fe36ef54fe98d4278b87906b0bdfdbbb1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/5.jpg saved to cache
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906687d0>
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2/5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fe36ef54fe98d4278b87906b0bdfdbbb1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/6.jpg saved to cache
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc4dd0>
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2/5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fe36ef54fe98d4278b87906b0bdfdbbb1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/7.jpg saved to cache
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2
2026-03-27 16:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb6d1b99cdff749eeae53fd8b0da4ecd1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/8.jpg not downloaded yet
2026-03-27 16:46:50 [ayvens.fr] INFO: Found listing with ID: 1988262
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988262%27 HTTP/1.1" 200 None
2026-03-27 16:46:50 [ayvens.fr] INFO: Scrape type for 1988262: 1
2026-03-27 16:46:50 [ayvens.fr] INFO: Extracting data for car ID: 1988262
2026-03-27 16:46:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4123731c-295a-55f6-8362-4d19522a5b0d with identifier: 1988262
2026-03-27 16:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4123731c-295a-55f6-8362-4d19522a5b0d with scrape type 1
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4123731c-295a-55f6-8362-4d19522a5b0d
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b71bfe30b684dfdab837fcff6e8d7aa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/1.jpg not downloaded yet
2026-03-27 16:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b71bfe30b684dfdab837fcff6e8d7aa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/2.jpg not downloaded yet
2026-03-27 16:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b71bfe30b684dfdab837fcff6e8d7aa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/3.jpg not downloaded yet
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b71bfe30b684dfdab837fcff6e8d7aa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/4.jpg not downloaded yet
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abe4d0>
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2/5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fe36ef54fe98d4278b87906b0bdfdbbb1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/8.jpg saved to cache
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2
2026-03-27 16:46:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2, skipping ID generation
2026-03-27 16:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2 with scrape type 1
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2 sending to next pipeline
2026-03-27 16:46:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2, identifier: 1988260
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b71bfe30b684dfdab837fcff6e8d7aa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/5.jpg not downloaded yet
2026-03-27 16:46:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2 with identifier: 1988260
2026-03-27 16:46:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2 with identifier: 1988260
2026-03-27 16:46:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2 with identifier: 1988260 to the API
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 102,
'color': 'BLEU DE PRUSSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'COROLLA',
'odometer': 56221,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2/5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324450,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2/5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324450,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2/5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326179,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2/5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336913,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2/5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339245,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2/5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352596,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2/5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 413648,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2/5e9dfc64-04c4-53aa-b9cc-ae5b012d36e2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328353,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/e36ef54fe98d4278b87906b0bdfdbbb1/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-08',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA COROLLA Corolla 122h Dynamic Business + Stage Hybrid Academy',
'transmission': 'automatic',
'trim': 'Corolla 122h Dynamic Business + Stage Hybrid Academy',
'vin': None,
'year': 2021}
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988260%27 HTTP/1.1" 200 None
2026-03-27 16:46:51 [ayvens.fr] INFO: Saving data for 1988260: {'created_time': 1774630011.295073, 'last_price_update_time': 1774630011.295084, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988260') HTTP/1.1" 204 0
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b71bfe30b684dfdab837fcff6e8d7aa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/6.jpg not downloaded yet
2026-03-27 16:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae1650>
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0435a57a-07ff-5421-bc68-95fe214ea7b0/0435a57a-07ff-5421-bc68-95fe214ea7b0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb6d1b99cdff749eeae53fd8b0da4ecd1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/3.jpg saved to cache
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0435a57a-07ff-5421-bc68-95fe214ea7b0
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f13750>
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0435a57a-07ff-5421-bc68-95fe214ea7b0/0435a57a-07ff-5421-bc68-95fe214ea7b0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb6d1b99cdff749eeae53fd8b0da4ecd1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/2.jpg saved to cache
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0435a57a-07ff-5421-bc68-95fe214ea7b0
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591444950>
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0435a57a-07ff-5421-bc68-95fe214ea7b0/0435a57a-07ff-5421-bc68-95fe214ea7b0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb6d1b99cdff749eeae53fd8b0da4ecd1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/1.jpg saved to cache
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0435a57a-07ff-5421-bc68-95fe214ea7b0
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ad5d50>
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0435a57a-07ff-5421-bc68-95fe214ea7b0/0435a57a-07ff-5421-bc68-95fe214ea7b0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb6d1b99cdff749eeae53fd8b0da4ecd1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/4.jpg saved to cache
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0435a57a-07ff-5421-bc68-95fe214ea7b0
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590db9250>
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0435a57a-07ff-5421-bc68-95fe214ea7b0/0435a57a-07ff-5421-bc68-95fe214ea7b0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb6d1b99cdff749eeae53fd8b0da4ecd1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/5.jpg saved to cache
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0435a57a-07ff-5421-bc68-95fe214ea7b0
2026-03-27 16:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b71bfe30b684dfdab837fcff6e8d7aa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/7.jpg not downloaded yet
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b71bfe30b684dfdab837fcff6e8d7aa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/8.jpg not downloaded yet
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905aa0d0>
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0435a57a-07ff-5421-bc68-95fe214ea7b0/0435a57a-07ff-5421-bc68-95fe214ea7b0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb6d1b99cdff749eeae53fd8b0da4ecd1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/7.jpg saved to cache
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0435a57a-07ff-5421-bc68-95fe214ea7b0
2026-03-27 16:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:51 [ayvens.fr] INFO: Found listing with ID: 1988263
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988263%27 HTTP/1.1" 200 None
2026-03-27 16:46:51 [ayvens.fr] INFO: Scrape type for 1988263: 1
2026-03-27 16:46:51 [ayvens.fr] INFO: Extracting data for car ID: 1988263
2026-03-27 16:46:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2944de3f-5371-5bcc-9428-b4db7906ec31 with identifier: 1988263
2026-03-27 16:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2944de3f-5371-5bcc-9428-b4db7906ec31 with scrape type 1
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 2944de3f-5371-5bcc-9428-b4db7906ec31
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fe63f5349a48c473d96295a84b835f463%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/1.jpg not downloaded yet
2026-03-27 16:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fe63f5349a48c473d96295a84b835f463%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/2.jpg not downloaded yet
2026-03-27 16:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068e050>
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0435a57a-07ff-5421-bc68-95fe214ea7b0/0435a57a-07ff-5421-bc68-95fe214ea7b0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb6d1b99cdff749eeae53fd8b0da4ecd1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/6.jpg saved to cache
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0435a57a-07ff-5421-bc68-95fe214ea7b0
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fe63f5349a48c473d96295a84b835f463%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/3.jpg not downloaded yet
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fe63f5349a48c473d96295a84b835f463%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/4.jpg not downloaded yet
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b40850>
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0435a57a-07ff-5421-bc68-95fe214ea7b0/0435a57a-07ff-5421-bc68-95fe214ea7b0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb6d1b99cdff749eeae53fd8b0da4ecd1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/8.jpg saved to cache
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0435a57a-07ff-5421-bc68-95fe214ea7b0
2026-03-27 16:46:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0435a57a-07ff-5421-bc68-95fe214ea7b0, skipping ID generation
2026-03-27 16:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0435a57a-07ff-5421-bc68-95fe214ea7b0 with scrape type 1
2026-03-27 16:46:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0435a57a-07ff-5421-bc68-95fe214ea7b0 sending to next pipeline
2026-03-27 16:46:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0435a57a-07ff-5421-bc68-95fe214ea7b0, identifier: 1988261
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d50cd0>
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4123731c-295a-55f6-8362-4d19522a5b0d/4123731c-295a-55f6-8362-4d19522a5b0d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b71bfe30b684dfdab837fcff6e8d7aa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/1.jpg saved to cache
2026-03-27 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4123731c-295a-55f6-8362-4d19522a5b0d
2026-03-27 16:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d2a10>
2026-03-27 16:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4123731c-295a-55f6-8362-4d19522a5b0d/4123731c-295a-55f6-8362-4d19522a5b0d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b71bfe30b684dfdab837fcff6e8d7aa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/2.jpg saved to cache
2026-03-27 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4123731c-295a-55f6-8362-4d19522a5b0d
2026-03-27 16:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fe63f5349a48c473d96295a84b835f463%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/5.jpg not downloaded yet
2026-03-27 16:46:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0435a57a-07ff-5421-bc68-95fe214ea7b0 with identifier: 1988261
2026-03-27 16:46:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0435a57a-07ff-5421-bc68-95fe214ea7b0 with identifier: 1988261
2026-03-27 16:46:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0435a57a-07ff-5421-bc68-95fe214ea7b0 with identifier: 1988261 to the API
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '0435a57a-07ff-5421-bc68-95fe214ea7b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 118628,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0435a57a-07ff-5421-bc68-95fe214ea7b0/0435a57a-07ff-5421-bc68-95fe214ea7b0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439320,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0435a57a-07ff-5421-bc68-95fe214ea7b0/0435a57a-07ff-5421-bc68-95fe214ea7b0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439320,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0435a57a-07ff-5421-bc68-95fe214ea7b0/0435a57a-07ff-5421-bc68-95fe214ea7b0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425426,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0435a57a-07ff-5421-bc68-95fe214ea7b0/0435a57a-07ff-5421-bc68-95fe214ea7b0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312011,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0435a57a-07ff-5421-bc68-95fe214ea7b0/0435a57a-07ff-5421-bc68-95fe214ea7b0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379138,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0435a57a-07ff-5421-bc68-95fe214ea7b0/0435a57a-07ff-5421-bc68-95fe214ea7b0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308300,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0435a57a-07ff-5421-bc68-95fe214ea7b0/0435a57a-07ff-5421-bc68-95fe214ea7b0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216158,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0435a57a-07ff-5421-bc68-95fe214ea7b0/0435a57a-07ff-5421-bc68-95fe214ea7b0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400511,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/b6d1b99cdff749eeae53fd8b0da4ecd1/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-28',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.5 BlueHDi 110ch S&S Allure Pack',
'transmission': 'manual',
'trim': '2008 1.5 BlueHDi 110ch S&S Allure Pack',
'vin': None,
'year': 2022}
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988261%27 HTTP/1.1" 200 None
2026-03-27 16:46:52 [ayvens.fr] INFO: Saving data for 1988261: {'created_time': 1774630012.585917, 'last_price_update_time': 1774630012.585929, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988261') HTTP/1.1" 204 0
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fe63f5349a48c473d96295a84b835f463%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/6.jpg not downloaded yet
2026-03-27 16:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59067eed0>
2026-03-27 16:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4123731c-295a-55f6-8362-4d19522a5b0d/4123731c-295a-55f6-8362-4d19522a5b0d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b71bfe30b684dfdab837fcff6e8d7aa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/4.jpg saved to cache
2026-03-27 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4123731c-295a-55f6-8362-4d19522a5b0d
2026-03-27 16:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7e110>
2026-03-27 16:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4123731c-295a-55f6-8362-4d19522a5b0d/4123731c-295a-55f6-8362-4d19522a5b0d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b71bfe30b684dfdab837fcff6e8d7aa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/3.jpg saved to cache
2026-03-27 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4123731c-295a-55f6-8362-4d19522a5b0d
2026-03-27 16:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6f150>
2026-03-27 16:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4123731c-295a-55f6-8362-4d19522a5b0d/4123731c-295a-55f6-8362-4d19522a5b0d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b71bfe30b684dfdab837fcff6e8d7aa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/5.jpg saved to cache
2026-03-27 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4123731c-295a-55f6-8362-4d19522a5b0d
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fe63f5349a48c473d96295a84b835f463%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/7.jpg not downloaded yet
2026-03-27 16:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fe63f5349a48c473d96295a84b835f463%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/8.jpg not downloaded yet
2026-03-27 16:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f82c10>
2026-03-27 16:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4123731c-295a-55f6-8362-4d19522a5b0d/4123731c-295a-55f6-8362-4d19522a5b0d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b71bfe30b684dfdab837fcff6e8d7aa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/6.jpg saved to cache
2026-03-27 16:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4123731c-295a-55f6-8362-4d19522a5b0d
2026-03-27 16:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:52 [ayvens.fr] INFO: Found listing with ID: 1988264
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988264%27 HTTP/1.1" 200 None
2026-03-27 16:46:53 [ayvens.fr] INFO: Scrape type for 1988264: 1
2026-03-27 16:46:53 [ayvens.fr] INFO: Extracting data for car ID: 1988264
2026-03-27 16:46:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7be4638a-7fd9-509c-8bce-b2648127f268 with identifier: 1988264
2026-03-27 16:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7be4638a-7fd9-509c-8bce-b2648127f268 with scrape type 1
2026-03-27 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7be4638a-7fd9-509c-8bce-b2648127f268
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3801d171c2b14144b124f54eac893bb0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/1.jpg not downloaded yet
2026-03-27 16:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3801d171c2b14144b124f54eac893bb0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/2.jpg not downloaded yet
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066bc50>
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4123731c-295a-55f6-8362-4d19522a5b0d/4123731c-295a-55f6-8362-4d19522a5b0d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b71bfe30b684dfdab837fcff6e8d7aa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/7.jpg saved to cache
2026-03-27 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4123731c-295a-55f6-8362-4d19522a5b0d
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3801d171c2b14144b124f54eac893bb0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/3.jpg not downloaded yet
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2e6d0>
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2944de3f-5371-5bcc-9428-b4db7906ec31/2944de3f-5371-5bcc-9428-b4db7906ec31_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fe63f5349a48c473d96295a84b835f463%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/1.jpg saved to cache
2026-03-27 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2944de3f-5371-5bcc-9428-b4db7906ec31
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0f750>
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2944de3f-5371-5bcc-9428-b4db7906ec31/2944de3f-5371-5bcc-9428-b4db7906ec31_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fe63f5349a48c473d96295a84b835f463%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/2.jpg saved to cache
2026-03-27 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2944de3f-5371-5bcc-9428-b4db7906ec31
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050c050>
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2944de3f-5371-5bcc-9428-b4db7906ec31/2944de3f-5371-5bcc-9428-b4db7906ec31_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fe63f5349a48c473d96295a84b835f463%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/3.jpg saved to cache
2026-03-27 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2944de3f-5371-5bcc-9428-b4db7906ec31
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3801d171c2b14144b124f54eac893bb0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/4.jpg not downloaded yet
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b67010>
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4123731c-295a-55f6-8362-4d19522a5b0d/4123731c-295a-55f6-8362-4d19522a5b0d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F7b71bfe30b684dfdab837fcff6e8d7aa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/8.jpg saved to cache
2026-03-27 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4123731c-295a-55f6-8362-4d19522a5b0d
2026-03-27 16:46:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4123731c-295a-55f6-8362-4d19522a5b0d, skipping ID generation
2026-03-27 16:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4123731c-295a-55f6-8362-4d19522a5b0d with scrape type 1
2026-03-27 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4123731c-295a-55f6-8362-4d19522a5b0d sending to next pipeline
2026-03-27 16:46:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4123731c-295a-55f6-8362-4d19522a5b0d, identifier: 1988262
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068d310>
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2944de3f-5371-5bcc-9428-b4db7906ec31/2944de3f-5371-5bcc-9428-b4db7906ec31_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fe63f5349a48c473d96295a84b835f463%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/4.jpg saved to cache
2026-03-27 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2944de3f-5371-5bcc-9428-b4db7906ec31
2026-03-27 16:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3801d171c2b14144b124f54eac893bb0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/5.jpg not downloaded yet
2026-03-27 16:46:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4123731c-295a-55f6-8362-4d19522a5b0d with identifier: 1988262
2026-03-27 16:46:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:46:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4123731c-295a-55f6-8362-4d19522a5b0d with identifier: 1988262
2026-03-27 16:46:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4123731c-295a-55f6-8362-4d19522a5b0d with identifier: 1988262 to the API
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 47,
'color': 'NOIRE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '4123731c-295a-55f6-8362-4d19522a5b0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'X3',
'odometer': 36485,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4123731c-295a-55f6-8362-4d19522a5b0d/4123731c-295a-55f6-8362-4d19522a5b0d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458921,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4123731c-295a-55f6-8362-4d19522a5b0d/4123731c-295a-55f6-8362-4d19522a5b0d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458921,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4123731c-295a-55f6-8362-4d19522a5b0d/4123731c-295a-55f6-8362-4d19522a5b0d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414276,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4123731c-295a-55f6-8362-4d19522a5b0d/4123731c-295a-55f6-8362-4d19522a5b0d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346013,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4123731c-295a-55f6-8362-4d19522a5b0d/4123731c-295a-55f6-8362-4d19522a5b0d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280091,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4123731c-295a-55f6-8362-4d19522a5b0d/4123731c-295a-55f6-8362-4d19522a5b0d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4123731c-295a-55f6-8362-4d19522a5b0d/4123731c-295a-55f6-8362-4d19522a5b0d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318906,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4123731c-295a-55f6-8362-4d19522a5b0d/4123731c-295a-55f6-8362-4d19522a5b0d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 479328,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/7b71bfe30b684dfdab837fcff6e8d7aa/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-17',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 X3 xDrive30e 292ch Business Design',
'transmission': 'automatic',
'trim': 'X3 xDrive30e 292ch Business Design',
'vin': None,
'year': 2023}
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988262%27 HTTP/1.1" 200 None
2026-03-27 16:46:54 [ayvens.fr] INFO: Saving data for 1988262: {'created_time': 1774630014.750035, 'last_price_update_time': 1774630014.750049, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988262') HTTP/1.1" 204 0
2026-03-27 16:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3801d171c2b14144b124f54eac893bb0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/6.jpg not downloaded yet
2026-03-27 16:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911c9bd0>
2026-03-27 16:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2944de3f-5371-5bcc-9428-b4db7906ec31/2944de3f-5371-5bcc-9428-b4db7906ec31_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fe63f5349a48c473d96295a84b835f463%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/6.jpg saved to cache
2026-03-27 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2944de3f-5371-5bcc-9428-b4db7906ec31
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3801d171c2b14144b124f54eac893bb0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/7.jpg not downloaded yet
2026-03-27 16:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3801d171c2b14144b124f54eac893bb0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/8.jpg not downloaded yet
2026-03-27 16:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c2590>
2026-03-27 16:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2944de3f-5371-5bcc-9428-b4db7906ec31/2944de3f-5371-5bcc-9428-b4db7906ec31_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fe63f5349a48c473d96295a84b835f463%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/7.jpg saved to cache
2026-03-27 16:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2944de3f-5371-5bcc-9428-b4db7906ec31
2026-03-27 16:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f83290>
2026-03-27 16:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2944de3f-5371-5bcc-9428-b4db7906ec31/2944de3f-5371-5bcc-9428-b4db7906ec31_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fe63f5349a48c473d96295a84b835f463%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/5.jpg saved to cache
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2944de3f-5371-5bcc-9428-b4db7906ec31
2026-03-27 16:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b67f90>
2026-03-27 16:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2944de3f-5371-5bcc-9428-b4db7906ec31/2944de3f-5371-5bcc-9428-b4db7906ec31_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Fe63f5349a48c473d96295a84b835f463%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/8.jpg saved to cache
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2944de3f-5371-5bcc-9428-b4db7906ec31
2026-03-27 16:46:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2944de3f-5371-5bcc-9428-b4db7906ec31, skipping ID generation
2026-03-27 16:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2944de3f-5371-5bcc-9428-b4db7906ec31 with scrape type 1
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2944de3f-5371-5bcc-9428-b4db7906ec31 sending to next pipeline
2026-03-27 16:46:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 2944de3f-5371-5bcc-9428-b4db7906ec31, identifier: 1988263
2026-03-27 16:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:55 [ayvens.fr] INFO: Found listing with ID: 1988265
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988265%27 HTTP/1.1" 200 None
2026-03-27 16:46:55 [ayvens.fr] INFO: Scrape type for 1988265: 1
2026-03-27 16:46:55 [ayvens.fr] INFO: Extracting data for car ID: 1988265
2026-03-27 16:46:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b32d88ed-43e5-5582-923e-523c13f165df with identifier: 1988265
2026-03-27 16:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b32d88ed-43e5-5582-923e-523c13f165df with scrape type 1
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b32d88ed-43e5-5582-923e-523c13f165df
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fe8d514b2f64846a5a90c9418e450d275%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/1.jpg not downloaded yet
2026-03-27 16:46:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 2944de3f-5371-5bcc-9428-b4db7906ec31 with identifier: 1988263
2026-03-27 16:46:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 2944de3f-5371-5bcc-9428-b4db7906ec31 with identifier: 1988263
2026-03-27 16:46:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 2944de3f-5371-5bcc-9428-b4db7906ec31 with identifier: 1988263 to the API
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 141,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '2944de3f-5371-5bcc-9428-b4db7906ec31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'TRAFIC',
'odometer': 44598,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2944de3f-5371-5bcc-9428-b4db7906ec31/2944de3f-5371-5bcc-9428-b4db7906ec31_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382531,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2944de3f-5371-5bcc-9428-b4db7906ec31/2944de3f-5371-5bcc-9428-b4db7906ec31_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382531,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2944de3f-5371-5bcc-9428-b4db7906ec31/2944de3f-5371-5bcc-9428-b4db7906ec31_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331188,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2944de3f-5371-5bcc-9428-b4db7906ec31/2944de3f-5371-5bcc-9428-b4db7906ec31_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361150,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2944de3f-5371-5bcc-9428-b4db7906ec31/2944de3f-5371-5bcc-9428-b4db7906ec31_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280997,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2944de3f-5371-5bcc-9428-b4db7906ec31/2944de3f-5371-5bcc-9428-b4db7906ec31_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337961,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2944de3f-5371-5bcc-9428-b4db7906ec31/2944de3f-5371-5bcc-9428-b4db7906ec31_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295221,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2944de3f-5371-5bcc-9428-b4db7906ec31/2944de3f-5371-5bcc-9428-b4db7906ec31_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329128,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/e63f5349a48c473d96295a84b835f463/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-20',
'seats_number': 8,
'seller_name': None,
'title': 'RENAULT TRAFIC Trafic Combi L2 2.0 dCi 120ch S&S Zen 8 places',
'transmission': 'manual',
'trim': 'Trafic Combi L2 2.0 dCi 120ch S&S Zen 8 places',
'vin': None,
'year': 2020}
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988263%27 HTTP/1.1" 200 None
2026-03-27 16:46:55 [ayvens.fr] INFO: Saving data for 1988263: {'created_time': 1774630015.530223, 'last_price_update_time': 1774630015.530234, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988263') HTTP/1.1" 204 0
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fe8d514b2f64846a5a90c9418e450d275%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/2.jpg not downloaded yet
2026-03-27 16:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b36350>
2026-03-27 16:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7be4638a-7fd9-509c-8bce-b2648127f268/7be4638a-7fd9-509c-8bce-b2648127f268_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3801d171c2b14144b124f54eac893bb0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/1.jpg saved to cache
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7be4638a-7fd9-509c-8bce-b2648127f268
2026-03-27 16:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b2a3d0>
2026-03-27 16:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7be4638a-7fd9-509c-8bce-b2648127f268/7be4638a-7fd9-509c-8bce-b2648127f268_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3801d171c2b14144b124f54eac893bb0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/2.jpg saved to cache
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7be4638a-7fd9-509c-8bce-b2648127f268
2026-03-27 16:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905ab950>
2026-03-27 16:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7be4638a-7fd9-509c-8bce-b2648127f268/7be4638a-7fd9-509c-8bce-b2648127f268_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3801d171c2b14144b124f54eac893bb0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/3.jpg saved to cache
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7be4638a-7fd9-509c-8bce-b2648127f268
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fe8d514b2f64846a5a90c9418e450d275%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/3.jpg not downloaded yet
2026-03-27 16:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fe8d514b2f64846a5a90c9418e450d275%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/4.jpg not downloaded yet
2026-03-27 16:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fe8d514b2f64846a5a90c9418e450d275%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/5.jpg not downloaded yet
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fe8d514b2f64846a5a90c9418e450d275%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/6.jpg not downloaded yet
2026-03-27 16:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fe8d514b2f64846a5a90c9418e450d275%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/7.jpg not downloaded yet
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fe8d514b2f64846a5a90c9418e450d275%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/8.jpg not downloaded yet
2026-03-27 16:46:55 [ayvens.fr] INFO: Found listing with ID: 1988266
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988266%27 HTTP/1.1" 200 None
2026-03-27 16:46:55 [ayvens.fr] INFO: Scrape type for 1988266: 1
2026-03-27 16:46:55 [ayvens.fr] INFO: Extracting data for car ID: 1988266
2026-03-27 16:46:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47485c9c-1bad-50ad-852f-b34d84901639 with identifier: 1988266
2026-03-27 16:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47485c9c-1bad-50ad-852f-b34d84901639 with scrape type 1
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 47485c9c-1bad-50ad-852f-b34d84901639
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fdf229e8b24da40b69f64e0c6d46e7f17%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/1.jpg not downloaded yet
2026-03-27 16:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c0f90>
2026-03-27 16:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7be4638a-7fd9-509c-8bce-b2648127f268/7be4638a-7fd9-509c-8bce-b2648127f268_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3801d171c2b14144b124f54eac893bb0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/4.jpg saved to cache
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7be4638a-7fd9-509c-8bce-b2648127f268
2026-03-27 16:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f12310>
2026-03-27 16:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7be4638a-7fd9-509c-8bce-b2648127f268/7be4638a-7fd9-509c-8bce-b2648127f268_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3801d171c2b14144b124f54eac893bb0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/5.jpg saved to cache
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7be4638a-7fd9-509c-8bce-b2648127f268
2026-03-27 16:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc7210>
2026-03-27 16:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7be4638a-7fd9-509c-8bce-b2648127f268/7be4638a-7fd9-509c-8bce-b2648127f268_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3801d171c2b14144b124f54eac893bb0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/6.jpg saved to cache
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7be4638a-7fd9-509c-8bce-b2648127f268
2026-03-27 16:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc7450>
2026-03-27 16:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7be4638a-7fd9-509c-8bce-b2648127f268/7be4638a-7fd9-509c-8bce-b2648127f268_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3801d171c2b14144b124f54eac893bb0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/7.jpg saved to cache
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7be4638a-7fd9-509c-8bce-b2648127f268
2026-03-27 16:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ad5d90>
2026-03-27 16:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7be4638a-7fd9-509c-8bce-b2648127f268/7be4638a-7fd9-509c-8bce-b2648127f268_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3801d171c2b14144b124f54eac893bb0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/8.jpg saved to cache
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7be4638a-7fd9-509c-8bce-b2648127f268
2026-03-27 16:46:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7be4638a-7fd9-509c-8bce-b2648127f268, skipping ID generation
2026-03-27 16:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7be4638a-7fd9-509c-8bce-b2648127f268 with scrape type 1
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7be4638a-7fd9-509c-8bce-b2648127f268 sending to next pipeline
2026-03-27 16:46:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7be4638a-7fd9-509c-8bce-b2648127f268, identifier: 1988264
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fdf229e8b24da40b69f64e0c6d46e7f17%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/2.jpg not downloaded yet
2026-03-27 16:46:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7be4638a-7fd9-509c-8bce-b2648127f268 with identifier: 1988264
2026-03-27 16:46:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7be4638a-7fd9-509c-8bce-b2648127f268 with identifier: 1988264
2026-03-27 16:46:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7be4638a-7fd9-509c-8bce-b2648127f268 with identifier: 1988264 to the API
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '7be4638a-7fd9-509c-8bce-b2648127f268',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 55392,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be4638a-7fd9-509c-8bce-b2648127f268/7be4638a-7fd9-509c-8bce-b2648127f268_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444896,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be4638a-7fd9-509c-8bce-b2648127f268/7be4638a-7fd9-509c-8bce-b2648127f268_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444896,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be4638a-7fd9-509c-8bce-b2648127f268/7be4638a-7fd9-509c-8bce-b2648127f268_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457012,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be4638a-7fd9-509c-8bce-b2648127f268/7be4638a-7fd9-509c-8bce-b2648127f268_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397075,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be4638a-7fd9-509c-8bce-b2648127f268/7be4638a-7fd9-509c-8bce-b2648127f268_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357294,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be4638a-7fd9-509c-8bce-b2648127f268/7be4638a-7fd9-509c-8bce-b2648127f268_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340927,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be4638a-7fd9-509c-8bce-b2648127f268/7be4638a-7fd9-509c-8bce-b2648127f268_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216464,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be4638a-7fd9-509c-8bce-b2648127f268/7be4638a-7fd9-509c-8bce-b2648127f268_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 463367,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3801d171c2b14144b124f54eac893bb0/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-06',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 130ch S&S GT EAT8',
'transmission': 'automatic',
'trim': '2008 1.2 PureTech 130ch S&S GT EAT8',
'vin': None,
'year': 2022}
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988264%27 HTTP/1.1" 200 None
2026-03-27 16:46:56 [ayvens.fr] INFO: Saving data for 1988264: {'created_time': 1774630016.747186, 'last_price_update_time': 1774630016.747199, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988264') HTTP/1.1" 204 0
2026-03-27 16:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fdf229e8b24da40b69f64e0c6d46e7f17%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/3.jpg not downloaded yet
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fdf229e8b24da40b69f64e0c6d46e7f17%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/4.jpg not downloaded yet
2026-03-27 16:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fdf229e8b24da40b69f64e0c6d46e7f17%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/5.jpg not downloaded yet
2026-03-27 16:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fdf229e8b24da40b69f64e0c6d46e7f17%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/6.jpg not downloaded yet
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fdf229e8b24da40b69f64e0c6d46e7f17%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/7.jpg not downloaded yet
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fdf229e8b24da40b69f64e0c6d46e7f17%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/8.jpg not downloaded yet
2026-03-27 16:46:56 [ayvens.fr] INFO: Found listing with ID: 1988267
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988267%27 HTTP/1.1" 200 None
2026-03-27 16:46:56 [ayvens.fr] INFO: Scrape type for 1988267: 1
2026-03-27 16:46:56 [ayvens.fr] INFO: Extracting data for car ID: 1988267
2026-03-27 16:46:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52c3c9d6-ba4c-5c08-96b2-ab539ee26686 with identifier: 1988267
2026-03-27 16:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52c3c9d6-ba4c-5c08-96b2-ab539ee26686 with scrape type 1
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 52c3c9d6-ba4c-5c08-96b2-ab539ee26686
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F7b10f309fb774e47ac3d11d5eed24bd7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/1.jpg not downloaded yet
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F7b10f309fb774e47ac3d11d5eed24bd7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/2.jpg not downloaded yet
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F7b10f309fb774e47ac3d11d5eed24bd7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/3.jpg not downloaded yet
2026-03-27 16:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911c8390>
2026-03-27 16:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b32d88ed-43e5-5582-923e-523c13f165df/b32d88ed-43e5-5582-923e-523c13f165df_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fe8d514b2f64846a5a90c9418e450d275%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/5.jpg saved to cache
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b32d88ed-43e5-5582-923e-523c13f165df
2026-03-27 16:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F7b10f309fb774e47ac3d11d5eed24bd7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/4.jpg not downloaded yet
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6c550>
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b32d88ed-43e5-5582-923e-523c13f165df/b32d88ed-43e5-5582-923e-523c13f165df_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fe8d514b2f64846a5a90c9418e450d275%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/2.jpg saved to cache
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b32d88ed-43e5-5582-923e-523c13f165df
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906946d0>
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b32d88ed-43e5-5582-923e-523c13f165df/b32d88ed-43e5-5582-923e-523c13f165df_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fe8d514b2f64846a5a90c9418e450d275%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/4.jpg saved to cache
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b32d88ed-43e5-5582-923e-523c13f165df
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e14b50>
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b32d88ed-43e5-5582-923e-523c13f165df/b32d88ed-43e5-5582-923e-523c13f165df_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fe8d514b2f64846a5a90c9418e450d275%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/7.jpg saved to cache
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b32d88ed-43e5-5582-923e-523c13f165df
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa0d90>
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b32d88ed-43e5-5582-923e-523c13f165df/b32d88ed-43e5-5582-923e-523c13f165df_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fe8d514b2f64846a5a90c9418e450d275%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/1.jpg saved to cache
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b32d88ed-43e5-5582-923e-523c13f165df
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dac690>
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b32d88ed-43e5-5582-923e-523c13f165df/b32d88ed-43e5-5582-923e-523c13f165df_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fe8d514b2f64846a5a90c9418e450d275%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/6.jpg saved to cache
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b32d88ed-43e5-5582-923e-523c13f165df
2026-03-27 16:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F7b10f309fb774e47ac3d11d5eed24bd7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/5.jpg not downloaded yet
2026-03-27 16:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e8f450>
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b32d88ed-43e5-5582-923e-523c13f165df/b32d88ed-43e5-5582-923e-523c13f165df_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fe8d514b2f64846a5a90c9418e450d275%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/3.jpg saved to cache
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b32d88ed-43e5-5582-923e-523c13f165df
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e158d0>
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47485c9c-1bad-50ad-852f-b34d84901639/47485c9c-1bad-50ad-852f-b34d84901639_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fdf229e8b24da40b69f64e0c6d46e7f17%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/1.jpg saved to cache
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47485c9c-1bad-50ad-852f-b34d84901639
2026-03-27 16:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F7b10f309fb774e47ac3d11d5eed24bd7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/6.jpg not downloaded yet
2026-03-27 16:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F7b10f309fb774e47ac3d11d5eed24bd7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/7.jpg not downloaded yet
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591003350>
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47485c9c-1bad-50ad-852f-b34d84901639/47485c9c-1bad-50ad-852f-b34d84901639_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fdf229e8b24da40b69f64e0c6d46e7f17%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/3.jpg saved to cache
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47485c9c-1bad-50ad-852f-b34d84901639
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905123d0>
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47485c9c-1bad-50ad-852f-b34d84901639/47485c9c-1bad-50ad-852f-b34d84901639_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fdf229e8b24da40b69f64e0c6d46e7f17%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/2.jpg saved to cache
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47485c9c-1bad-50ad-852f-b34d84901639
2026-03-27 16:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F7b10f309fb774e47ac3d11d5eed24bd7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/8.jpg not downloaded yet
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ac7d50>
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47485c9c-1bad-50ad-852f-b34d84901639/47485c9c-1bad-50ad-852f-b34d84901639_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fdf229e8b24da40b69f64e0c6d46e7f17%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/4.jpg saved to cache
2026-03-27 16:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47485c9c-1bad-50ad-852f-b34d84901639
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590aea310>
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47485c9c-1bad-50ad-852f-b34d84901639/47485c9c-1bad-50ad-852f-b34d84901639_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fdf229e8b24da40b69f64e0c6d46e7f17%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/5.jpg saved to cache
2026-03-27 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47485c9c-1bad-50ad-852f-b34d84901639
2026-03-27 16:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df4390>
2026-03-27 16:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b32d88ed-43e5-5582-923e-523c13f165df/b32d88ed-43e5-5582-923e-523c13f165df_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fe8d514b2f64846a5a90c9418e450d275%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/8.jpg saved to cache
2026-03-27 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b32d88ed-43e5-5582-923e-523c13f165df
2026-03-27 16:46:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b32d88ed-43e5-5582-923e-523c13f165df, skipping ID generation
2026-03-27 16:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b32d88ed-43e5-5582-923e-523c13f165df with scrape type 1
2026-03-27 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b32d88ed-43e5-5582-923e-523c13f165df sending to next pipeline
2026-03-27 16:46:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b32d88ed-43e5-5582-923e-523c13f165df, identifier: 1988265
2026-03-27 16:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2c610>
2026-03-27 16:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47485c9c-1bad-50ad-852f-b34d84901639/47485c9c-1bad-50ad-852f-b34d84901639_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fdf229e8b24da40b69f64e0c6d46e7f17%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/6.jpg saved to cache
2026-03-27 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47485c9c-1bad-50ad-852f-b34d84901639
2026-03-27 16:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:46:58 [ayvens.fr] INFO: Found listing with ID: 1988268
2026-03-27 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988268%27 HTTP/1.1" 200 None
2026-03-27 16:46:58 [ayvens.fr] INFO: Scrape type for 1988268: 1
2026-03-27 16:46:58 [ayvens.fr] INFO: Extracting data for car ID: 1988268
2026-03-27 16:46:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a592184f-18b5-5aa0-aa7d-6509d900aa22 with identifier: 1988268
2026-03-27 16:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a592184f-18b5-5aa0-aa7d-6509d900aa22 with scrape type 1
2026-03-27 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a592184f-18b5-5aa0-aa7d-6509d900aa22
2026-03-27 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3b3bffc8458341669884c599defa050e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/1.jpg not downloaded yet
2026-03-27 16:46:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b32d88ed-43e5-5582-923e-523c13f165df with identifier: 1988265
2026-03-27 16:46:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b32d88ed-43e5-5582-923e-523c13f165df with identifier: 1988265
2026-03-27 16:46:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b32d88ed-43e5-5582-923e-523c13f165df with identifier: 1988265 to the API
2026-03-27 16:46:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:46:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:46:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 147,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'b32d88ed-43e5-5582-923e-523c13f165df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 77434,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b32d88ed-43e5-5582-923e-523c13f165df/b32d88ed-43e5-5582-923e-523c13f165df_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 473206,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b32d88ed-43e5-5582-923e-523c13f165df/b32d88ed-43e5-5582-923e-523c13f165df_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 473206,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b32d88ed-43e5-5582-923e-523c13f165df/b32d88ed-43e5-5582-923e-523c13f165df_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510516,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b32d88ed-43e5-5582-923e-523c13f165df/b32d88ed-43e5-5582-923e-523c13f165df_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424491,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b32d88ed-43e5-5582-923e-523c13f165df/b32d88ed-43e5-5582-923e-523c13f165df_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309423,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b32d88ed-43e5-5582-923e-523c13f165df/b32d88ed-43e5-5582-923e-523c13f165df_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358401,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b32d88ed-43e5-5582-923e-523c13f165df/b32d88ed-43e5-5582-923e-523c13f165df_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297989,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b32d88ed-43e5-5582-923e-523c13f165df/b32d88ed-43e5-5582-923e-523c13f165df_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 531404,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/e8d514b2f64846a5a90c9418e450d275/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-05',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch S&S Style EAT8',
'transmission': 'automatic',
'trim': '3008 1.2 PureTech 130ch S&S Style EAT8',
'vin': None,
'year': 2022}
2026-03-27 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988265%27 HTTP/1.1" 200 None
2026-03-27 16:46:59 [ayvens.fr] INFO: Saving data for 1988265: {'created_time': 1774630019.867308, 'last_price_update_time': 1774630019.86732, 'auction_closing_time': 1774969200.0}
2026-03-27 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988265') HTTP/1.1" 204 0
2026-03-27 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3b3bffc8458341669884c599defa050e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/2.jpg not downloaded yet
2026-03-27 16:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59f04da50>
2026-03-27 16:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47485c9c-1bad-50ad-852f-b34d84901639/47485c9c-1bad-50ad-852f-b34d84901639_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fdf229e8b24da40b69f64e0c6d46e7f17%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/7.jpg saved to cache
2026-03-27 16:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47485c9c-1bad-50ad-852f-b34d84901639
2026-03-27 16:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3b3bffc8458341669884c599defa050e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/3.jpg not downloaded yet
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903cc650>
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47485c9c-1bad-50ad-852f-b34d84901639/47485c9c-1bad-50ad-852f-b34d84901639_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fdf229e8b24da40b69f64e0c6d46e7f17%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/8.jpg saved to cache
2026-03-27 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47485c9c-1bad-50ad-852f-b34d84901639
2026-03-27 16:47:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47485c9c-1bad-50ad-852f-b34d84901639, skipping ID generation
2026-03-27 16:47:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47485c9c-1bad-50ad-852f-b34d84901639 with scrape type 1
2026-03-27 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47485c9c-1bad-50ad-852f-b34d84901639 sending to next pipeline
2026-03-27 16:47:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 47485c9c-1bad-50ad-852f-b34d84901639, identifier: 1988266
2026-03-27 16:47:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 47485c9c-1bad-50ad-852f-b34d84901639 with identifier: 1988266
2026-03-27 16:47:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:47:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 47485c9c-1bad-50ad-852f-b34d84901639 with identifier: 1988266
2026-03-27 16:47:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 47485c9c-1bad-50ad-852f-b34d84901639 with identifier: 1988266 to the API
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 135,
'color': 'NOIR PERLA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '47485c9c-1bad-50ad-852f-b34d84901639',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 63907,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47485c9c-1bad-50ad-852f-b34d84901639/47485c9c-1bad-50ad-852f-b34d84901639_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385611,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47485c9c-1bad-50ad-852f-b34d84901639/47485c9c-1bad-50ad-852f-b34d84901639_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385611,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47485c9c-1bad-50ad-852f-b34d84901639/47485c9c-1bad-50ad-852f-b34d84901639_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354176,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47485c9c-1bad-50ad-852f-b34d84901639/47485c9c-1bad-50ad-852f-b34d84901639_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361157,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47485c9c-1bad-50ad-852f-b34d84901639/47485c9c-1bad-50ad-852f-b34d84901639_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414977,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47485c9c-1bad-50ad-852f-b34d84901639/47485c9c-1bad-50ad-852f-b34d84901639_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331335,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47485c9c-1bad-50ad-852f-b34d84901639/47485c9c-1bad-50ad-852f-b34d84901639_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389740,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47485c9c-1bad-50ad-852f-b34d84901639/47485c9c-1bad-50ad-852f-b34d84901639_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349344,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/df229e8b24da40b69f64e0c6d46e7f17/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-06',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '3008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'vin': None,
'year': 2020}
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988266%27 HTTP/1.1" 200 None
2026-03-27 16:47:00 [ayvens.fr] INFO: Saving data for 1988266: {'created_time': 1774630020.592081, 'last_price_update_time': 1774630020.592094, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988266') HTTP/1.1" 204 0
2026-03-27 16:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3b3bffc8458341669884c599defa050e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/4.jpg not downloaded yet
2026-03-27 16:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3b3bffc8458341669884c599defa050e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/5.jpg not downloaded yet
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3b3bffc8458341669884c599defa050e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/6.jpg not downloaded yet
2026-03-27 16:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3b3bffc8458341669884c599defa050e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/7.jpg not downloaded yet
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3b3bffc8458341669884c599defa050e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/8.jpg not downloaded yet
2026-03-27 16:47:00 [ayvens.fr] INFO: Found listing with ID: 1988269
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988269%27 HTTP/1.1" 200 None
2026-03-27 16:47:00 [ayvens.fr] INFO: Scrape type for 1988269: 1
2026-03-27 16:47:00 [ayvens.fr] INFO: Extracting data for car ID: 1988269
2026-03-27 16:47:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21ea5af5-85bf-523d-ade1-1120380b9d35 with identifier: 1988269
2026-03-27 16:47:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21ea5af5-85bf-523d-ade1-1120380b9d35 with scrape type 1
2026-03-27 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 21ea5af5-85bf-523d-ade1-1120380b9d35
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb693bd9af4bf45d1b7e836d5b0acaed8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/1.jpg not downloaded yet
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb693bd9af4bf45d1b7e836d5b0acaed8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/2.jpg not downloaded yet
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d81190>
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52c3c9d6-ba4c-5c08-96b2-ab539ee26686/52c3c9d6-ba4c-5c08-96b2-ab539ee26686_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F7b10f309fb774e47ac3d11d5eed24bd7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/1.jpg saved to cache
2026-03-27 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52c3c9d6-ba4c-5c08-96b2-ab539ee26686
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590597f90>
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52c3c9d6-ba4c-5c08-96b2-ab539ee26686/52c3c9d6-ba4c-5c08-96b2-ab539ee26686_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F7b10f309fb774e47ac3d11d5eed24bd7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/2.jpg saved to cache
2026-03-27 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 52c3c9d6-ba4c-5c08-96b2-ab539ee26686
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591444110>
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52c3c9d6-ba4c-5c08-96b2-ab539ee26686/52c3c9d6-ba4c-5c08-96b2-ab539ee26686_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F7b10f309fb774e47ac3d11d5eed24bd7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/3.jpg saved to cache
2026-03-27 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 52c3c9d6-ba4c-5c08-96b2-ab539ee26686
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4fcd0>
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52c3c9d6-ba4c-5c08-96b2-ab539ee26686/52c3c9d6-ba4c-5c08-96b2-ab539ee26686_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F7b10f309fb774e47ac3d11d5eed24bd7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/6.jpg saved to cache
2026-03-27 16:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 52c3c9d6-ba4c-5c08-96b2-ab539ee26686
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d82c90>
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52c3c9d6-ba4c-5c08-96b2-ab539ee26686/52c3c9d6-ba4c-5c08-96b2-ab539ee26686_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F7b10f309fb774e47ac3d11d5eed24bd7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/5.jpg saved to cache
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 52c3c9d6-ba4c-5c08-96b2-ab539ee26686
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d43c10>
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52c3c9d6-ba4c-5c08-96b2-ab539ee26686/52c3c9d6-ba4c-5c08-96b2-ab539ee26686_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F7b10f309fb774e47ac3d11d5eed24bd7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/4.jpg saved to cache
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 52c3c9d6-ba4c-5c08-96b2-ab539ee26686
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb693bd9af4bf45d1b7e836d5b0acaed8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/3.jpg not downloaded yet
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abba50>
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52c3c9d6-ba4c-5c08-96b2-ab539ee26686/52c3c9d6-ba4c-5c08-96b2-ab539ee26686_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F7b10f309fb774e47ac3d11d5eed24bd7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/7.jpg saved to cache
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 52c3c9d6-ba4c-5c08-96b2-ab539ee26686
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb693bd9af4bf45d1b7e836d5b0acaed8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/4.jpg not downloaded yet
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb693bd9af4bf45d1b7e836d5b0acaed8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/5.jpg not downloaded yet
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f11ad0>
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52c3c9d6-ba4c-5c08-96b2-ab539ee26686/52c3c9d6-ba4c-5c08-96b2-ab539ee26686_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F7b10f309fb774e47ac3d11d5eed24bd7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/8.jpg saved to cache
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 52c3c9d6-ba4c-5c08-96b2-ab539ee26686
2026-03-27 16:47:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 52c3c9d6-ba4c-5c08-96b2-ab539ee26686, skipping ID generation
2026-03-27 16:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52c3c9d6-ba4c-5c08-96b2-ab539ee26686 with scrape type 1
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52c3c9d6-ba4c-5c08-96b2-ab539ee26686 sending to next pipeline
2026-03-27 16:47:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 52c3c9d6-ba4c-5c08-96b2-ab539ee26686, identifier: 1988267
2026-03-27 16:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 52c3c9d6-ba4c-5c08-96b2-ab539ee26686 with identifier: 1988267
2026-03-27 16:47:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 52c3c9d6-ba4c-5c08-96b2-ab539ee26686 with identifier: 1988267
2026-03-27 16:47:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 52c3c9d6-ba4c-5c08-96b2-ab539ee26686 with identifier: 1988267 to the API
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '52c3c9d6-ba4c-5c08-96b2-ab539ee26686',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 28937,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c3c9d6-ba4c-5c08-96b2-ab539ee26686/52c3c9d6-ba4c-5c08-96b2-ab539ee26686_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 522946,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c3c9d6-ba4c-5c08-96b2-ab539ee26686/52c3c9d6-ba4c-5c08-96b2-ab539ee26686_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 522946,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c3c9d6-ba4c-5c08-96b2-ab539ee26686/52c3c9d6-ba4c-5c08-96b2-ab539ee26686_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438841,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c3c9d6-ba4c-5c08-96b2-ab539ee26686/52c3c9d6-ba4c-5c08-96b2-ab539ee26686_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356001,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c3c9d6-ba4c-5c08-96b2-ab539ee26686/52c3c9d6-ba4c-5c08-96b2-ab539ee26686_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330819,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c3c9d6-ba4c-5c08-96b2-ab539ee26686/52c3c9d6-ba4c-5c08-96b2-ab539ee26686_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374290,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c3c9d6-ba4c-5c08-96b2-ab539ee26686/52c3c9d6-ba4c-5c08-96b2-ab539ee26686_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172793,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c3c9d6-ba4c-5c08-96b2-ab539ee26686/52c3c9d6-ba4c-5c08-96b2-ab539ee26686_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 396079,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/7b10f309fb774e47ac3d11d5eed24bd7/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-06',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 130ch S&S GT EAT8',
'transmission': 'automatic',
'trim': '2008 1.2 PureTech 130ch S&S GT EAT8',
'vin': None,
'year': 2022}
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988267%27 HTTP/1.1" 200 None
2026-03-27 16:47:01 [ayvens.fr] INFO: Saving data for 1988267: {'created_time': 1774630021.630111, 'last_price_update_time': 1774630021.630122, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988267') HTTP/1.1" 204 0
2026-03-27 16:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb693bd9af4bf45d1b7e836d5b0acaed8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/6.jpg not downloaded yet
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb693bd9af4bf45d1b7e836d5b0acaed8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/7.jpg not downloaded yet
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a00d0>
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a592184f-18b5-5aa0-aa7d-6509d900aa22/a592184f-18b5-5aa0-aa7d-6509d900aa22_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3b3bffc8458341669884c599defa050e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/4.jpg saved to cache
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a592184f-18b5-5aa0-aa7d-6509d900aa22
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592c2f810>
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a592184f-18b5-5aa0-aa7d-6509d900aa22/a592184f-18b5-5aa0-aa7d-6509d900aa22_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3b3bffc8458341669884c599defa050e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/7.jpg saved to cache
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a592184f-18b5-5aa0-aa7d-6509d900aa22
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb693bd9af4bf45d1b7e836d5b0acaed8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/8.jpg not downloaded yet
2026-03-27 16:47:01 [ayvens.fr] INFO: Found listing with ID: 1988270
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988270%27 HTTP/1.1" 200 None
2026-03-27 16:47:01 [ayvens.fr] INFO: Scrape type for 1988270: 1
2026-03-27 16:47:01 [ayvens.fr] INFO: Extracting data for car ID: 1988270
2026-03-27 16:47:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71ee2234-111d-54df-ba03-ac9ab6804561 with identifier: 1988270
2026-03-27 16:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71ee2234-111d-54df-ba03-ac9ab6804561 with scrape type 1
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 71ee2234-111d-54df-ba03-ac9ab6804561
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F30dc1b9a61dd403eb3aca83f2702f8c1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/1.jpg not downloaded yet
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b582d0>
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a592184f-18b5-5aa0-aa7d-6509d900aa22/a592184f-18b5-5aa0-aa7d-6509d900aa22_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3b3bffc8458341669884c599defa050e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/1.jpg saved to cache
2026-03-27 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a592184f-18b5-5aa0-aa7d-6509d900aa22
2026-03-27 16:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d80c10>
2026-03-27 16:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a592184f-18b5-5aa0-aa7d-6509d900aa22/a592184f-18b5-5aa0-aa7d-6509d900aa22_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3b3bffc8458341669884c599defa050e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/2.jpg saved to cache
2026-03-27 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a592184f-18b5-5aa0-aa7d-6509d900aa22
2026-03-27 16:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b2910>
2026-03-27 16:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a592184f-18b5-5aa0-aa7d-6509d900aa22/a592184f-18b5-5aa0-aa7d-6509d900aa22_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3b3bffc8458341669884c599defa050e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/3.jpg saved to cache
2026-03-27 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a592184f-18b5-5aa0-aa7d-6509d900aa22
2026-03-27 16:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d40c90>
2026-03-27 16:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a592184f-18b5-5aa0-aa7d-6509d900aa22/a592184f-18b5-5aa0-aa7d-6509d900aa22_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3b3bffc8458341669884c599defa050e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/5.jpg saved to cache
2026-03-27 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a592184f-18b5-5aa0-aa7d-6509d900aa22
2026-03-27 16:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903cf310>
2026-03-27 16:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a592184f-18b5-5aa0-aa7d-6509d900aa22/a592184f-18b5-5aa0-aa7d-6509d900aa22_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3b3bffc8458341669884c599defa050e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/6.jpg saved to cache
2026-03-27 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a592184f-18b5-5aa0-aa7d-6509d900aa22
2026-03-27 16:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b67790>
2026-03-27 16:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a592184f-18b5-5aa0-aa7d-6509d900aa22/a592184f-18b5-5aa0-aa7d-6509d900aa22_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3b3bffc8458341669884c599defa050e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/8.jpg saved to cache
2026-03-27 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a592184f-18b5-5aa0-aa7d-6509d900aa22
2026-03-27 16:47:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a592184f-18b5-5aa0-aa7d-6509d900aa22, skipping ID generation
2026-03-27 16:47:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a592184f-18b5-5aa0-aa7d-6509d900aa22 with scrape type 1
2026-03-27 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a592184f-18b5-5aa0-aa7d-6509d900aa22 sending to next pipeline
2026-03-27 16:47:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a592184f-18b5-5aa0-aa7d-6509d900aa22, identifier: 1988268
2026-03-27 16:47:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a592184f-18b5-5aa0-aa7d-6509d900aa22 with identifier: 1988268
2026-03-27 16:47:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:47:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a592184f-18b5-5aa0-aa7d-6509d900aa22 with identifier: 1988268
2026-03-27 16:47:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a592184f-18b5-5aa0-aa7d-6509d900aa22 with identifier: 1988268 to the API
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'color': 'GRIS INDIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'a592184f-18b5-5aa0-aa7d-6509d900aa22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 103645,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a592184f-18b5-5aa0-aa7d-6509d900aa22/a592184f-18b5-5aa0-aa7d-6509d900aa22_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431329,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a592184f-18b5-5aa0-aa7d-6509d900aa22/a592184f-18b5-5aa0-aa7d-6509d900aa22_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431329,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a592184f-18b5-5aa0-aa7d-6509d900aa22/a592184f-18b5-5aa0-aa7d-6509d900aa22_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387153,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a592184f-18b5-5aa0-aa7d-6509d900aa22/a592184f-18b5-5aa0-aa7d-6509d900aa22_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386205,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a592184f-18b5-5aa0-aa7d-6509d900aa22/a592184f-18b5-5aa0-aa7d-6509d900aa22_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388736,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a592184f-18b5-5aa0-aa7d-6509d900aa22/a592184f-18b5-5aa0-aa7d-6509d900aa22_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353322,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a592184f-18b5-5aa0-aa7d-6509d900aa22/a592184f-18b5-5aa0-aa7d-6509d900aa22_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317360,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a592184f-18b5-5aa0-aa7d-6509d900aa22/a592184f-18b5-5aa0-aa7d-6509d900aa22_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343202,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3b3bffc8458341669884c599defa050e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-04',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN GOLF Golf 1.0 TSI 115ch Confortline Business DSG7',
'transmission': 'automatic',
'trim': 'Golf 1.0 TSI 115ch Confortline Business DSG7',
'vin': None,
'year': 2019}
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988268%27 HTTP/1.1" 200 None
2026-03-27 16:47:02 [ayvens.fr] INFO: Saving data for 1988268: {'created_time': 1774630022.821047, 'last_price_update_time': 1774630022.821062, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988268') HTTP/1.1" 204 0
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F30dc1b9a61dd403eb3aca83f2702f8c1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/2.jpg not downloaded yet
2026-03-27 16:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F30dc1b9a61dd403eb3aca83f2702f8c1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/3.jpg not downloaded yet
2026-03-27 16:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F30dc1b9a61dd403eb3aca83f2702f8c1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/4.jpg not downloaded yet
2026-03-27 16:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F30dc1b9a61dd403eb3aca83f2702f8c1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/5.jpg not downloaded yet
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F30dc1b9a61dd403eb3aca83f2702f8c1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/6.jpg not downloaded yet
2026-03-27 16:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F30dc1b9a61dd403eb3aca83f2702f8c1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/7.jpg not downloaded yet
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F30dc1b9a61dd403eb3aca83f2702f8c1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/8.jpg not downloaded yet
2026-03-27 16:47:03 [ayvens.fr] INFO: Found listing with ID: 1988271
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988271%27 HTTP/1.1" 200 None
2026-03-27 16:47:03 [ayvens.fr] INFO: Scrape type for 1988271: 1
2026-03-27 16:47:03 [ayvens.fr] INFO: Extracting data for car ID: 1988271
2026-03-27 16:47:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3a323c3-6d84-5c47-b3bb-ce24f5302d48 with identifier: 1988271
2026-03-27 16:47:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3a323c3-6d84-5c47-b3bb-ce24f5302d48 with scrape type 1
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b3a323c3-6d84-5c47-b3bb-ce24f5302d48
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fb0f7c6cfb38e40de8e7132927e1df628%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/1.jpg not downloaded yet
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904d7050>
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21ea5af5-85bf-523d-ade1-1120380b9d35/21ea5af5-85bf-523d-ade1-1120380b9d35_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb693bd9af4bf45d1b7e836d5b0acaed8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/5.jpg saved to cache
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21ea5af5-85bf-523d-ade1-1120380b9d35
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fb0f7c6cfb38e40de8e7132927e1df628%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/2.jpg not downloaded yet
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa1550>
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21ea5af5-85bf-523d-ade1-1120380b9d35/21ea5af5-85bf-523d-ade1-1120380b9d35_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb693bd9af4bf45d1b7e836d5b0acaed8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/3.jpg saved to cache
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21ea5af5-85bf-523d-ade1-1120380b9d35
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abe0d0>
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21ea5af5-85bf-523d-ade1-1120380b9d35/21ea5af5-85bf-523d-ade1-1120380b9d35_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb693bd9af4bf45d1b7e836d5b0acaed8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/1.jpg saved to cache
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21ea5af5-85bf-523d-ade1-1120380b9d35
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe2110>
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21ea5af5-85bf-523d-ade1-1120380b9d35/21ea5af5-85bf-523d-ade1-1120380b9d35_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb693bd9af4bf45d1b7e836d5b0acaed8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/4.jpg saved to cache
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21ea5af5-85bf-523d-ade1-1120380b9d35
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903dc310>
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21ea5af5-85bf-523d-ade1-1120380b9d35/21ea5af5-85bf-523d-ade1-1120380b9d35_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb693bd9af4bf45d1b7e836d5b0acaed8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/7.jpg saved to cache
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21ea5af5-85bf-523d-ade1-1120380b9d35
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904d7910>
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21ea5af5-85bf-523d-ade1-1120380b9d35/21ea5af5-85bf-523d-ade1-1120380b9d35_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb693bd9af4bf45d1b7e836d5b0acaed8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/6.jpg saved to cache
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21ea5af5-85bf-523d-ade1-1120380b9d35
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d2610>
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21ea5af5-85bf-523d-ade1-1120380b9d35/21ea5af5-85bf-523d-ade1-1120380b9d35_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb693bd9af4bf45d1b7e836d5b0acaed8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/2.jpg saved to cache
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21ea5af5-85bf-523d-ade1-1120380b9d35
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b2a410>
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21ea5af5-85bf-523d-ade1-1120380b9d35/21ea5af5-85bf-523d-ade1-1120380b9d35_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fb693bd9af4bf45d1b7e836d5b0acaed8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/8.jpg saved to cache
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21ea5af5-85bf-523d-ade1-1120380b9d35
2026-03-27 16:47:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21ea5af5-85bf-523d-ade1-1120380b9d35, skipping ID generation
2026-03-27 16:47:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21ea5af5-85bf-523d-ade1-1120380b9d35 with scrape type 1
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21ea5af5-85bf-523d-ade1-1120380b9d35 sending to next pipeline
2026-03-27 16:47:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 21ea5af5-85bf-523d-ade1-1120380b9d35, identifier: 1988269
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fb0f7c6cfb38e40de8e7132927e1df628%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/3.jpg not downloaded yet
2026-03-27 16:47:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 21ea5af5-85bf-523d-ade1-1120380b9d35 with identifier: 1988269
2026-03-27 16:47:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:47:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 21ea5af5-85bf-523d-ade1-1120380b9d35 with identifier: 1988269
2026-03-27 16:47:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 21ea5af5-85bf-523d-ade1-1120380b9d35 with identifier: 1988269 to the API
2026-03-27 16:47:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'OCEAN GREEN',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '21ea5af5-85bf-523d-ade1-1120380b9d35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 28681,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21ea5af5-85bf-523d-ade1-1120380b9d35/21ea5af5-85bf-523d-ade1-1120380b9d35_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450099,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21ea5af5-85bf-523d-ade1-1120380b9d35/21ea5af5-85bf-523d-ade1-1120380b9d35_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450099,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21ea5af5-85bf-523d-ade1-1120380b9d35/21ea5af5-85bf-523d-ade1-1120380b9d35_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409327,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21ea5af5-85bf-523d-ade1-1120380b9d35/21ea5af5-85bf-523d-ade1-1120380b9d35_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 487700,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21ea5af5-85bf-523d-ade1-1120380b9d35/21ea5af5-85bf-523d-ade1-1120380b9d35_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364511,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21ea5af5-85bf-523d-ade1-1120380b9d35/21ea5af5-85bf-523d-ade1-1120380b9d35_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21ea5af5-85bf-523d-ade1-1120380b9d35/21ea5af5-85bf-523d-ade1-1120380b9d35_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301011,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21ea5af5-85bf-523d-ade1-1120380b9d35/21ea5af5-85bf-523d-ade1-1120380b9d35_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324239,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/b693bd9af4bf45d1b7e836d5b0acaed8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-24',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 e 118ch Icone',
'transmission': 'automatic',
'trim': '500 e 118ch Icone',
'vin': None,
'year': 2022}
2026-03-27 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988269%27 HTTP/1.1" 200 None
2026-03-27 16:47:04 [ayvens.fr] INFO: Saving data for 1988269: {'created_time': 1774630024.965088, 'last_price_update_time': 1774630024.965098, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988269') HTTP/1.1" 204 0
2026-03-27 16:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fb0f7c6cfb38e40de8e7132927e1df628%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/4.jpg not downloaded yet
2026-03-27 16:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fb0f7c6cfb38e40de8e7132927e1df628%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/5.jpg not downloaded yet
2026-03-27 16:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fb0f7c6cfb38e40de8e7132927e1df628%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/6.jpg not downloaded yet
2026-03-27 16:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fb0f7c6cfb38e40de8e7132927e1df628%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/7.jpg not downloaded yet
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fb0f7c6cfb38e40de8e7132927e1df628%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/8.jpg not downloaded yet
2026-03-27 16:47:05 [ayvens.fr] INFO: Found listing with ID: 1988272
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988272%27 HTTP/1.1" 200 None
2026-03-27 16:47:05 [ayvens.fr] INFO: Scrape type for 1988272: 1
2026-03-27 16:47:05 [ayvens.fr] INFO: Extracting data for car ID: 1988272
2026-03-27 16:47:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6565e6b4-dccd-5101-b94f-c73b5a460b2c with identifier: 1988272
2026-03-27 16:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6565e6b4-dccd-5101-b94f-c73b5a460b2c with scrape type 1
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6565e6b4-dccd-5101-b94f-c73b5a460b2c
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe4159f05b13403d82f3e71e8be2de2a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/1.jpg not downloaded yet
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe4159f05b13403d82f3e71e8be2de2a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/2.jpg not downloaded yet
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b34bd0>
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ee2234-111d-54df-ba03-ac9ab6804561/71ee2234-111d-54df-ba03-ac9ab6804561_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F30dc1b9a61dd403eb3aca83f2702f8c1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/3.jpg saved to cache
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71ee2234-111d-54df-ba03-ac9ab6804561
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe4159f05b13403d82f3e71e8be2de2a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/3.jpg not downloaded yet
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6e0d0>
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ee2234-111d-54df-ba03-ac9ab6804561/71ee2234-111d-54df-ba03-ac9ab6804561_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F30dc1b9a61dd403eb3aca83f2702f8c1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/4.jpg saved to cache
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71ee2234-111d-54df-ba03-ac9ab6804561
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe0290>
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ee2234-111d-54df-ba03-ac9ab6804561/71ee2234-111d-54df-ba03-ac9ab6804561_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F30dc1b9a61dd403eb3aca83f2702f8c1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/5.jpg saved to cache
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71ee2234-111d-54df-ba03-ac9ab6804561
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066e110>
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ee2234-111d-54df-ba03-ac9ab6804561/71ee2234-111d-54df-ba03-ac9ab6804561_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F30dc1b9a61dd403eb3aca83f2702f8c1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/2.jpg saved to cache
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71ee2234-111d-54df-ba03-ac9ab6804561
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd13d0>
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ee2234-111d-54df-ba03-ac9ab6804561/71ee2234-111d-54df-ba03-ac9ab6804561_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F30dc1b9a61dd403eb3aca83f2702f8c1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/6.jpg saved to cache
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 71ee2234-111d-54df-ba03-ac9ab6804561
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590aff690>
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ee2234-111d-54df-ba03-ac9ab6804561/71ee2234-111d-54df-ba03-ac9ab6804561_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F30dc1b9a61dd403eb3aca83f2702f8c1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/7.jpg saved to cache
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 71ee2234-111d-54df-ba03-ac9ab6804561
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe4159f05b13403d82f3e71e8be2de2a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/4.jpg not downloaded yet
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe4159f05b13403d82f3e71e8be2de2a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/5.jpg not downloaded yet
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e16810>
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ee2234-111d-54df-ba03-ac9ab6804561/71ee2234-111d-54df-ba03-ac9ab6804561_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F30dc1b9a61dd403eb3aca83f2702f8c1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/1.jpg saved to cache
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71ee2234-111d-54df-ba03-ac9ab6804561
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904d5110>
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71ee2234-111d-54df-ba03-ac9ab6804561/71ee2234-111d-54df-ba03-ac9ab6804561_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F30dc1b9a61dd403eb3aca83f2702f8c1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/8.jpg saved to cache
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 71ee2234-111d-54df-ba03-ac9ab6804561
2026-03-27 16:47:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71ee2234-111d-54df-ba03-ac9ab6804561, skipping ID generation
2026-03-27 16:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71ee2234-111d-54df-ba03-ac9ab6804561 with scrape type 1
2026-03-27 16:47:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71ee2234-111d-54df-ba03-ac9ab6804561 sending to next pipeline
2026-03-27 16:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 71ee2234-111d-54df-ba03-ac9ab6804561, identifier: 1988270
2026-03-27 16:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 71ee2234-111d-54df-ba03-ac9ab6804561 with identifier: 1988270
2026-03-27 16:47:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:47:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 71ee2234-111d-54df-ba03-ac9ab6804561 with identifier: 1988270
2026-03-27 16:47:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 71ee2234-111d-54df-ba03-ac9ab6804561 with identifier: 1988270 to the API
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-03-27 16:47:06 [crawlers.pipelines.post_to_api] ERROR: ayvens.fr, item_id 71ee2234-111d-54df-ba03-ac9ab6804561: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"Color","ErrorMessage":"color value can only be expressed in letters","ErrorCode":0}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 27 Mar 2026 16:47:05 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-03-27 16:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '71ee2234-111d-54df-ba03-ac9ab6804561',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 140123,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71ee2234-111d-54df-ba03-ac9ab6804561/71ee2234-111d-54df-ba03-ac9ab6804561_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532546,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71ee2234-111d-54df-ba03-ac9ab6804561/71ee2234-111d-54df-ba03-ac9ab6804561_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532546,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71ee2234-111d-54df-ba03-ac9ab6804561/71ee2234-111d-54df-ba03-ac9ab6804561_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329857,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71ee2234-111d-54df-ba03-ac9ab6804561/71ee2234-111d-54df-ba03-ac9ab6804561_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302063,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71ee2234-111d-54df-ba03-ac9ab6804561/71ee2234-111d-54df-ba03-ac9ab6804561_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343930,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71ee2234-111d-54df-ba03-ac9ab6804561/71ee2234-111d-54df-ba03-ac9ab6804561_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376631,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71ee2234-111d-54df-ba03-ac9ab6804561/71ee2234-111d-54df-ba03-ac9ab6804561_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210325,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71ee2234-111d-54df-ba03-ac9ab6804561/71ee2234-111d-54df-ba03-ac9ab6804561_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414030,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/30dc1b9a61dd403eb3aca83f2702f8c1/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 SW 308 SW 1.5 BlueHDi 130ch S&S Active Pack EAT8',
'transmission': 'automatic',
'trim': '308 SW 1.5 BlueHDi 130ch S&S Active Pack EAT8',
'vin': None,
'year': 2022}
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988270%27 HTTP/1.1" 200 None
2026-03-27 16:47:06 [ayvens.fr] INFO: Saving data for 1988270: {'created_time': 1774630026.159279, 'last_price_update_time': 1774630026.159289, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988270') HTTP/1.1" 204 0
2026-03-27 16:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe4159f05b13403d82f3e71e8be2de2a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/6.jpg not downloaded yet
2026-03-27 16:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe4159f05b13403d82f3e71e8be2de2a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/7.jpg not downloaded yet
2026-03-27 16:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911cb350>
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a323c3-6d84-5c47-b3bb-ce24f5302d48/b3a323c3-6d84-5c47-b3bb-ce24f5302d48_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fb0f7c6cfb38e40de8e7132927e1df628%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/4.jpg saved to cache
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3a323c3-6d84-5c47-b3bb-ce24f5302d48
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591112910>
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a323c3-6d84-5c47-b3bb-ce24f5302d48/b3a323c3-6d84-5c47-b3bb-ce24f5302d48_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fb0f7c6cfb38e40de8e7132927e1df628%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/6.jpg saved to cache
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3a323c3-6d84-5c47-b3bb-ce24f5302d48
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b287d0>
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a323c3-6d84-5c47-b3bb-ce24f5302d48/b3a323c3-6d84-5c47-b3bb-ce24f5302d48_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fb0f7c6cfb38e40de8e7132927e1df628%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/8.jpg saved to cache
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3a323c3-6d84-5c47-b3bb-ce24f5302d48
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe4159f05b13403d82f3e71e8be2de2a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/8.jpg not downloaded yet
2026-03-27 16:47:06 [ayvens.fr] INFO: Found listing with ID: 1988273
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988273%27 HTTP/1.1" 200 None
2026-03-27 16:47:06 [ayvens.fr] INFO: Scrape type for 1988273: 1
2026-03-27 16:47:06 [ayvens.fr] INFO: Extracting data for car ID: 1988273
2026-03-27 16:47:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 804edd8e-e020-52f7-9f10-a8995214a571 with identifier: 1988273
2026-03-27 16:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 804edd8e-e020-52f7-9f10-a8995214a571 with scrape type 1
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 804edd8e-e020-52f7-9f10-a8995214a571
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F83f1566c17714f12824c59a5b26182e9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/1.jpg not downloaded yet
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f32b50>
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a323c3-6d84-5c47-b3bb-ce24f5302d48/b3a323c3-6d84-5c47-b3bb-ce24f5302d48_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fb0f7c6cfb38e40de8e7132927e1df628%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/7.jpg saved to cache
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3a323c3-6d84-5c47-b3bb-ce24f5302d48
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa9f10>
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a323c3-6d84-5c47-b3bb-ce24f5302d48/b3a323c3-6d84-5c47-b3bb-ce24f5302d48_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fb0f7c6cfb38e40de8e7132927e1df628%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/3.jpg saved to cache
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3a323c3-6d84-5c47-b3bb-ce24f5302d48
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050e510>
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a323c3-6d84-5c47-b3bb-ce24f5302d48/b3a323c3-6d84-5c47-b3bb-ce24f5302d48_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fb0f7c6cfb38e40de8e7132927e1df628%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/5.jpg saved to cache
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3a323c3-6d84-5c47-b3bb-ce24f5302d48
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5914328d0>
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a323c3-6d84-5c47-b3bb-ce24f5302d48/b3a323c3-6d84-5c47-b3bb-ce24f5302d48_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fb0f7c6cfb38e40de8e7132927e1df628%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/1.jpg saved to cache
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3a323c3-6d84-5c47-b3bb-ce24f5302d48
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050e350>
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a323c3-6d84-5c47-b3bb-ce24f5302d48/b3a323c3-6d84-5c47-b3bb-ce24f5302d48_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fb0f7c6cfb38e40de8e7132927e1df628%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/2.jpg saved to cache
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3a323c3-6d84-5c47-b3bb-ce24f5302d48
2026-03-27 16:47:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3a323c3-6d84-5c47-b3bb-ce24f5302d48, skipping ID generation
2026-03-27 16:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3a323c3-6d84-5c47-b3bb-ce24f5302d48 with scrape type 1
2026-03-27 16:47:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3a323c3-6d84-5c47-b3bb-ce24f5302d48 sending to next pipeline
2026-03-27 16:47:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b3a323c3-6d84-5c47-b3bb-ce24f5302d48, identifier: 1988271
2026-03-27 16:47:06 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at -3 pages/min), scraped 73 items (at 42 items/min)
2026-03-27 16:47:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-27 16:47:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b3a323c3-6d84-5c47-b3bb-ce24f5302d48 with identifier: 1988271
2026-03-27 16:47:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b3a323c3-6d84-5c47-b3bb-ce24f5302d48 with identifier: 1988271
2026-03-27 16:47:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b3a323c3-6d84-5c47-b3bb-ce24f5302d48 with identifier: 1988271 to the API
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'b3a323c3-6d84-5c47-b3bb-ce24f5302d48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'TUCSON',
'odometer': 134763,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3a323c3-6d84-5c47-b3bb-ce24f5302d48/b3a323c3-6d84-5c47-b3bb-ce24f5302d48_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 545497,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3a323c3-6d84-5c47-b3bb-ce24f5302d48/b3a323c3-6d84-5c47-b3bb-ce24f5302d48_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 545497,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3a323c3-6d84-5c47-b3bb-ce24f5302d48/b3a323c3-6d84-5c47-b3bb-ce24f5302d48_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431019,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3a323c3-6d84-5c47-b3bb-ce24f5302d48/b3a323c3-6d84-5c47-b3bb-ce24f5302d48_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395532,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3a323c3-6d84-5c47-b3bb-ce24f5302d48/b3a323c3-6d84-5c47-b3bb-ce24f5302d48_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404304,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3a323c3-6d84-5c47-b3bb-ce24f5302d48/b3a323c3-6d84-5c47-b3bb-ce24f5302d48_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319785,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3a323c3-6d84-5c47-b3bb-ce24f5302d48/b3a323c3-6d84-5c47-b3bb-ce24f5302d48_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3a323c3-6d84-5c47-b3bb-ce24f5302d48/b3a323c3-6d84-5c47-b3bb-ce24f5302d48_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310810,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/b0f7c6cfb38e40de8e7132927e1df628/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-10',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI TUCSON Tucson 1.6 T-GDi 230ch Hybrid Business BVA6',
'transmission': 'automatic',
'trim': 'Tucson 1.6 T-GDi 230ch Hybrid Business BVA6',
'vin': None,
'year': 2023}
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988271%27 HTTP/1.1" 200 None
2026-03-27 16:47:07 [ayvens.fr] INFO: Saving data for 1988271: {'created_time': 1774630027.320027, 'last_price_update_time': 1774630027.320039, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988271') HTTP/1.1" 204 0
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F83f1566c17714f12824c59a5b26182e9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/2.jpg not downloaded yet
2026-03-27 16:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F83f1566c17714f12824c59a5b26182e9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/3.jpg not downloaded yet
2026-03-27 16:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F83f1566c17714f12824c59a5b26182e9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/4.jpg not downloaded yet
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F83f1566c17714f12824c59a5b26182e9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/5.jpg not downloaded yet
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F83f1566c17714f12824c59a5b26182e9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/6.jpg not downloaded yet
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F83f1566c17714f12824c59a5b26182e9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/7.jpg not downloaded yet
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F83f1566c17714f12824c59a5b26182e9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/8.jpg not downloaded yet
2026-03-27 16:47:07 [ayvens.fr] INFO: Found listing with ID: 1988274
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988274%27 HTTP/1.1" 200 None
2026-03-27 16:47:07 [ayvens.fr] INFO: Scrape type for 1988274: 1
2026-03-27 16:47:07 [ayvens.fr] INFO: Extracting data for car ID: 1988274
2026-03-27 16:47:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa55ac30-c81e-563f-a4f8-0f643b907c9d with identifier: 1988274
2026-03-27 16:47:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa55ac30-c81e-563f-a4f8-0f643b907c9d with scrape type 1
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item aa55ac30-c81e-563f-a4f8-0f643b907c9d
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F46aa614ffdb846a288cc0d5cc5c3ce96%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/1.jpg not downloaded yet
2026-03-27 16:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F46aa614ffdb846a288cc0d5cc5c3ce96%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/2.jpg not downloaded yet
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903de5d0>
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6565e6b4-dccd-5101-b94f-c73b5a460b2c/6565e6b4-dccd-5101-b94f-c73b5a460b2c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe4159f05b13403d82f3e71e8be2de2a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/5.jpg saved to cache
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6565e6b4-dccd-5101-b94f-c73b5a460b2c
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590594510>
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6565e6b4-dccd-5101-b94f-c73b5a460b2c/6565e6b4-dccd-5101-b94f-c73b5a460b2c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe4159f05b13403d82f3e71e8be2de2a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/4.jpg saved to cache
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6565e6b4-dccd-5101-b94f-c73b5a460b2c
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de5f10>
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6565e6b4-dccd-5101-b94f-c73b5a460b2c/6565e6b4-dccd-5101-b94f-c73b5a460b2c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe4159f05b13403d82f3e71e8be2de2a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/3.jpg saved to cache
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6565e6b4-dccd-5101-b94f-c73b5a460b2c
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066b890>
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6565e6b4-dccd-5101-b94f-c73b5a460b2c/6565e6b4-dccd-5101-b94f-c73b5a460b2c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe4159f05b13403d82f3e71e8be2de2a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/2.jpg saved to cache
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6565e6b4-dccd-5101-b94f-c73b5a460b2c
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de4c50>
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6565e6b4-dccd-5101-b94f-c73b5a460b2c/6565e6b4-dccd-5101-b94f-c73b5a460b2c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe4159f05b13403d82f3e71e8be2de2a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/1.jpg saved to cache
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6565e6b4-dccd-5101-b94f-c73b5a460b2c
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590669f90>
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6565e6b4-dccd-5101-b94f-c73b5a460b2c/6565e6b4-dccd-5101-b94f-c73b5a460b2c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe4159f05b13403d82f3e71e8be2de2a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/7.jpg saved to cache
2026-03-27 16:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6565e6b4-dccd-5101-b94f-c73b5a460b2c
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904fdfd0>
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6565e6b4-dccd-5101-b94f-c73b5a460b2c/6565e6b4-dccd-5101-b94f-c73b5a460b2c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe4159f05b13403d82f3e71e8be2de2a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/6.jpg saved to cache
2026-03-27 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6565e6b4-dccd-5101-b94f-c73b5a460b2c
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F46aa614ffdb846a288cc0d5cc5c3ce96%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/3.jpg not downloaded yet
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F46aa614ffdb846a288cc0d5cc5c3ce96%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/4.jpg not downloaded yet
2026-03-27 16:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F46aa614ffdb846a288cc0d5cc5c3ce96%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/5.jpg not downloaded yet
2026-03-27 16:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906747d0>
2026-03-27 16:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6565e6b4-dccd-5101-b94f-c73b5a460b2c/6565e6b4-dccd-5101-b94f-c73b5a460b2c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fbe4159f05b13403d82f3e71e8be2de2a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/8.jpg saved to cache
2026-03-27 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6565e6b4-dccd-5101-b94f-c73b5a460b2c
2026-03-27 16:47:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6565e6b4-dccd-5101-b94f-c73b5a460b2c, skipping ID generation
2026-03-27 16:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6565e6b4-dccd-5101-b94f-c73b5a460b2c with scrape type 1
2026-03-27 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6565e6b4-dccd-5101-b94f-c73b5a460b2c sending to next pipeline
2026-03-27 16:47:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6565e6b4-dccd-5101-b94f-c73b5a460b2c, identifier: 1988272
2026-03-27 16:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6565e6b4-dccd-5101-b94f-c73b5a460b2c with identifier: 1988272
2026-03-27 16:47:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6565e6b4-dccd-5101-b94f-c73b5a460b2c with identifier: 1988272
2026-03-27 16:47:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6565e6b4-dccd-5101-b94f-c73b5a460b2c with identifier: 1988272 to the API
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': 'NOIR MYTHIC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '6565e6b4-dccd-5101-b94f-c73b5a460b2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'A3 SPORTBACK',
'odometer': 99537,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6565e6b4-dccd-5101-b94f-c73b5a460b2c/6565e6b4-dccd-5101-b94f-c73b5a460b2c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393455,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6565e6b4-dccd-5101-b94f-c73b5a460b2c/6565e6b4-dccd-5101-b94f-c73b5a460b2c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393455,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6565e6b4-dccd-5101-b94f-c73b5a460b2c/6565e6b4-dccd-5101-b94f-c73b5a460b2c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356696,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6565e6b4-dccd-5101-b94f-c73b5a460b2c/6565e6b4-dccd-5101-b94f-c73b5a460b2c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 390994,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6565e6b4-dccd-5101-b94f-c73b5a460b2c/6565e6b4-dccd-5101-b94f-c73b5a460b2c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325798,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6565e6b4-dccd-5101-b94f-c73b5a460b2c/6565e6b4-dccd-5101-b94f-c73b5a460b2c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306797,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6565e6b4-dccd-5101-b94f-c73b5a460b2c/6565e6b4-dccd-5101-b94f-c73b5a460b2c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308121,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6565e6b4-dccd-5101-b94f-c73b5a460b2c/6565e6b4-dccd-5101-b94f-c73b5a460b2c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246339,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/be4159f05b13403d82f3e71e8be2de2a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-01',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI A3 SPORTBACK A3 Sportback 35 TDI 150ch S tronic 7',
'transmission': 'automatic',
'trim': 'A3 Sportback 35 TDI 150ch S tronic 7',
'vin': None,
'year': 2022}
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988272%27 HTTP/1.1" 200 None
2026-03-27 16:47:08 [ayvens.fr] INFO: Saving data for 1988272: {'created_time': 1774630028.574142, 'last_price_update_time': 1774630028.574155, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988272') HTTP/1.1" 204 0
2026-03-27 16:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F46aa614ffdb846a288cc0d5cc5c3ce96%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/6.jpg not downloaded yet
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F46aa614ffdb846a288cc0d5cc5c3ce96%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/7.jpg not downloaded yet
2026-03-27 16:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590646cd0>
2026-03-27 16:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804edd8e-e020-52f7-9f10-a8995214a571/804edd8e-e020-52f7-9f10-a8995214a571_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F83f1566c17714f12824c59a5b26182e9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/5.jpg saved to cache
2026-03-27 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 804edd8e-e020-52f7-9f10-a8995214a571
2026-03-27 16:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c3e50>
2026-03-27 16:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804edd8e-e020-52f7-9f10-a8995214a571/804edd8e-e020-52f7-9f10-a8995214a571_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F83f1566c17714f12824c59a5b26182e9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/3.jpg saved to cache
2026-03-27 16:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 804edd8e-e020-52f7-9f10-a8995214a571
2026-03-27 16:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59103fe90>
2026-03-27 16:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804edd8e-e020-52f7-9f10-a8995214a571/804edd8e-e020-52f7-9f10-a8995214a571_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F83f1566c17714f12824c59a5b26182e9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/6.jpg saved to cache
2026-03-27 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 804edd8e-e020-52f7-9f10-a8995214a571
2026-03-27 16:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa0290>
2026-03-27 16:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804edd8e-e020-52f7-9f10-a8995214a571/804edd8e-e020-52f7-9f10-a8995214a571_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F83f1566c17714f12824c59a5b26182e9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/7.jpg saved to cache
2026-03-27 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 804edd8e-e020-52f7-9f10-a8995214a571
2026-03-27 16:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F46aa614ffdb846a288cc0d5cc5c3ce96%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/8.jpg not downloaded yet
2026-03-27 16:47:09 [ayvens.fr] INFO: Found listing with ID: 1988275
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988275%27 HTTP/1.1" 200 None
2026-03-27 16:47:09 [ayvens.fr] INFO: Scrape type for 1988275: 1
2026-03-27 16:47:09 [ayvens.fr] INFO: Extracting data for car ID: 1988275
2026-03-27 16:47:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c002d000-bdba-5c51-bcb1-1c7444607bfa with identifier: 1988275
2026-03-27 16:47:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c002d000-bdba-5c51-bcb1-1c7444607bfa with scrape type 1
2026-03-27 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c002d000-bdba-5c51-bcb1-1c7444607bfa
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fddac9d02480049f89e60597294fd34e2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/1.jpg not downloaded yet
2026-03-27 16:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d7a950>
2026-03-27 16:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804edd8e-e020-52f7-9f10-a8995214a571/804edd8e-e020-52f7-9f10-a8995214a571_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F83f1566c17714f12824c59a5b26182e9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/2.jpg saved to cache
2026-03-27 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 804edd8e-e020-52f7-9f10-a8995214a571
2026-03-27 16:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590645950>
2026-03-27 16:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804edd8e-e020-52f7-9f10-a8995214a571/804edd8e-e020-52f7-9f10-a8995214a571_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F83f1566c17714f12824c59a5b26182e9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/1.jpg saved to cache
2026-03-27 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 804edd8e-e020-52f7-9f10-a8995214a571
2026-03-27 16:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df5650>
2026-03-27 16:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804edd8e-e020-52f7-9f10-a8995214a571/804edd8e-e020-52f7-9f10-a8995214a571_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F83f1566c17714f12824c59a5b26182e9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/4.jpg saved to cache
2026-03-27 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 804edd8e-e020-52f7-9f10-a8995214a571
2026-03-27 16:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fddac9d02480049f89e60597294fd34e2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/2.jpg not downloaded yet
2026-03-27 16:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd0a10>
2026-03-27 16:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804edd8e-e020-52f7-9f10-a8995214a571/804edd8e-e020-52f7-9f10-a8995214a571_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F83f1566c17714f12824c59a5b26182e9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/8.jpg saved to cache
2026-03-27 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 804edd8e-e020-52f7-9f10-a8995214a571
2026-03-27 16:47:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 804edd8e-e020-52f7-9f10-a8995214a571, skipping ID generation
2026-03-27 16:47:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 804edd8e-e020-52f7-9f10-a8995214a571 with scrape type 1
2026-03-27 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 804edd8e-e020-52f7-9f10-a8995214a571 sending to next pipeline
2026-03-27 16:47:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 804edd8e-e020-52f7-9f10-a8995214a571, identifier: 1988273
2026-03-27 16:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fddac9d02480049f89e60597294fd34e2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/3.jpg not downloaded yet
2026-03-27 16:47:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 804edd8e-e020-52f7-9f10-a8995214a571 with identifier: 1988273
2026-03-27 16:47:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 804edd8e-e020-52f7-9f10-a8995214a571 with identifier: 1988273
2026-03-27 16:47:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 804edd8e-e020-52f7-9f10-a8995214a571 with identifier: 1988273 to the API
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '804edd8e-e020-52f7-9f10-a8995214a571',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'NIRO EV',
'odometer': 30368,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804edd8e-e020-52f7-9f10-a8995214a571/804edd8e-e020-52f7-9f10-a8995214a571_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555372,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804edd8e-e020-52f7-9f10-a8995214a571/804edd8e-e020-52f7-9f10-a8995214a571_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555372,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804edd8e-e020-52f7-9f10-a8995214a571/804edd8e-e020-52f7-9f10-a8995214a571_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474323,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804edd8e-e020-52f7-9f10-a8995214a571/804edd8e-e020-52f7-9f10-a8995214a571_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387568,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804edd8e-e020-52f7-9f10-a8995214a571/804edd8e-e020-52f7-9f10-a8995214a571_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323430,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804edd8e-e020-52f7-9f10-a8995214a571/804edd8e-e020-52f7-9f10-a8995214a571_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337466,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804edd8e-e020-52f7-9f10-a8995214a571/804edd8e-e020-52f7-9f10-a8995214a571_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313060,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804edd8e-e020-52f7-9f10-a8995214a571/804edd8e-e020-52f7-9f10-a8995214a571_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299175,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/83f1566c17714f12824c59a5b26182e9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-01',
'seats_number': 5,
'seller_name': None,
'title': 'KIA NIRO EV Niro EV 204ch Active Business',
'transmission': 'automatic',
'trim': 'Niro EV 204ch Active Business',
'vin': None,
'year': 2024}
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988273%27 HTTP/1.1" 200 None
2026-03-27 16:47:10 [ayvens.fr] INFO: Saving data for 1988273: {'created_time': 1774630030.076157, 'last_price_update_time': 1774630030.076168, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988273') HTTP/1.1" 204 0
2026-03-27 16:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fddac9d02480049f89e60597294fd34e2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/4.jpg not downloaded yet
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4c150>
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa55ac30-c81e-563f-a4f8-0f643b907c9d/aa55ac30-c81e-563f-a4f8-0f643b907c9d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F46aa614ffdb846a288cc0d5cc5c3ce96%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/1.jpg saved to cache
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa55ac30-c81e-563f-a4f8-0f643b907c9d
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590aeb290>
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa55ac30-c81e-563f-a4f8-0f643b907c9d/aa55ac30-c81e-563f-a4f8-0f643b907c9d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F46aa614ffdb846a288cc0d5cc5c3ce96%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/5.jpg saved to cache
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa55ac30-c81e-563f-a4f8-0f643b907c9d
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fddac9d02480049f89e60597294fd34e2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/5.jpg not downloaded yet
2026-03-27 16:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fddac9d02480049f89e60597294fd34e2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/6.jpg not downloaded yet
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590647350>
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa55ac30-c81e-563f-a4f8-0f643b907c9d/aa55ac30-c81e-563f-a4f8-0f643b907c9d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F46aa614ffdb846a288cc0d5cc5c3ce96%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/4.jpg saved to cache
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa55ac30-c81e-563f-a4f8-0f643b907c9d
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903dc250>
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa55ac30-c81e-563f-a4f8-0f643b907c9d/aa55ac30-c81e-563f-a4f8-0f643b907c9d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F46aa614ffdb846a288cc0d5cc5c3ce96%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/7.jpg saved to cache
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa55ac30-c81e-563f-a4f8-0f643b907c9d
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591002e10>
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa55ac30-c81e-563f-a4f8-0f643b907c9d/aa55ac30-c81e-563f-a4f8-0f643b907c9d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F46aa614ffdb846a288cc0d5cc5c3ce96%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/3.jpg saved to cache
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa55ac30-c81e-563f-a4f8-0f643b907c9d
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050fad0>
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa55ac30-c81e-563f-a4f8-0f643b907c9d/aa55ac30-c81e-563f-a4f8-0f643b907c9d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F46aa614ffdb846a288cc0d5cc5c3ce96%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/2.jpg saved to cache
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa55ac30-c81e-563f-a4f8-0f643b907c9d
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e14f90>
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa55ac30-c81e-563f-a4f8-0f643b907c9d/aa55ac30-c81e-563f-a4f8-0f643b907c9d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F46aa614ffdb846a288cc0d5cc5c3ce96%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/6.jpg saved to cache
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa55ac30-c81e-563f-a4f8-0f643b907c9d
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fddac9d02480049f89e60597294fd34e2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/7.jpg not downloaded yet
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fddac9d02480049f89e60597294fd34e2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/8.jpg not downloaded yet
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b69390>
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa55ac30-c81e-563f-a4f8-0f643b907c9d/aa55ac30-c81e-563f-a4f8-0f643b907c9d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F46aa614ffdb846a288cc0d5cc5c3ce96%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/8.jpg saved to cache
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa55ac30-c81e-563f-a4f8-0f643b907c9d
2026-03-27 16:47:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa55ac30-c81e-563f-a4f8-0f643b907c9d, skipping ID generation
2026-03-27 16:47:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa55ac30-c81e-563f-a4f8-0f643b907c9d with scrape type 1
2026-03-27 16:47:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa55ac30-c81e-563f-a4f8-0f643b907c9d sending to next pipeline
2026-03-27 16:47:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: aa55ac30-c81e-563f-a4f8-0f643b907c9d, identifier: 1988274
2026-03-27 16:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: aa55ac30-c81e-563f-a4f8-0f643b907c9d with identifier: 1988274
2026-03-27 16:47:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: aa55ac30-c81e-563f-a4f8-0f643b907c9d with identifier: 1988274
2026-03-27 16:47:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: aa55ac30-c81e-563f-a4f8-0f643b907c9d with identifier: 1988274 to the API
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'aa55ac30-c81e-563f-a4f8-0f643b907c9d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 68971,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa55ac30-c81e-563f-a4f8-0f643b907c9d/aa55ac30-c81e-563f-a4f8-0f643b907c9d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 459538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa55ac30-c81e-563f-a4f8-0f643b907c9d/aa55ac30-c81e-563f-a4f8-0f643b907c9d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 459538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa55ac30-c81e-563f-a4f8-0f643b907c9d/aa55ac30-c81e-563f-a4f8-0f643b907c9d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516925,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa55ac30-c81e-563f-a4f8-0f643b907c9d/aa55ac30-c81e-563f-a4f8-0f643b907c9d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424355,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa55ac30-c81e-563f-a4f8-0f643b907c9d/aa55ac30-c81e-563f-a4f8-0f643b907c9d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372115,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa55ac30-c81e-563f-a4f8-0f643b907c9d/aa55ac30-c81e-563f-a4f8-0f643b907c9d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306162,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa55ac30-c81e-563f-a4f8-0f643b907c9d/aa55ac30-c81e-563f-a4f8-0f643b907c9d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250259,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa55ac30-c81e-563f-a4f8-0f643b907c9d/aa55ac30-c81e-563f-a4f8-0f643b907c9d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310093,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/46aa614ffdb846a288cc0d5cc5c3ce96/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-24',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CAPTUR Captur 1.0 TCe 90ch Business',
'transmission': 'manual',
'trim': 'Captur 1.0 TCe 90ch Business',
'vin': None,
'year': 2021}
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988274%27 HTTP/1.1" 200 None
2026-03-27 16:47:11 [ayvens.fr] INFO: Saving data for 1988274: {'created_time': 1774630031.621953, 'last_price_update_time': 1774630031.621963, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988274') HTTP/1.1" 204 0
2026-03-27 16:47:11 [ayvens.fr] INFO: Found listing with ID: 1988276
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988276%27 HTTP/1.1" 200 None
2026-03-27 16:47:11 [ayvens.fr] INFO: Scrape type for 1988276: 1
2026-03-27 16:47:11 [ayvens.fr] INFO: Extracting data for car ID: 1988276
2026-03-27 16:47:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afb94705-c3fc-5537-a8dc-e44afc506bdc with identifier: 1988276
2026-03-27 16:47:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afb94705-c3fc-5537-a8dc-e44afc506bdc with scrape type 1
2026-03-27 16:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item afb94705-c3fc-5537-a8dc-e44afc506bdc
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F301829a832d442a9a74f4e9d1755bb23%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/1.jpg not downloaded yet
2026-03-27 16:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F301829a832d442a9a74f4e9d1755bb23%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/2.jpg not downloaded yet
2026-03-27 16:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590db9010>
2026-03-27 16:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c002d000-bdba-5c51-bcb1-1c7444607bfa/c002d000-bdba-5c51-bcb1-1c7444607bfa_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fddac9d02480049f89e60597294fd34e2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/2.jpg saved to cache
2026-03-27 16:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c002d000-bdba-5c51-bcb1-1c7444607bfa
2026-03-27 16:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F301829a832d442a9a74f4e9d1755bb23%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/3.jpg not downloaded yet
2026-03-27 16:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F301829a832d442a9a74f4e9d1755bb23%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/4.jpg not downloaded yet
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F301829a832d442a9a74f4e9d1755bb23%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/5.jpg not downloaded yet
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F301829a832d442a9a74f4e9d1755bb23%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/6.jpg not downloaded yet
2026-03-27 16:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065de10>
2026-03-27 16:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c002d000-bdba-5c51-bcb1-1c7444607bfa/c002d000-bdba-5c51-bcb1-1c7444607bfa_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fddac9d02480049f89e60597294fd34e2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/1.jpg saved to cache
2026-03-27 16:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c002d000-bdba-5c51-bcb1-1c7444607bfa
2026-03-27 16:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4f2d0>
2026-03-27 16:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c002d000-bdba-5c51-bcb1-1c7444607bfa/c002d000-bdba-5c51-bcb1-1c7444607bfa_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fddac9d02480049f89e60597294fd34e2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/3.jpg saved to cache
2026-03-27 16:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c002d000-bdba-5c51-bcb1-1c7444607bfa
2026-03-27 16:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066f350>
2026-03-27 16:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c002d000-bdba-5c51-bcb1-1c7444607bfa/c002d000-bdba-5c51-bcb1-1c7444607bfa_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fddac9d02480049f89e60597294fd34e2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/4.jpg saved to cache
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c002d000-bdba-5c51-bcb1-1c7444607bfa
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F301829a832d442a9a74f4e9d1755bb23%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/7.jpg not downloaded yet
2026-03-27 16:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F301829a832d442a9a74f4e9d1755bb23%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/8.jpg not downloaded yet
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa2810>
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c002d000-bdba-5c51-bcb1-1c7444607bfa/c002d000-bdba-5c51-bcb1-1c7444607bfa_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fddac9d02480049f89e60597294fd34e2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/6.jpg saved to cache
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c002d000-bdba-5c51-bcb1-1c7444607bfa
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590db9410>
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c002d000-bdba-5c51-bcb1-1c7444607bfa/c002d000-bdba-5c51-bcb1-1c7444607bfa_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fddac9d02480049f89e60597294fd34e2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/5.jpg saved to cache
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c002d000-bdba-5c51-bcb1-1c7444607bfa
2026-03-27 16:47:12 [ayvens.fr] INFO: Found listing with ID: 1988277
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988277%27 HTTP/1.1" 200 None
2026-03-27 16:47:12 [ayvens.fr] INFO: Scrape type for 1988277: 1
2026-03-27 16:47:12 [ayvens.fr] INFO: Extracting data for car ID: 1988277
2026-03-27 16:47:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c911483e-62ae-5688-9306-e446da933f16 with identifier: 1988277
2026-03-27 16:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c911483e-62ae-5688-9306-e446da933f16 with scrape type 1
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c911483e-62ae-5688-9306-e446da933f16
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7322b2a0d42d42a78d53b9c7938fc307%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/1.jpg not downloaded yet
2026-03-27 16:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7322b2a0d42d42a78d53b9c7938fc307%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/2.jpg not downloaded yet
2026-03-27 16:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7322b2a0d42d42a78d53b9c7938fc307%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/3.jpg not downloaded yet
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4d590>
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c002d000-bdba-5c51-bcb1-1c7444607bfa/c002d000-bdba-5c51-bcb1-1c7444607bfa_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fddac9d02480049f89e60597294fd34e2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/7.jpg saved to cache
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c002d000-bdba-5c51-bcb1-1c7444607bfa
2026-03-27 16:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7322b2a0d42d42a78d53b9c7938fc307%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/4.jpg not downloaded yet
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050c7d0>
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afb94705-c3fc-5537-a8dc-e44afc506bdc/afb94705-c3fc-5537-a8dc-e44afc506bdc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F301829a832d442a9a74f4e9d1755bb23%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/4.jpg saved to cache
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item afb94705-c3fc-5537-a8dc-e44afc506bdc
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7322b2a0d42d42a78d53b9c7938fc307%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/5.jpg not downloaded yet
2026-03-27 16:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e14490>
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afb94705-c3fc-5537-a8dc-e44afc506bdc/afb94705-c3fc-5537-a8dc-e44afc506bdc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F301829a832d442a9a74f4e9d1755bb23%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/3.jpg saved to cache
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item afb94705-c3fc-5537-a8dc-e44afc506bdc
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b431d0>
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c002d000-bdba-5c51-bcb1-1c7444607bfa/c002d000-bdba-5c51-bcb1-1c7444607bfa_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fddac9d02480049f89e60597294fd34e2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/8.jpg saved to cache
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c002d000-bdba-5c51-bcb1-1c7444607bfa
2026-03-27 16:47:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c002d000-bdba-5c51-bcb1-1c7444607bfa, skipping ID generation
2026-03-27 16:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c002d000-bdba-5c51-bcb1-1c7444607bfa with scrape type 1
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c002d000-bdba-5c51-bcb1-1c7444607bfa sending to next pipeline
2026-03-27 16:47:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c002d000-bdba-5c51-bcb1-1c7444607bfa, identifier: 1988275
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591112f50>
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afb94705-c3fc-5537-a8dc-e44afc506bdc/afb94705-c3fc-5537-a8dc-e44afc506bdc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F301829a832d442a9a74f4e9d1755bb23%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/2.jpg saved to cache
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item afb94705-c3fc-5537-a8dc-e44afc506bdc
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7fa10>
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afb94705-c3fc-5537-a8dc-e44afc506bdc/afb94705-c3fc-5537-a8dc-e44afc506bdc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F301829a832d442a9a74f4e9d1755bb23%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/1.jpg saved to cache
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afb94705-c3fc-5537-a8dc-e44afc506bdc
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7322b2a0d42d42a78d53b9c7938fc307%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/6.jpg not downloaded yet
2026-03-27 16:47:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c002d000-bdba-5c51-bcb1-1c7444607bfa with identifier: 1988275
2026-03-27 16:47:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c002d000-bdba-5c51-bcb1-1c7444607bfa with identifier: 1988275
2026-03-27 16:47:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c002d000-bdba-5c51-bcb1-1c7444607bfa with identifier: 1988275 to the API
2026-03-27 16:47:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 135,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'c002d000-bdba-5c51-bcb1-1c7444607bfa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 54467,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c002d000-bdba-5c51-bcb1-1c7444607bfa/c002d000-bdba-5c51-bcb1-1c7444607bfa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345422,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c002d000-bdba-5c51-bcb1-1c7444607bfa/c002d000-bdba-5c51-bcb1-1c7444607bfa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345422,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c002d000-bdba-5c51-bcb1-1c7444607bfa/c002d000-bdba-5c51-bcb1-1c7444607bfa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385462,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c002d000-bdba-5c51-bcb1-1c7444607bfa/c002d000-bdba-5c51-bcb1-1c7444607bfa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354048,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c002d000-bdba-5c51-bcb1-1c7444607bfa/c002d000-bdba-5c51-bcb1-1c7444607bfa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 390442,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c002d000-bdba-5c51-bcb1-1c7444607bfa/c002d000-bdba-5c51-bcb1-1c7444607bfa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316659,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c002d000-bdba-5c51-bcb1-1c7444607bfa/c002d000-bdba-5c51-bcb1-1c7444607bfa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284959,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c002d000-bdba-5c51-bcb1-1c7444607bfa/c002d000-bdba-5c51-bcb1-1c7444607bfa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397103,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ddac9d02480049f89e60597294fd34e2/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-03',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE Megane 1.0 TCe 115ch Business',
'transmission': 'manual',
'trim': 'Megane 1.0 TCe 115ch Business',
'vin': None,
'year': 2021}
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988275%27 HTTP/1.1" 200 None
2026-03-27 16:47:14 [ayvens.fr] INFO: Saving data for 1988275: {'created_time': 1774630034.555427, 'last_price_update_time': 1774630034.555438, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988275') HTTP/1.1" 204 0
2026-03-27 16:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a1610>
2026-03-27 16:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afb94705-c3fc-5537-a8dc-e44afc506bdc/afb94705-c3fc-5537-a8dc-e44afc506bdc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F301829a832d442a9a74f4e9d1755bb23%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/5.jpg saved to cache
2026-03-27 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item afb94705-c3fc-5537-a8dc-e44afc506bdc
2026-03-27 16:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7322b2a0d42d42a78d53b9c7938fc307%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/7.jpg not downloaded yet
2026-03-27 16:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2f710>
2026-03-27 16:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afb94705-c3fc-5537-a8dc-e44afc506bdc/afb94705-c3fc-5537-a8dc-e44afc506bdc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F301829a832d442a9a74f4e9d1755bb23%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/6.jpg saved to cache
2026-03-27 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item afb94705-c3fc-5537-a8dc-e44afc506bdc
2026-03-27 16:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7322b2a0d42d42a78d53b9c7938fc307%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/8.jpg not downloaded yet
2026-03-27 16:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:14 [ayvens.fr] INFO: Found listing with ID: 1988278
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988278%27 HTTP/1.1" 200 None
2026-03-27 16:47:14 [ayvens.fr] INFO: Scrape type for 1988278: 1
2026-03-27 16:47:14 [ayvens.fr] INFO: Extracting data for car ID: 1988278
2026-03-27 16:47:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be6e5c6c-5648-56cf-a332-8304814c18c7 with identifier: 1988278
2026-03-27 16:47:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be6e5c6c-5648-56cf-a332-8304814c18c7 with scrape type 1
2026-03-27 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item be6e5c6c-5648-56cf-a332-8304814c18c7
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F061a458ec85a432c89f0341eca34e82a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/1.jpg not downloaded yet
2026-03-27 16:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4ded0>
2026-03-27 16:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afb94705-c3fc-5537-a8dc-e44afc506bdc/afb94705-c3fc-5537-a8dc-e44afc506bdc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F301829a832d442a9a74f4e9d1755bb23%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/7.jpg saved to cache
2026-03-27 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item afb94705-c3fc-5537-a8dc-e44afc506bdc
2026-03-27 16:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ab9510>
2026-03-27 16:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afb94705-c3fc-5537-a8dc-e44afc506bdc/afb94705-c3fc-5537-a8dc-e44afc506bdc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F301829a832d442a9a74f4e9d1755bb23%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/8.jpg saved to cache
2026-03-27 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item afb94705-c3fc-5537-a8dc-e44afc506bdc
2026-03-27 16:47:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: afb94705-c3fc-5537-a8dc-e44afc506bdc, skipping ID generation
2026-03-27 16:47:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afb94705-c3fc-5537-a8dc-e44afc506bdc with scrape type 1
2026-03-27 16:47:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afb94705-c3fc-5537-a8dc-e44afc506bdc sending to next pipeline
2026-03-27 16:47:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: afb94705-c3fc-5537-a8dc-e44afc506bdc, identifier: 1988276
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F061a458ec85a432c89f0341eca34e82a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/2.jpg not downloaded yet
2026-03-27 16:47:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: afb94705-c3fc-5537-a8dc-e44afc506bdc with identifier: 1988276
2026-03-27 16:47:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:47:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: afb94705-c3fc-5537-a8dc-e44afc506bdc with identifier: 1988276
2026-03-27 16:47:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: afb94705-c3fc-5537-a8dc-e44afc506bdc with identifier: 1988276 to the API
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 45,
'color': 'PHYTONICBLAU METALLISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'afb94705-c3fc-5537-a8dc-e44afc506bdc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'X3',
'odometer': 47749,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afb94705-c3fc-5537-a8dc-e44afc506bdc/afb94705-c3fc-5537-a8dc-e44afc506bdc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461173,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afb94705-c3fc-5537-a8dc-e44afc506bdc/afb94705-c3fc-5537-a8dc-e44afc506bdc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461173,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afb94705-c3fc-5537-a8dc-e44afc506bdc/afb94705-c3fc-5537-a8dc-e44afc506bdc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438667,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afb94705-c3fc-5537-a8dc-e44afc506bdc/afb94705-c3fc-5537-a8dc-e44afc506bdc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372446,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afb94705-c3fc-5537-a8dc-e44afc506bdc/afb94705-c3fc-5537-a8dc-e44afc506bdc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340333,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afb94705-c3fc-5537-a8dc-e44afc506bdc/afb94705-c3fc-5537-a8dc-e44afc506bdc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346571,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afb94705-c3fc-5537-a8dc-e44afc506bdc/afb94705-c3fc-5537-a8dc-e44afc506bdc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354910,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afb94705-c3fc-5537-a8dc-e44afc506bdc/afb94705-c3fc-5537-a8dc-e44afc506bdc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392357,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/301829a832d442a9a74f4e9d1755bb23/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-12',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 X3 xDrive30e 292ch Business Design',
'transmission': 'automatic',
'trim': 'X3 xDrive30e 292ch Business Design',
'vin': None,
'year': 2022}
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988276%27 HTTP/1.1" 200 None
2026-03-27 16:47:15 [ayvens.fr] INFO: Saving data for 1988276: {'created_time': 1774630035.39396, 'last_price_update_time': 1774630035.393971, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988276') HTTP/1.1" 204 0
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F061a458ec85a432c89f0341eca34e82a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/3.jpg not downloaded yet
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd2910>
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c911483e-62ae-5688-9306-e446da933f16/c911483e-62ae-5688-9306-e446da933f16_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7322b2a0d42d42a78d53b9c7938fc307%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/2.jpg saved to cache
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c911483e-62ae-5688-9306-e446da933f16
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e14050>
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c911483e-62ae-5688-9306-e446da933f16/c911483e-62ae-5688-9306-e446da933f16_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7322b2a0d42d42a78d53b9c7938fc307%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/3.jpg saved to cache
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c911483e-62ae-5688-9306-e446da933f16
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590590350>
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c911483e-62ae-5688-9306-e446da933f16/c911483e-62ae-5688-9306-e446da933f16_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7322b2a0d42d42a78d53b9c7938fc307%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/4.jpg saved to cache
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c911483e-62ae-5688-9306-e446da933f16
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b74750>
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c911483e-62ae-5688-9306-e446da933f16/c911483e-62ae-5688-9306-e446da933f16_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7322b2a0d42d42a78d53b9c7938fc307%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/1.jpg saved to cache
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c911483e-62ae-5688-9306-e446da933f16
2026-03-27 16:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F061a458ec85a432c89f0341eca34e82a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/4.jpg not downloaded yet
2026-03-27 16:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F061a458ec85a432c89f0341eca34e82a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/5.jpg not downloaded yet
2026-03-27 16:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F061a458ec85a432c89f0341eca34e82a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/6.jpg not downloaded yet
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F061a458ec85a432c89f0341eca34e82a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/7.jpg not downloaded yet
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F061a458ec85a432c89f0341eca34e82a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/8.jpg not downloaded yet
2026-03-27 16:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:15 [ayvens.fr] INFO: Found listing with ID: 1988279
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988279%27 HTTP/1.1" 200 None
2026-03-27 16:47:15 [ayvens.fr] INFO: Scrape type for 1988279: 1
2026-03-27 16:47:15 [ayvens.fr] INFO: Extracting data for car ID: 1988279
2026-03-27 16:47:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f49fcea6-5e3a-525c-bff8-6edd35120706 with identifier: 1988279
2026-03-27 16:47:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f49fcea6-5e3a-525c-bff8-6edd35120706 with scrape type 1
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f49fcea6-5e3a-525c-bff8-6edd35120706
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F62065d44bf704993868a94b0902b9e4e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/1.jpg not downloaded yet
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F62065d44bf704993868a94b0902b9e4e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/2.jpg not downloaded yet
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591483f50>
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c911483e-62ae-5688-9306-e446da933f16/c911483e-62ae-5688-9306-e446da933f16_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7322b2a0d42d42a78d53b9c7938fc307%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/5.jpg saved to cache
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c911483e-62ae-5688-9306-e446da933f16
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a3d50>
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c911483e-62ae-5688-9306-e446da933f16/c911483e-62ae-5688-9306-e446da933f16_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7322b2a0d42d42a78d53b9c7938fc307%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/6.jpg saved to cache
2026-03-27 16:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c911483e-62ae-5688-9306-e446da933f16
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590669f50>
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c911483e-62ae-5688-9306-e446da933f16/c911483e-62ae-5688-9306-e446da933f16_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7322b2a0d42d42a78d53b9c7938fc307%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/7.jpg saved to cache
2026-03-27 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c911483e-62ae-5688-9306-e446da933f16
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F62065d44bf704993868a94b0902b9e4e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/3.jpg not downloaded yet
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F62065d44bf704993868a94b0902b9e4e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/4.jpg not downloaded yet
2026-03-27 16:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ac4a90>
2026-03-27 16:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c911483e-62ae-5688-9306-e446da933f16/c911483e-62ae-5688-9306-e446da933f16_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7322b2a0d42d42a78d53b9c7938fc307%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/8.jpg saved to cache
2026-03-27 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c911483e-62ae-5688-9306-e446da933f16
2026-03-27 16:47:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c911483e-62ae-5688-9306-e446da933f16, skipping ID generation
2026-03-27 16:47:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c911483e-62ae-5688-9306-e446da933f16 with scrape type 1
2026-03-27 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c911483e-62ae-5688-9306-e446da933f16 sending to next pipeline
2026-03-27 16:47:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c911483e-62ae-5688-9306-e446da933f16, identifier: 1988277
2026-03-27 16:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e16710>
2026-03-27 16:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be6e5c6c-5648-56cf-a332-8304814c18c7/be6e5c6c-5648-56cf-a332-8304814c18c7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F061a458ec85a432c89f0341eca34e82a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/1.jpg saved to cache
2026-03-27 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be6e5c6c-5648-56cf-a332-8304814c18c7
2026-03-27 16:47:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c911483e-62ae-5688-9306-e446da933f16 with identifier: 1988277
2026-03-27 16:47:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:47:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c911483e-62ae-5688-9306-e446da933f16 with identifier: 1988277
2026-03-27 16:47:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c911483e-62ae-5688-9306-e446da933f16 with identifier: 1988277 to the API
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'GRIS ACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'c911483e-62ae-5688-9306-e446da933f16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C5 AIRCROSS',
'odometer': 103803,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c911483e-62ae-5688-9306-e446da933f16/c911483e-62ae-5688-9306-e446da933f16_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380517,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c911483e-62ae-5688-9306-e446da933f16/c911483e-62ae-5688-9306-e446da933f16_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380517,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c911483e-62ae-5688-9306-e446da933f16/c911483e-62ae-5688-9306-e446da933f16_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309806,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c911483e-62ae-5688-9306-e446da933f16/c911483e-62ae-5688-9306-e446da933f16_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254836,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c911483e-62ae-5688-9306-e446da933f16/c911483e-62ae-5688-9306-e446da933f16_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263213,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c911483e-62ae-5688-9306-e446da933f16/c911483e-62ae-5688-9306-e446da933f16_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260199,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c911483e-62ae-5688-9306-e446da933f16/c911483e-62ae-5688-9306-e446da933f16_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260944,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c911483e-62ae-5688-9306-e446da933f16/c911483e-62ae-5688-9306-e446da933f16_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272092,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/7322b2a0d42d42a78d53b9c7938fc307/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-27',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C5 AIRCROSS C5 Aircross PureTech 130ch S&S Live',
'transmission': 'manual',
'trim': 'C5 Aircross PureTech 130ch S&S Live',
'vin': None,
'year': 2022}
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988277%27 HTTP/1.1" 200 None
2026-03-27 16:47:16 [ayvens.fr] INFO: Saving data for 1988277: {'created_time': 1774630036.706593, 'last_price_update_time': 1774630036.706607, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988277') HTTP/1.1" 204 0
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F62065d44bf704993868a94b0902b9e4e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/5.jpg not downloaded yet
2026-03-27 16:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F62065d44bf704993868a94b0902b9e4e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/6.jpg not downloaded yet
2026-03-27 16:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F62065d44bf704993868a94b0902b9e4e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/7.jpg not downloaded yet
2026-03-27 16:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F62065d44bf704993868a94b0902b9e4e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/8.jpg not downloaded yet
2026-03-27 16:47:16 [ayvens.fr] INFO: Found listing with ID: 1988280
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988280%27 HTTP/1.1" 200 None
2026-03-27 16:47:16 [ayvens.fr] INFO: Scrape type for 1988280: 1
2026-03-27 16:47:16 [ayvens.fr] INFO: Extracting data for car ID: 1988280
2026-03-27 16:47:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74913362-4d58-5cdb-9822-16640fa2ddae with identifier: 1988280
2026-03-27 16:47:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74913362-4d58-5cdb-9822-16640fa2ddae with scrape type 1
2026-03-27 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 74913362-4d58-5cdb-9822-16640fa2ddae
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb3152965bc4d48a9b9c4fdc63376e71a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/1.jpg not downloaded yet
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb3152965bc4d48a9b9c4fdc63376e71a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/2.jpg not downloaded yet
2026-03-27 16:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7d350>
2026-03-27 16:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be6e5c6c-5648-56cf-a332-8304814c18c7/be6e5c6c-5648-56cf-a332-8304814c18c7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F061a458ec85a432c89f0341eca34e82a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/3.jpg saved to cache
2026-03-27 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be6e5c6c-5648-56cf-a332-8304814c18c7
2026-03-27 16:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590eff4d0>
2026-03-27 16:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be6e5c6c-5648-56cf-a332-8304814c18c7/be6e5c6c-5648-56cf-a332-8304814c18c7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F061a458ec85a432c89f0341eca34e82a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/8.jpg saved to cache
2026-03-27 16:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be6e5c6c-5648-56cf-a332-8304814c18c7
2026-03-27 16:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590597e90>
2026-03-27 16:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be6e5c6c-5648-56cf-a332-8304814c18c7/be6e5c6c-5648-56cf-a332-8304814c18c7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F061a458ec85a432c89f0341eca34e82a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/7.jpg saved to cache
2026-03-27 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be6e5c6c-5648-56cf-a332-8304814c18c7
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb3152965bc4d48a9b9c4fdc63376e71a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/3.jpg not downloaded yet
2026-03-27 16:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905292d0>
2026-03-27 16:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be6e5c6c-5648-56cf-a332-8304814c18c7/be6e5c6c-5648-56cf-a332-8304814c18c7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F061a458ec85a432c89f0341eca34e82a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/6.jpg saved to cache
2026-03-27 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be6e5c6c-5648-56cf-a332-8304814c18c7
2026-03-27 16:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe10d0>
2026-03-27 16:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be6e5c6c-5648-56cf-a332-8304814c18c7/be6e5c6c-5648-56cf-a332-8304814c18c7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F061a458ec85a432c89f0341eca34e82a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/4.jpg saved to cache
2026-03-27 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be6e5c6c-5648-56cf-a332-8304814c18c7
2026-03-27 16:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d0a50>
2026-03-27 16:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be6e5c6c-5648-56cf-a332-8304814c18c7/be6e5c6c-5648-56cf-a332-8304814c18c7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F061a458ec85a432c89f0341eca34e82a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/5.jpg saved to cache
2026-03-27 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be6e5c6c-5648-56cf-a332-8304814c18c7
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb3152965bc4d48a9b9c4fdc63376e71a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/4.jpg not downloaded yet
2026-03-27 16:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb3152965bc4d48a9b9c4fdc63376e71a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/5.jpg not downloaded yet
2026-03-27 16:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904cbd10>
2026-03-27 16:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be6e5c6c-5648-56cf-a332-8304814c18c7/be6e5c6c-5648-56cf-a332-8304814c18c7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F061a458ec85a432c89f0341eca34e82a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/2.jpg saved to cache
2026-03-27 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be6e5c6c-5648-56cf-a332-8304814c18c7
2026-03-27 16:47:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be6e5c6c-5648-56cf-a332-8304814c18c7, skipping ID generation
2026-03-27 16:47:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be6e5c6c-5648-56cf-a332-8304814c18c7 with scrape type 1
2026-03-27 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be6e5c6c-5648-56cf-a332-8304814c18c7 sending to next pipeline
2026-03-27 16:47:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: be6e5c6c-5648-56cf-a332-8304814c18c7, identifier: 1988278
2026-03-27 16:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5942d9ed0>
2026-03-27 16:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f49fcea6-5e3a-525c-bff8-6edd35120706/f49fcea6-5e3a-525c-bff8-6edd35120706_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F62065d44bf704993868a94b0902b9e4e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/1.jpg saved to cache
2026-03-27 16:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f49fcea6-5e3a-525c-bff8-6edd35120706
2026-03-27 16:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: be6e5c6c-5648-56cf-a332-8304814c18c7 with identifier: 1988278
2026-03-27 16:47:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:47:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: be6e5c6c-5648-56cf-a332-8304814c18c7 with identifier: 1988278
2026-03-27 16:47:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: be6e5c6c-5648-56cf-a332-8304814c18c7 with identifier: 1988278 to the API
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'BLANC OK',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'be6e5c6c-5648-56cf-a332-8304814c18c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 105740,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be6e5c6c-5648-56cf-a332-8304814c18c7/be6e5c6c-5648-56cf-a332-8304814c18c7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 592125,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be6e5c6c-5648-56cf-a332-8304814c18c7/be6e5c6c-5648-56cf-a332-8304814c18c7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 592125,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be6e5c6c-5648-56cf-a332-8304814c18c7/be6e5c6c-5648-56cf-a332-8304814c18c7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504937,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be6e5c6c-5648-56cf-a332-8304814c18c7/be6e5c6c-5648-56cf-a332-8304814c18c7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 490544,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be6e5c6c-5648-56cf-a332-8304814c18c7/be6e5c6c-5648-56cf-a332-8304814c18c7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404507,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be6e5c6c-5648-56cf-a332-8304814c18c7/be6e5c6c-5648-56cf-a332-8304814c18c7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351623,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be6e5c6c-5648-56cf-a332-8304814c18c7/be6e5c6c-5648-56cf-a332-8304814c18c7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291886,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be6e5c6c-5648-56cf-a332-8304814c18c7/be6e5c6c-5648-56cf-a332-8304814c18c7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 278506,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/061a458ec85a432c89f0341eca34e82a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-12',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 130ch S&S Allure EAT8',
'transmission': 'automatic',
'trim': '2008 1.2 PureTech 130ch S&S Allure EAT8',
'vin': None,
'year': 2023}
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988278%27 HTTP/1.1" 200 None
2026-03-27 16:47:18 [ayvens.fr] INFO: Saving data for 1988278: {'created_time': 1774630038.026059, 'last_price_update_time': 1774630038.026076, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988278') HTTP/1.1" 204 0
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb3152965bc4d48a9b9c4fdc63376e71a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/6.jpg not downloaded yet
2026-03-27 16:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59103ca50>
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f49fcea6-5e3a-525c-bff8-6edd35120706/f49fcea6-5e3a-525c-bff8-6edd35120706_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F62065d44bf704993868a94b0902b9e4e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/2.jpg saved to cache
2026-03-27 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f49fcea6-5e3a-525c-bff8-6edd35120706
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051ffd0>
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f49fcea6-5e3a-525c-bff8-6edd35120706/f49fcea6-5e3a-525c-bff8-6edd35120706_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F62065d44bf704993868a94b0902b9e4e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/3.jpg saved to cache
2026-03-27 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f49fcea6-5e3a-525c-bff8-6edd35120706
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5914838d0>
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f49fcea6-5e3a-525c-bff8-6edd35120706/f49fcea6-5e3a-525c-bff8-6edd35120706_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F62065d44bf704993868a94b0902b9e4e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/4.jpg saved to cache
2026-03-27 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f49fcea6-5e3a-525c-bff8-6edd35120706
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592d56dd0>
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f49fcea6-5e3a-525c-bff8-6edd35120706/f49fcea6-5e3a-525c-bff8-6edd35120706_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F62065d44bf704993868a94b0902b9e4e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/7.jpg saved to cache
2026-03-27 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f49fcea6-5e3a-525c-bff8-6edd35120706
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb3152965bc4d48a9b9c4fdc63376e71a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/7.jpg not downloaded yet
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592d55e90>
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f49fcea6-5e3a-525c-bff8-6edd35120706/f49fcea6-5e3a-525c-bff8-6edd35120706_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F62065d44bf704993868a94b0902b9e4e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/5.jpg saved to cache
2026-03-27 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f49fcea6-5e3a-525c-bff8-6edd35120706
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd25d0>
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f49fcea6-5e3a-525c-bff8-6edd35120706/f49fcea6-5e3a-525c-bff8-6edd35120706_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F62065d44bf704993868a94b0902b9e4e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/8.jpg saved to cache
2026-03-27 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f49fcea6-5e3a-525c-bff8-6edd35120706
2026-03-27 16:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb3152965bc4d48a9b9c4fdc63376e71a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/8.jpg not downloaded yet
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d6e510>
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f49fcea6-5e3a-525c-bff8-6edd35120706/f49fcea6-5e3a-525c-bff8-6edd35120706_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F62065d44bf704993868a94b0902b9e4e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/6.jpg saved to cache
2026-03-27 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f49fcea6-5e3a-525c-bff8-6edd35120706
2026-03-27 16:47:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f49fcea6-5e3a-525c-bff8-6edd35120706, skipping ID generation
2026-03-27 16:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f49fcea6-5e3a-525c-bff8-6edd35120706 with scrape type 1
2026-03-27 16:47:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f49fcea6-5e3a-525c-bff8-6edd35120706 sending to next pipeline
2026-03-27 16:47:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f49fcea6-5e3a-525c-bff8-6edd35120706, identifier: 1988279
2026-03-27 16:47:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f49fcea6-5e3a-525c-bff8-6edd35120706 with identifier: 1988279
2026-03-27 16:47:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f49fcea6-5e3a-525c-bff8-6edd35120706 with identifier: 1988279
2026-03-27 16:47:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f49fcea6-5e3a-525c-bff8-6edd35120706 with identifier: 1988279 to the API
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'f49fcea6-5e3a-525c-bff8-6edd35120706',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 95715,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f49fcea6-5e3a-525c-bff8-6edd35120706/f49fcea6-5e3a-525c-bff8-6edd35120706_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438940,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f49fcea6-5e3a-525c-bff8-6edd35120706/f49fcea6-5e3a-525c-bff8-6edd35120706_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438940,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f49fcea6-5e3a-525c-bff8-6edd35120706/f49fcea6-5e3a-525c-bff8-6edd35120706_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 399620,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f49fcea6-5e3a-525c-bff8-6edd35120706/f49fcea6-5e3a-525c-bff8-6edd35120706_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335144,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f49fcea6-5e3a-525c-bff8-6edd35120706/f49fcea6-5e3a-525c-bff8-6edd35120706_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423298,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f49fcea6-5e3a-525c-bff8-6edd35120706/f49fcea6-5e3a-525c-bff8-6edd35120706_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407870,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f49fcea6-5e3a-525c-bff8-6edd35120706/f49fcea6-5e3a-525c-bff8-6edd35120706_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 267596,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f49fcea6-5e3a-525c-bff8-6edd35120706/f49fcea6-5e3a-525c-bff8-6edd35120706_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261987,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/62065d44bf704993868a94b0902b9e4e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE Megane 1.5 Blue dCi 115ch Evolution EDC',
'transmission': 'automatic',
'trim': 'Megane 1.5 Blue dCi 115ch Evolution EDC',
'vin': None,
'year': 2022}
2026-03-27 16:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988279%27 HTTP/1.1" 200 None
2026-03-27 16:47:19 [ayvens.fr] INFO: Saving data for 1988279: {'created_time': 1774630039.004112, 'last_price_update_time': 1774630039.004125, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988279') HTTP/1.1" 204 0
2026-03-27 16:47:19 [ayvens.fr] INFO: Found listing with ID: 1988281
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988281%27 HTTP/1.1" 200 None
2026-03-27 16:47:19 [ayvens.fr] INFO: Scrape type for 1988281: 1
2026-03-27 16:47:19 [ayvens.fr] INFO: Extracting data for car ID: 1988281
2026-03-27 16:47:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b with identifier: 1988281
2026-03-27 16:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b with scrape type 1
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F152df24736004dd3ada374fde9a7177a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/1.jpg not downloaded yet
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2e790>
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74913362-4d58-5cdb-9822-16640fa2ddae/74913362-4d58-5cdb-9822-16640fa2ddae_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb3152965bc4d48a9b9c4fdc63376e71a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/1.jpg saved to cache
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74913362-4d58-5cdb-9822-16640fa2ddae
2026-03-27 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F152df24736004dd3ada374fde9a7177a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/2.jpg not downloaded yet
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F152df24736004dd3ada374fde9a7177a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/3.jpg not downloaded yet
2026-03-27 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F152df24736004dd3ada374fde9a7177a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/4.jpg not downloaded yet
2026-03-27 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F152df24736004dd3ada374fde9a7177a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/5.jpg not downloaded yet
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F152df24736004dd3ada374fde9a7177a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/6.jpg not downloaded yet
2026-03-27 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F152df24736004dd3ada374fde9a7177a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/7.jpg not downloaded yet
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F152df24736004dd3ada374fde9a7177a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/8.jpg not downloaded yet
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4dcd0>
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74913362-4d58-5cdb-9822-16640fa2ddae/74913362-4d58-5cdb-9822-16640fa2ddae_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb3152965bc4d48a9b9c4fdc63376e71a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/3.jpg saved to cache
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74913362-4d58-5cdb-9822-16640fa2ddae
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e2cd0>
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74913362-4d58-5cdb-9822-16640fa2ddae/74913362-4d58-5cdb-9822-16640fa2ddae_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb3152965bc4d48a9b9c4fdc63376e71a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/2.jpg saved to cache
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74913362-4d58-5cdb-9822-16640fa2ddae
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a8ad0>
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74913362-4d58-5cdb-9822-16640fa2ddae/74913362-4d58-5cdb-9822-16640fa2ddae_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb3152965bc4d48a9b9c4fdc63376e71a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/4.jpg saved to cache
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74913362-4d58-5cdb-9822-16640fa2ddae
2026-03-27 16:47:19 [ayvens.fr] INFO: Found listing with ID: 1988282
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988282%27 HTTP/1.1" 200 None
2026-03-27 16:47:19 [ayvens.fr] INFO: Scrape type for 1988282: 1
2026-03-27 16:47:19 [ayvens.fr] INFO: Extracting data for car ID: 1988282
2026-03-27 16:47:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d457b7d-b5eb-5001-8098-154178934e48 with identifier: 1988282
2026-03-27 16:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d457b7d-b5eb-5001-8098-154178934e48 with scrape type 1
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1d457b7d-b5eb-5001-8098-154178934e48
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F10d853b3d4ad4456a28a6bbb5fb69cca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/1.jpg not downloaded yet
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F10d853b3d4ad4456a28a6bbb5fb69cca%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/2.jpg not downloaded yet
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e15dd0>
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74913362-4d58-5cdb-9822-16640fa2ddae/74913362-4d58-5cdb-9822-16640fa2ddae_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb3152965bc4d48a9b9c4fdc63376e71a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/5.jpg saved to cache
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74913362-4d58-5cdb-9822-16640fa2ddae
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591483ed0>
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74913362-4d58-5cdb-9822-16640fa2ddae/74913362-4d58-5cdb-9822-16640fa2ddae_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb3152965bc4d48a9b9c4fdc63376e71a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/6.jpg saved to cache
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74913362-4d58-5cdb-9822-16640fa2ddae
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ac7ed0>
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74913362-4d58-5cdb-9822-16640fa2ddae/74913362-4d58-5cdb-9822-16640fa2ddae_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb3152965bc4d48a9b9c4fdc63376e71a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/7.jpg saved to cache
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74913362-4d58-5cdb-9822-16640fa2ddae
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F10d853b3d4ad4456a28a6bbb5fb69cca%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/3.jpg not downloaded yet
2026-03-27 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F10d853b3d4ad4456a28a6bbb5fb69cca%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/4.jpg not downloaded yet
2026-03-27 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F10d853b3d4ad4456a28a6bbb5fb69cca%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/5.jpg not downloaded yet
2026-03-27 16:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F10d853b3d4ad4456a28a6bbb5fb69cca%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/6.jpg not downloaded yet
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F10d853b3d4ad4456a28a6bbb5fb69cca%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/7.jpg not downloaded yet
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F10d853b3d4ad4456a28a6bbb5fb69cca%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/8.jpg not downloaded yet
2026-03-27 16:47:20 [ayvens.fr] INFO: Found listing with ID: 1988283
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988283%27 HTTP/1.1" 200 None
2026-03-27 16:47:20 [ayvens.fr] INFO: Scrape type for 1988283: 1
2026-03-27 16:47:20 [ayvens.fr] INFO: Extracting data for car ID: 1988283
2026-03-27 16:47:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42abf82d-52d8-5f81-9d79-8af87d8b697c with identifier: 1988283
2026-03-27 16:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42abf82d-52d8-5f81-9d79-8af87d8b697c with scrape type 1
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 42abf82d-52d8-5f81-9d79-8af87d8b697c
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F5119f4eb75e4481a8691bdc916239aed%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/1.jpg not downloaded yet
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F5119f4eb75e4481a8691bdc916239aed%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/2.jpg not downloaded yet
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F5119f4eb75e4481a8691bdc916239aed%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/3.jpg not downloaded yet
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591433a50>
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b/d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F152df24736004dd3ada374fde9a7177a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/6.jpg saved to cache
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b1b950>
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74913362-4d58-5cdb-9822-16640fa2ddae/74913362-4d58-5cdb-9822-16640fa2ddae_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb3152965bc4d48a9b9c4fdc63376e71a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/8.jpg saved to cache
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74913362-4d58-5cdb-9822-16640fa2ddae
2026-03-27 16:47:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74913362-4d58-5cdb-9822-16640fa2ddae, skipping ID generation
2026-03-27 16:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74913362-4d58-5cdb-9822-16640fa2ddae with scrape type 1
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74913362-4d58-5cdb-9822-16640fa2ddae sending to next pipeline
2026-03-27 16:47:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 74913362-4d58-5cdb-9822-16640fa2ddae, identifier: 1988280
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5945f9cd0>
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b/d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F152df24736004dd3ada374fde9a7177a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/4.jpg saved to cache
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911cbc50>
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b/d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F152df24736004dd3ada374fde9a7177a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/1.jpg saved to cache
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591110410>
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b/d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F152df24736004dd3ada374fde9a7177a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/2.jpg saved to cache
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590696010>
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b/d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F152df24736004dd3ada374fde9a7177a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/3.jpg saved to cache
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591446f50>
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b/d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F152df24736004dd3ada374fde9a7177a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/5.jpg saved to cache
2026-03-27 16:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b
2026-03-27 16:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 74913362-4d58-5cdb-9822-16640fa2ddae with identifier: 1988280
2026-03-27 16:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 74913362-4d58-5cdb-9822-16640fa2ddae with identifier: 1988280
2026-03-27 16:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 74913362-4d58-5cdb-9822-16640fa2ddae with identifier: 1988280 to the API
2026-03-27 16:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 48,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '74913362-4d58-5cdb-9822-16640fa2ddae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'X3',
'odometer': 85563,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74913362-4d58-5cdb-9822-16640fa2ddae/74913362-4d58-5cdb-9822-16640fa2ddae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 500286,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74913362-4d58-5cdb-9822-16640fa2ddae/74913362-4d58-5cdb-9822-16640fa2ddae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 500286,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74913362-4d58-5cdb-9822-16640fa2ddae/74913362-4d58-5cdb-9822-16640fa2ddae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 499029,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74913362-4d58-5cdb-9822-16640fa2ddae/74913362-4d58-5cdb-9822-16640fa2ddae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385241,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74913362-4d58-5cdb-9822-16640fa2ddae/74913362-4d58-5cdb-9822-16640fa2ddae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 454252,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74913362-4d58-5cdb-9822-16640fa2ddae/74913362-4d58-5cdb-9822-16640fa2ddae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 462380,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74913362-4d58-5cdb-9822-16640fa2ddae/74913362-4d58-5cdb-9822-16640fa2ddae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333286,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74913362-4d58-5cdb-9822-16640fa2ddae/74913362-4d58-5cdb-9822-16640fa2ddae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381980,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b3152965bc4d48a9b9c4fdc63376e71a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-02',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 X3 xDrive30e 292ch M Sport',
'transmission': 'automatic',
'trim': 'X3 xDrive30e 292ch M Sport',
'vin': None,
'year': 2022}
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988280%27 HTTP/1.1" 200 None
2026-03-27 16:47:21 [ayvens.fr] INFO: Saving data for 1988280: {'created_time': 1774630041.104495, 'last_price_update_time': 1774630041.104507, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988280') HTTP/1.1" 204 0
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F5119f4eb75e4481a8691bdc916239aed%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/4.jpg not downloaded yet
2026-03-27 16:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d53fd0>
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b/d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F152df24736004dd3ada374fde9a7177a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/7.jpg saved to cache
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b
2026-03-27 16:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F5119f4eb75e4481a8691bdc916239aed%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/5.jpg not downloaded yet
2026-03-27 16:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F5119f4eb75e4481a8691bdc916239aed%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/6.jpg not downloaded yet
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590515890>
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d457b7d-b5eb-5001-8098-154178934e48/1d457b7d-b5eb-5001-8098-154178934e48_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F10d853b3d4ad4456a28a6bbb5fb69cca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/1.jpg saved to cache
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d457b7d-b5eb-5001-8098-154178934e48
2026-03-27 16:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F5119f4eb75e4481a8691bdc916239aed%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/7.jpg not downloaded yet
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F5119f4eb75e4481a8691bdc916239aed%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/8.jpg not downloaded yet
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b0050>
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d457b7d-b5eb-5001-8098-154178934e48/1d457b7d-b5eb-5001-8098-154178934e48_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F10d853b3d4ad4456a28a6bbb5fb69cca%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/2.jpg saved to cache
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d457b7d-b5eb-5001-8098-154178934e48
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe0f90>
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d457b7d-b5eb-5001-8098-154178934e48/1d457b7d-b5eb-5001-8098-154178934e48_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F10d853b3d4ad4456a28a6bbb5fb69cca%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/4.jpg saved to cache
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d457b7d-b5eb-5001-8098-154178934e48
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4c9d0>
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d457b7d-b5eb-5001-8098-154178934e48/1d457b7d-b5eb-5001-8098-154178934e48_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F10d853b3d4ad4456a28a6bbb5fb69cca%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/6.jpg saved to cache
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d457b7d-b5eb-5001-8098-154178934e48
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d6f850>
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d457b7d-b5eb-5001-8098-154178934e48/1d457b7d-b5eb-5001-8098-154178934e48_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F10d853b3d4ad4456a28a6bbb5fb69cca%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/3.jpg saved to cache
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d457b7d-b5eb-5001-8098-154178934e48
2026-03-27 16:47:21 [ayvens.fr] INFO: Found listing with ID: 1988284
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988284%27 HTTP/1.1" 200 None
2026-03-27 16:47:21 [ayvens.fr] INFO: Scrape type for 1988284: 1
2026-03-27 16:47:21 [ayvens.fr] INFO: Extracting data for car ID: 1988284
2026-03-27 16:47:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87a357cc-46a4-5eb2-9a63-75a02bced56c with identifier: 1988284
2026-03-27 16:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87a357cc-46a4-5eb2-9a63-75a02bced56c with scrape type 1
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 87a357cc-46a4-5eb2-9a63-75a02bced56c
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252F17dde39211e847bd9e90ff5b2e1cf0a4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/1.jpg not downloaded yet
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252F17dde39211e847bd9e90ff5b2e1cf0a4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/2.jpg not downloaded yet
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a05d0>
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d457b7d-b5eb-5001-8098-154178934e48/1d457b7d-b5eb-5001-8098-154178934e48_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F10d853b3d4ad4456a28a6bbb5fb69cca%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/5.jpg saved to cache
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d457b7d-b5eb-5001-8098-154178934e48
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4bf50>
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d457b7d-b5eb-5001-8098-154178934e48/1d457b7d-b5eb-5001-8098-154178934e48_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F10d853b3d4ad4456a28a6bbb5fb69cca%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/7.jpg saved to cache
2026-03-27 16:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d457b7d-b5eb-5001-8098-154178934e48
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591107490>
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b/d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F152df24736004dd3ada374fde9a7177a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/8.jpg saved to cache
2026-03-27 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b
2026-03-27 16:47:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b, skipping ID generation
2026-03-27 16:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b with scrape type 1
2026-03-27 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b sending to next pipeline
2026-03-27 16:47:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b, identifier: 1988281
2026-03-27 16:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b with identifier: 1988281
2026-03-27 16:47:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:47:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b with identifier: 1988281
2026-03-27 16:47:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b with identifier: 1988281 to the API
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 145,
'color': 'SAPHIRSCHWARZ M',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'd24ceb14-a2c1-54e0-aab3-349fd8bb2c7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'X1',
'odometer': 56385,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b/d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439364,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b/d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439364,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b/d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438120,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b/d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417799,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b/d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435328,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b/d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303227,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b/d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348799,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b/d24ceb14-a2c1-54e0-aab3-349fd8bb2c7b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432668,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/152df24736004dd3ada374fde9a7177a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-06',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 X1 sDrive18i 136ch xLine First Edition',
'transmission': 'automatic',
'trim': 'X1 sDrive18i 136ch xLine First Edition',
'vin': None,
'year': 2023}
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988281%27 HTTP/1.1" 200 None
2026-03-27 16:47:22 [ayvens.fr] INFO: Saving data for 1988281: {'created_time': 1774630042.611043, 'last_price_update_time': 1774630042.611055, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988281') HTTP/1.1" 204 0
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252F17dde39211e847bd9e90ff5b2e1cf0a4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/3.jpg not downloaded yet
2026-03-27 16:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252F17dde39211e847bd9e90ff5b2e1cf0a4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/4.jpg not downloaded yet
2026-03-27 16:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae0910>
2026-03-27 16:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d457b7d-b5eb-5001-8098-154178934e48/1d457b7d-b5eb-5001-8098-154178934e48_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F10d853b3d4ad4456a28a6bbb5fb69cca%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/8.jpg saved to cache
2026-03-27 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d457b7d-b5eb-5001-8098-154178934e48
2026-03-27 16:47:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d457b7d-b5eb-5001-8098-154178934e48, skipping ID generation
2026-03-27 16:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d457b7d-b5eb-5001-8098-154178934e48 with scrape type 1
2026-03-27 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d457b7d-b5eb-5001-8098-154178934e48 sending to next pipeline
2026-03-27 16:47:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1d457b7d-b5eb-5001-8098-154178934e48, identifier: 1988282
2026-03-27 16:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252F17dde39211e847bd9e90ff5b2e1cf0a4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/5.jpg not downloaded yet
2026-03-27 16:47:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1d457b7d-b5eb-5001-8098-154178934e48 with identifier: 1988282
2026-03-27 16:47:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:47:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1d457b7d-b5eb-5001-8098-154178934e48 with identifier: 1988282
2026-03-27 16:47:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1d457b7d-b5eb-5001-8098-154178934e48 with identifier: 1988282 to the API
2026-03-27 16:47:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'MINERALWEISS M',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '1d457b7d-b5eb-5001-8098-154178934e48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 1',
'odometer': 47979,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d457b7d-b5eb-5001-8098-154178934e48/1d457b7d-b5eb-5001-8098-154178934e48_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324266,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d457b7d-b5eb-5001-8098-154178934e48/1d457b7d-b5eb-5001-8098-154178934e48_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324266,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d457b7d-b5eb-5001-8098-154178934e48/1d457b7d-b5eb-5001-8098-154178934e48_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282506,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d457b7d-b5eb-5001-8098-154178934e48/1d457b7d-b5eb-5001-8098-154178934e48_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293942,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d457b7d-b5eb-5001-8098-154178934e48/1d457b7d-b5eb-5001-8098-154178934e48_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328243,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d457b7d-b5eb-5001-8098-154178934e48/1d457b7d-b5eb-5001-8098-154178934e48_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274257,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d457b7d-b5eb-5001-8098-154178934e48/1d457b7d-b5eb-5001-8098-154178934e48_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364688,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d457b7d-b5eb-5001-8098-154178934e48/1d457b7d-b5eb-5001-8098-154178934e48_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389042,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/10d853b3d4ad4456a28a6bbb5fb69cca/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-06',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 1 Série 1 116i 109ch Business Design',
'transmission': 'manual',
'trim': 'Série 1 116i 109ch Business Design',
'vin': None,
'year': 2024}
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988282%27 HTTP/1.1" 200 None
2026-03-27 16:47:23 [ayvens.fr] INFO: Saving data for 1988282: {'created_time': 1774630043.464134, 'last_price_update_time': 1774630043.464145, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988282') HTTP/1.1" 204 0
2026-03-27 16:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252F17dde39211e847bd9e90ff5b2e1cf0a4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/6.jpg not downloaded yet
2026-03-27 16:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592c40f90>
2026-03-27 16:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42abf82d-52d8-5f81-9d79-8af87d8b697c/42abf82d-52d8-5f81-9d79-8af87d8b697c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F5119f4eb75e4481a8691bdc916239aed%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/4.jpg saved to cache
2026-03-27 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 42abf82d-52d8-5f81-9d79-8af87d8b697c
2026-03-27 16:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051aa50>
2026-03-27 16:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42abf82d-52d8-5f81-9d79-8af87d8b697c/42abf82d-52d8-5f81-9d79-8af87d8b697c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F5119f4eb75e4481a8691bdc916239aed%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/3.jpg saved to cache
2026-03-27 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 42abf82d-52d8-5f81-9d79-8af87d8b697c
2026-03-27 16:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911061d0>
2026-03-27 16:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42abf82d-52d8-5f81-9d79-8af87d8b697c/42abf82d-52d8-5f81-9d79-8af87d8b697c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F5119f4eb75e4481a8691bdc916239aed%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/6.jpg saved to cache
2026-03-27 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 42abf82d-52d8-5f81-9d79-8af87d8b697c
2026-03-27 16:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592870b90>
2026-03-27 16:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42abf82d-52d8-5f81-9d79-8af87d8b697c/42abf82d-52d8-5f81-9d79-8af87d8b697c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F5119f4eb75e4481a8691bdc916239aed%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/5.jpg saved to cache
2026-03-27 16:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 42abf82d-52d8-5f81-9d79-8af87d8b697c
2026-03-27 16:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d97c50>
2026-03-27 16:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42abf82d-52d8-5f81-9d79-8af87d8b697c/42abf82d-52d8-5f81-9d79-8af87d8b697c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F5119f4eb75e4481a8691bdc916239aed%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/1.jpg saved to cache
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 42abf82d-52d8-5f81-9d79-8af87d8b697c
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252F17dde39211e847bd9e90ff5b2e1cf0a4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/7.jpg not downloaded yet
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252F17dde39211e847bd9e90ff5b2e1cf0a4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/8.jpg not downloaded yet
2026-03-27 16:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591483750>
2026-03-27 16:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42abf82d-52d8-5f81-9d79-8af87d8b697c/42abf82d-52d8-5f81-9d79-8af87d8b697c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F5119f4eb75e4481a8691bdc916239aed%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/7.jpg saved to cache
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 42abf82d-52d8-5f81-9d79-8af87d8b697c
2026-03-27 16:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f30f50>
2026-03-27 16:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42abf82d-52d8-5f81-9d79-8af87d8b697c/42abf82d-52d8-5f81-9d79-8af87d8b697c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F5119f4eb75e4481a8691bdc916239aed%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/2.jpg saved to cache
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 42abf82d-52d8-5f81-9d79-8af87d8b697c
2026-03-27 16:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:24 [ayvens.fr] INFO: Found listing with ID: 1988285
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988285%27 HTTP/1.1" 200 None
2026-03-27 16:47:24 [ayvens.fr] INFO: Scrape type for 1988285: 1
2026-03-27 16:47:24 [ayvens.fr] INFO: Extracting data for car ID: 1988285
2026-03-27 16:47:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ebab11a-2395-51c0-9074-da8a5b3303ad with identifier: 1988285
2026-03-27 16:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ebab11a-2395-51c0-9074-da8a5b3303ad with scrape type 1
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3ebab11a-2395-51c0-9074-da8a5b3303ad
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fb8e1b96305f64f88bcf823cad6376f3e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/1.jpg not downloaded yet
2026-03-27 16:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fb8e1b96305f64f88bcf823cad6376f3e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/2.jpg not downloaded yet
2026-03-27 16:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fb8e1b96305f64f88bcf823cad6376f3e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/3.jpg not downloaded yet
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fb8e1b96305f64f88bcf823cad6376f3e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/4.jpg not downloaded yet
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fb8e1b96305f64f88bcf823cad6376f3e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/5.jpg not downloaded yet
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fb8e1b96305f64f88bcf823cad6376f3e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/6.jpg not downloaded yet
2026-03-27 16:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd0e50>
2026-03-27 16:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a357cc-46a4-5eb2-9a63-75a02bced56c/87a357cc-46a4-5eb2-9a63-75a02bced56c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252F17dde39211e847bd9e90ff5b2e1cf0a4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/1.jpg saved to cache
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87a357cc-46a4-5eb2-9a63-75a02bced56c
2026-03-27 16:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590654f90>
2026-03-27 16:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a357cc-46a4-5eb2-9a63-75a02bced56c/87a357cc-46a4-5eb2-9a63-75a02bced56c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252F17dde39211e847bd9e90ff5b2e1cf0a4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/2.jpg saved to cache
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87a357cc-46a4-5eb2-9a63-75a02bced56c
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fb8e1b96305f64f88bcf823cad6376f3e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/7.jpg not downloaded yet
2026-03-27 16:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fb8e1b96305f64f88bcf823cad6376f3e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/8.jpg not downloaded yet
2026-03-27 16:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d8c7d0>
2026-03-27 16:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42abf82d-52d8-5f81-9d79-8af87d8b697c/42abf82d-52d8-5f81-9d79-8af87d8b697c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F5119f4eb75e4481a8691bdc916239aed%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/8.jpg saved to cache
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 42abf82d-52d8-5f81-9d79-8af87d8b697c
2026-03-27 16:47:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 42abf82d-52d8-5f81-9d79-8af87d8b697c, skipping ID generation
2026-03-27 16:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42abf82d-52d8-5f81-9d79-8af87d8b697c with scrape type 1
2026-03-27 16:47:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 42abf82d-52d8-5f81-9d79-8af87d8b697c sending to next pipeline
2026-03-27 16:47:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 42abf82d-52d8-5f81-9d79-8af87d8b697c, identifier: 1988283
2026-03-27 16:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ad4f90>
2026-03-27 16:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a357cc-46a4-5eb2-9a63-75a02bced56c/87a357cc-46a4-5eb2-9a63-75a02bced56c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252F17dde39211e847bd9e90ff5b2e1cf0a4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/4.jpg saved to cache
2026-03-27 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87a357cc-46a4-5eb2-9a63-75a02bced56c
2026-03-27 16:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc593178a90>
2026-03-27 16:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a357cc-46a4-5eb2-9a63-75a02bced56c/87a357cc-46a4-5eb2-9a63-75a02bced56c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252F17dde39211e847bd9e90ff5b2e1cf0a4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/3.jpg saved to cache
2026-03-27 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87a357cc-46a4-5eb2-9a63-75a02bced56c
2026-03-27 16:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9f210>
2026-03-27 16:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a357cc-46a4-5eb2-9a63-75a02bced56c/87a357cc-46a4-5eb2-9a63-75a02bced56c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252F17dde39211e847bd9e90ff5b2e1cf0a4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/6.jpg saved to cache
2026-03-27 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87a357cc-46a4-5eb2-9a63-75a02bced56c
2026-03-27 16:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f32ed0>
2026-03-27 16:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a357cc-46a4-5eb2-9a63-75a02bced56c/87a357cc-46a4-5eb2-9a63-75a02bced56c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252F17dde39211e847bd9e90ff5b2e1cf0a4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/5.jpg saved to cache
2026-03-27 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87a357cc-46a4-5eb2-9a63-75a02bced56c
2026-03-27 16:47:25 [ayvens.fr] INFO: Found listing with ID: 1988286
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988286%27 HTTP/1.1" 200 None
2026-03-27 16:47:25 [ayvens.fr] INFO: Scrape type for 1988286: 1
2026-03-27 16:47:25 [ayvens.fr] INFO: Extracting data for car ID: 1988286
2026-03-27 16:47:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0b3b197-72d5-5823-b384-a0ac816cd05d with identifier: 1988286
2026-03-27 16:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0b3b197-72d5-5823-b384-a0ac816cd05d with scrape type 1
2026-03-27 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e0b3b197-72d5-5823-b384-a0ac816cd05d
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc70119fdfe994c42ae3742524e9eea38%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/1.jpg not downloaded yet
2026-03-27 16:47:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 42abf82d-52d8-5f81-9d79-8af87d8b697c with identifier: 1988283
2026-03-27 16:47:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 42abf82d-52d8-5f81-9d79-8af87d8b697c with identifier: 1988283
2026-03-27 16:47:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 42abf82d-52d8-5f81-9d79-8af87d8b697c with identifier: 1988283 to the API
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '42abf82d-52d8-5f81-9d79-8af87d8b697c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 47396,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42abf82d-52d8-5f81-9d79-8af87d8b697c/42abf82d-52d8-5f81-9d79-8af87d8b697c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 631088,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42abf82d-52d8-5f81-9d79-8af87d8b697c/42abf82d-52d8-5f81-9d79-8af87d8b697c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 631088,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42abf82d-52d8-5f81-9d79-8af87d8b697c/42abf82d-52d8-5f81-9d79-8af87d8b697c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559923,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42abf82d-52d8-5f81-9d79-8af87d8b697c/42abf82d-52d8-5f81-9d79-8af87d8b697c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410926,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42abf82d-52d8-5f81-9d79-8af87d8b697c/42abf82d-52d8-5f81-9d79-8af87d8b697c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 452344,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42abf82d-52d8-5f81-9d79-8af87d8b697c/42abf82d-52d8-5f81-9d79-8af87d8b697c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405574,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42abf82d-52d8-5f81-9d79-8af87d8b697c/42abf82d-52d8-5f81-9d79-8af87d8b697c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338610,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42abf82d-52d8-5f81-9d79-8af87d8b697c/42abf82d-52d8-5f81-9d79-8af87d8b697c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 534341,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/5119f4eb75e4481a8691bdc916239aed/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 100ch S&S Active Pack',
'transmission': 'manual',
'trim': '2008 1.2 PureTech 100ch S&S Active Pack',
'vin': None,
'year': 2023}
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988283%27 HTTP/1.1" 200 None
2026-03-27 16:47:25 [ayvens.fr] INFO: Saving data for 1988283: {'created_time': 1774630045.680808, 'last_price_update_time': 1774630045.680821, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988283') HTTP/1.1" 204 0
2026-03-27 16:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc70119fdfe994c42ae3742524e9eea38%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/2.jpg not downloaded yet
2026-03-27 16:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051f0d0>
2026-03-27 16:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a357cc-46a4-5eb2-9a63-75a02bced56c/87a357cc-46a4-5eb2-9a63-75a02bced56c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252F17dde39211e847bd9e90ff5b2e1cf0a4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/7.jpg saved to cache
2026-03-27 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 87a357cc-46a4-5eb2-9a63-75a02bced56c
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b06610>
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a357cc-46a4-5eb2-9a63-75a02bced56c/87a357cc-46a4-5eb2-9a63-75a02bced56c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgx-%252F17dde39211e847bd9e90ff5b2e1cf0a4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/8.jpg saved to cache
2026-03-27 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87a357cc-46a4-5eb2-9a63-75a02bced56c
2026-03-27 16:47:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87a357cc-46a4-5eb2-9a63-75a02bced56c, skipping ID generation
2026-03-27 16:47:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87a357cc-46a4-5eb2-9a63-75a02bced56c with scrape type 1
2026-03-27 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87a357cc-46a4-5eb2-9a63-75a02bced56c sending to next pipeline
2026-03-27 16:47:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 87a357cc-46a4-5eb2-9a63-75a02bced56c, identifier: 1988284
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc70119fdfe994c42ae3742524e9eea38%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/3.jpg not downloaded yet
2026-03-27 16:47:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 87a357cc-46a4-5eb2-9a63-75a02bced56c with identifier: 1988284
2026-03-27 16:47:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:47:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 87a357cc-46a4-5eb2-9a63-75a02bced56c with identifier: 1988284
2026-03-27 16:47:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 87a357cc-46a4-5eb2-9a63-75a02bced56c with identifier: 1988284 to the API
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 25,
'color': 'VERT BORNEO',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '87a357cc-46a4-5eb2-9a63-75a02bced56c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 48224,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a357cc-46a4-5eb2-9a63-75a02bced56c/87a357cc-46a4-5eb2-9a63-75a02bced56c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438275,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a357cc-46a4-5eb2-9a63-75a02bced56c/87a357cc-46a4-5eb2-9a63-75a02bced56c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438275,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a357cc-46a4-5eb2-9a63-75a02bced56c/87a357cc-46a4-5eb2-9a63-75a02bced56c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446854,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a357cc-46a4-5eb2-9a63-75a02bced56c/87a357cc-46a4-5eb2-9a63-75a02bced56c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401189,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a357cc-46a4-5eb2-9a63-75a02bced56c/87a357cc-46a4-5eb2-9a63-75a02bced56c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330728,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a357cc-46a4-5eb2-9a63-75a02bced56c/87a357cc-46a4-5eb2-9a63-75a02bced56c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376946,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a357cc-46a4-5eb2-9a63-75a02bced56c/87a357cc-46a4-5eb2-9a63-75a02bced56c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352117,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a357cc-46a4-5eb2-9a63-75a02bced56c/87a357cc-46a4-5eb2-9a63-75a02bced56c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236438,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gx-/17dde39211e847bd9e90ff5b2e1cf0a4/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-06-18',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 265ch PHEV Active Business BVA6 4x4',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 265ch PHEV Active Business BVA6 4x4',
'vin': None,
'year': 2024}
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988284%27 HTTP/1.1" 200 None
2026-03-27 16:47:26 [ayvens.fr] INFO: Saving data for 1988284: {'created_time': 1774630046.559746, 'last_price_update_time': 1774630046.559758, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988284') HTTP/1.1" 204 0
2026-03-27 16:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc70119fdfe994c42ae3742524e9eea38%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/4.jpg not downloaded yet
2026-03-27 16:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592c74c90>
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebab11a-2395-51c0-9074-da8a5b3303ad/3ebab11a-2395-51c0-9074-da8a5b3303ad_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fb8e1b96305f64f88bcf823cad6376f3e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/2.jpg saved to cache
2026-03-27 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ebab11a-2395-51c0-9074-da8a5b3303ad
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b62390>
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebab11a-2395-51c0-9074-da8a5b3303ad/3ebab11a-2395-51c0-9074-da8a5b3303ad_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fb8e1b96305f64f88bcf823cad6376f3e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/3.jpg saved to cache
2026-03-27 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ebab11a-2395-51c0-9074-da8a5b3303ad
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b74310>
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebab11a-2395-51c0-9074-da8a5b3303ad/3ebab11a-2395-51c0-9074-da8a5b3303ad_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fb8e1b96305f64f88bcf823cad6376f3e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/1.jpg saved to cache
2026-03-27 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ebab11a-2395-51c0-9074-da8a5b3303ad
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051e390>
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebab11a-2395-51c0-9074-da8a5b3303ad/3ebab11a-2395-51c0-9074-da8a5b3303ad_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fb8e1b96305f64f88bcf823cad6376f3e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/4.jpg saved to cache
2026-03-27 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ebab11a-2395-51c0-9074-da8a5b3303ad
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc70119fdfe994c42ae3742524e9eea38%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/5.jpg not downloaded yet
2026-03-27 16:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc70119fdfe994c42ae3742524e9eea38%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/6.jpg not downloaded yet
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590656350>
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebab11a-2395-51c0-9074-da8a5b3303ad/3ebab11a-2395-51c0-9074-da8a5b3303ad_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fb8e1b96305f64f88bcf823cad6376f3e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/6.jpg saved to cache
2026-03-27 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ebab11a-2395-51c0-9074-da8a5b3303ad
2026-03-27 16:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dffdd0>
2026-03-27 16:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebab11a-2395-51c0-9074-da8a5b3303ad/3ebab11a-2395-51c0-9074-da8a5b3303ad_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fb8e1b96305f64f88bcf823cad6376f3e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/5.jpg saved to cache
2026-03-27 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ebab11a-2395-51c0-9074-da8a5b3303ad
2026-03-27 16:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590518a10>
2026-03-27 16:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebab11a-2395-51c0-9074-da8a5b3303ad/3ebab11a-2395-51c0-9074-da8a5b3303ad_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fb8e1b96305f64f88bcf823cad6376f3e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/7.jpg saved to cache
2026-03-27 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ebab11a-2395-51c0-9074-da8a5b3303ad
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc70119fdfe994c42ae3742524e9eea38%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/7.jpg not downloaded yet
2026-03-27 16:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc70119fdfe994c42ae3742524e9eea38%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/8.jpg not downloaded yet
2026-03-27 16:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe0d50>
2026-03-27 16:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebab11a-2395-51c0-9074-da8a5b3303ad/3ebab11a-2395-51c0-9074-da8a5b3303ad_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fb8e1b96305f64f88bcf823cad6376f3e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/8.jpg saved to cache
2026-03-27 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ebab11a-2395-51c0-9074-da8a5b3303ad
2026-03-27 16:47:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ebab11a-2395-51c0-9074-da8a5b3303ad, skipping ID generation
2026-03-27 16:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ebab11a-2395-51c0-9074-da8a5b3303ad with scrape type 1
2026-03-27 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ebab11a-2395-51c0-9074-da8a5b3303ad sending to next pipeline
2026-03-27 16:47:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3ebab11a-2395-51c0-9074-da8a5b3303ad, identifier: 1988285
2026-03-27 16:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc593546c10>
2026-03-27 16:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0b3b197-72d5-5823-b384-a0ac816cd05d/e0b3b197-72d5-5823-b384-a0ac816cd05d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc70119fdfe994c42ae3742524e9eea38%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/1.jpg saved to cache
2026-03-27 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0b3b197-72d5-5823-b384-a0ac816cd05d
2026-03-27 16:47:27 [ayvens.fr] INFO: Found listing with ID: 1988287
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988287%27 HTTP/1.1" 200 None
2026-03-27 16:47:27 [ayvens.fr] INFO: Scrape type for 1988287: 1
2026-03-27 16:47:27 [ayvens.fr] INFO: Extracting data for car ID: 1988287
2026-03-27 16:47:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3a2631a-880c-54c8-b3f6-93e0dbfebd6a with identifier: 1988287
2026-03-27 16:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3a2631a-880c-54c8-b3f6-93e0dbfebd6a with scrape type 1
2026-03-27 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e3a2631a-880c-54c8-b3f6-93e0dbfebd6a
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252F38d60ac9e5c14c2ca957cdaa85f6f386%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/1.jpg not downloaded yet
2026-03-27 16:47:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3ebab11a-2395-51c0-9074-da8a5b3303ad with identifier: 1988285
2026-03-27 16:47:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:47:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3ebab11a-2395-51c0-9074-da8a5b3303ad with identifier: 1988285
2026-03-27 16:47:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3ebab11a-2395-51c0-9074-da8a5b3303ad with identifier: 1988285 to the API
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 135,
'color': 'GRIS ECLIPSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '3ebab11a-2395-51c0-9074-da8a5b3303ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 48436,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebab11a-2395-51c0-9074-da8a5b3303ad/3ebab11a-2395-51c0-9074-da8a5b3303ad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318293,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebab11a-2395-51c0-9074-da8a5b3303ad/3ebab11a-2395-51c0-9074-da8a5b3303ad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318293,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebab11a-2395-51c0-9074-da8a5b3303ad/3ebab11a-2395-51c0-9074-da8a5b3303ad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293622,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebab11a-2395-51c0-9074-da8a5b3303ad/3ebab11a-2395-51c0-9074-da8a5b3303ad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290789,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebab11a-2395-51c0-9074-da8a5b3303ad/3ebab11a-2395-51c0-9074-da8a5b3303ad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341159,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebab11a-2395-51c0-9074-da8a5b3303ad/3ebab11a-2395-51c0-9074-da8a5b3303ad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297212,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebab11a-2395-51c0-9074-da8a5b3303ad/3ebab11a-2395-51c0-9074-da8a5b3303ad_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338914,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebab11a-2395-51c0-9074-da8a5b3303ad/3ebab11a-2395-51c0-9074-da8a5b3303ad_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300183,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/b8e1b96305f64f88bcf823cad6376f3e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-12',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 230ch HEV Active Business BVA6 4x2',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 230ch HEV Active Business BVA6 4x2',
'vin': None,
'year': 2022}
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988285%27 HTTP/1.1" 200 None
2026-03-27 16:47:28 [ayvens.fr] INFO: Saving data for 1988285: {'created_time': 1774630048.049267, 'last_price_update_time': 1774630048.049279, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988285') HTTP/1.1" 204 0
2026-03-27 16:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252F38d60ac9e5c14c2ca957cdaa85f6f386%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/2.jpg not downloaded yet
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d04d0>
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0b3b197-72d5-5823-b384-a0ac816cd05d/e0b3b197-72d5-5823-b384-a0ac816cd05d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc70119fdfe994c42ae3742524e9eea38%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/2.jpg saved to cache
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e0b3b197-72d5-5823-b384-a0ac816cd05d
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252F38d60ac9e5c14c2ca957cdaa85f6f386%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/3.jpg not downloaded yet
2026-03-27 16:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252F38d60ac9e5c14c2ca957cdaa85f6f386%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/4.jpg not downloaded yet
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252F38d60ac9e5c14c2ca957cdaa85f6f386%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/5.jpg not downloaded yet
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b886d0>
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0b3b197-72d5-5823-b384-a0ac816cd05d/e0b3b197-72d5-5823-b384-a0ac816cd05d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc70119fdfe994c42ae3742524e9eea38%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/3.jpg saved to cache
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e0b3b197-72d5-5823-b384-a0ac816cd05d
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252F38d60ac9e5c14c2ca957cdaa85f6f386%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/6.jpg not downloaded yet
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c16d0>
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0b3b197-72d5-5823-b384-a0ac816cd05d/e0b3b197-72d5-5823-b384-a0ac816cd05d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc70119fdfe994c42ae3742524e9eea38%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/4.jpg saved to cache
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e0b3b197-72d5-5823-b384-a0ac816cd05d
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252F38d60ac9e5c14c2ca957cdaa85f6f386%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/7.jpg not downloaded yet
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592c74c10>
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0b3b197-72d5-5823-b384-a0ac816cd05d/e0b3b197-72d5-5823-b384-a0ac816cd05d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc70119fdfe994c42ae3742524e9eea38%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/5.jpg saved to cache
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e0b3b197-72d5-5823-b384-a0ac816cd05d
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59287bf10>
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0b3b197-72d5-5823-b384-a0ac816cd05d/e0b3b197-72d5-5823-b384-a0ac816cd05d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc70119fdfe994c42ae3742524e9eea38%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/6.jpg saved to cache
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e0b3b197-72d5-5823-b384-a0ac816cd05d
2026-03-27 16:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252F38d60ac9e5c14c2ca957cdaa85f6f386%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/8.jpg not downloaded yet
2026-03-27 16:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:28 [ayvens.fr] INFO: Found listing with ID: 1988288
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988288%27 HTTP/1.1" 200 None
2026-03-27 16:47:28 [ayvens.fr] INFO: Scrape type for 1988288: 1
2026-03-27 16:47:28 [ayvens.fr] INFO: Extracting data for car ID: 1988288
2026-03-27 16:47:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19478576-873d-5078-b0e9-483278803a4d with identifier: 1988288
2026-03-27 16:47:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19478576-873d-5078-b0e9-483278803a4d with scrape type 1
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 19478576-873d-5078-b0e9-483278803a4d
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F0a8aa190df294cd39134627170308780%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/1.jpg not downloaded yet
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F0a8aa190df294cd39134627170308780%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/2.jpg not downloaded yet
2026-03-27 16:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F0a8aa190df294cd39134627170308780%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/3.jpg not downloaded yet
2026-03-27 16:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F0a8aa190df294cd39134627170308780%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/4.jpg not downloaded yet
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc4690>
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0b3b197-72d5-5823-b384-a0ac816cd05d/e0b3b197-72d5-5823-b384-a0ac816cd05d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc70119fdfe994c42ae3742524e9eea38%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/7.jpg saved to cache
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e0b3b197-72d5-5823-b384-a0ac816cd05d
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F0a8aa190df294cd39134627170308780%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/5.jpg not downloaded yet
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfe350>
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0b3b197-72d5-5823-b384-a0ac816cd05d/e0b3b197-72d5-5823-b384-a0ac816cd05d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc70119fdfe994c42ae3742524e9eea38%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/8.jpg saved to cache
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e0b3b197-72d5-5823-b384-a0ac816cd05d
2026-03-27 16:47:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0b3b197-72d5-5823-b384-a0ac816cd05d, skipping ID generation
2026-03-27 16:47:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0b3b197-72d5-5823-b384-a0ac816cd05d with scrape type 1
2026-03-27 16:47:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0b3b197-72d5-5823-b384-a0ac816cd05d sending to next pipeline
2026-03-27 16:47:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e0b3b197-72d5-5823-b384-a0ac816cd05d, identifier: 1988286
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F0a8aa190df294cd39134627170308780%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/6.jpg not downloaded yet
2026-03-27 16:47:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e0b3b197-72d5-5823-b384-a0ac816cd05d with identifier: 1988286
2026-03-27 16:47:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e0b3b197-72d5-5823-b384-a0ac816cd05d with identifier: 1988286
2026-03-27 16:47:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e0b3b197-72d5-5823-b384-a0ac816cd05d with identifier: 1988286 to the API
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'e0b3b197-72d5-5823-b384-a0ac816cd05d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 116249,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0b3b197-72d5-5823-b384-a0ac816cd05d/e0b3b197-72d5-5823-b384-a0ac816cd05d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301968,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0b3b197-72d5-5823-b384-a0ac816cd05d/e0b3b197-72d5-5823-b384-a0ac816cd05d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301968,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0b3b197-72d5-5823-b384-a0ac816cd05d/e0b3b197-72d5-5823-b384-a0ac816cd05d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322518,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0b3b197-72d5-5823-b384-a0ac816cd05d/e0b3b197-72d5-5823-b384-a0ac816cd05d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342536,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0b3b197-72d5-5823-b384-a0ac816cd05d/e0b3b197-72d5-5823-b384-a0ac816cd05d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368448,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0b3b197-72d5-5823-b384-a0ac816cd05d/e0b3b197-72d5-5823-b384-a0ac816cd05d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360512,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0b3b197-72d5-5823-b384-a0ac816cd05d/e0b3b197-72d5-5823-b384-a0ac816cd05d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 278010,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0b3b197-72d5-5823-b384-a0ac816cd05d/e0b3b197-72d5-5823-b384-a0ac816cd05d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325771,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c70119fdfe994c42ae3742524e9eea38/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-21',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Active Pack EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch S&S Active Pack EAT8',
'vin': None,
'year': 2023}
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988286%27 HTTP/1.1" 200 None
2026-03-27 16:47:29 [ayvens.fr] INFO: Saving data for 1988286: {'created_time': 1774630049.760492, 'last_price_update_time': 1774630049.760508, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988286') HTTP/1.1" 204 0
2026-03-27 16:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0f6d0>
2026-03-27 16:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3a2631a-880c-54c8-b3f6-93e0dbfebd6a/e3a2631a-880c-54c8-b3f6-93e0dbfebd6a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252F38d60ac9e5c14c2ca957cdaa85f6f386%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/1.jpg saved to cache
2026-03-27 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3a2631a-880c-54c8-b3f6-93e0dbfebd6a
2026-03-27 16:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d80e50>
2026-03-27 16:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3a2631a-880c-54c8-b3f6-93e0dbfebd6a/e3a2631a-880c-54c8-b3f6-93e0dbfebd6a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252F38d60ac9e5c14c2ca957cdaa85f6f386%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/3.jpg saved to cache
2026-03-27 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3a2631a-880c-54c8-b3f6-93e0dbfebd6a
2026-03-27 16:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d77b10>
2026-03-27 16:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3a2631a-880c-54c8-b3f6-93e0dbfebd6a/e3a2631a-880c-54c8-b3f6-93e0dbfebd6a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252F38d60ac9e5c14c2ca957cdaa85f6f386%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/2.jpg saved to cache
2026-03-27 16:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e3a2631a-880c-54c8-b3f6-93e0dbfebd6a
2026-03-27 16:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590590610>
2026-03-27 16:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3a2631a-880c-54c8-b3f6-93e0dbfebd6a/e3a2631a-880c-54c8-b3f6-93e0dbfebd6a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252F38d60ac9e5c14c2ca957cdaa85f6f386%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/4.jpg saved to cache
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3a2631a-880c-54c8-b3f6-93e0dbfebd6a
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d76ad0>
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3a2631a-880c-54c8-b3f6-93e0dbfebd6a/e3a2631a-880c-54c8-b3f6-93e0dbfebd6a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252F38d60ac9e5c14c2ca957cdaa85f6f386%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/5.jpg saved to cache
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e3a2631a-880c-54c8-b3f6-93e0dbfebd6a
2026-03-27 16:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F0a8aa190df294cd39134627170308780%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/7.jpg not downloaded yet
2026-03-27 16:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F0a8aa190df294cd39134627170308780%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/8.jpg not downloaded yet
2026-03-27 16:47:30 [ayvens.fr] INFO: Found listing with ID: 1988289
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988289%27 HTTP/1.1" 200 None
2026-03-27 16:47:30 [ayvens.fr] INFO: Scrape type for 1988289: 1
2026-03-27 16:47:30 [ayvens.fr] INFO: Extracting data for car ID: 1988289
2026-03-27 16:47:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c322516-08fb-5136-b126-4718c0da6b1e with identifier: 1988289
2026-03-27 16:47:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c322516-08fb-5136-b126-4718c0da6b1e with scrape type 1
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 8c322516-08fb-5136-b126-4718c0da6b1e
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9ae732e922e6469ebb3aff465976ade2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/1.jpg not downloaded yet
2026-03-27 16:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9ae732e922e6469ebb3aff465976ade2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/2.jpg not downloaded yet
2026-03-27 16:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9ae732e922e6469ebb3aff465976ade2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/3.jpg not downloaded yet
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9ae732e922e6469ebb3aff465976ade2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/4.jpg not downloaded yet
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591104bd0>
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3a2631a-880c-54c8-b3f6-93e0dbfebd6a/e3a2631a-880c-54c8-b3f6-93e0dbfebd6a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252F38d60ac9e5c14c2ca957cdaa85f6f386%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/6.jpg saved to cache
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e3a2631a-880c-54c8-b3f6-93e0dbfebd6a
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9ae732e922e6469ebb3aff465976ade2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/5.jpg not downloaded yet
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591106a50>
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3a2631a-880c-54c8-b3f6-93e0dbfebd6a/e3a2631a-880c-54c8-b3f6-93e0dbfebd6a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252F38d60ac9e5c14c2ca957cdaa85f6f386%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/7.jpg saved to cache
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e3a2631a-880c-54c8-b3f6-93e0dbfebd6a
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9ae732e922e6469ebb3aff465976ade2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/6.jpg not downloaded yet
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9ae732e922e6469ebb3aff465976ade2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/7.jpg not downloaded yet
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592c403d0>
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3a2631a-880c-54c8-b3f6-93e0dbfebd6a/e3a2631a-880c-54c8-b3f6-93e0dbfebd6a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252F38d60ac9e5c14c2ca957cdaa85f6f386%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/8.jpg saved to cache
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e3a2631a-880c-54c8-b3f6-93e0dbfebd6a
2026-03-27 16:47:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3a2631a-880c-54c8-b3f6-93e0dbfebd6a, skipping ID generation
2026-03-27 16:47:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3a2631a-880c-54c8-b3f6-93e0dbfebd6a with scrape type 1
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3a2631a-880c-54c8-b3f6-93e0dbfebd6a sending to next pipeline
2026-03-27 16:47:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e3a2631a-880c-54c8-b3f6-93e0dbfebd6a, identifier: 1988287
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905912d0>
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19478576-873d-5078-b0e9-483278803a4d/19478576-873d-5078-b0e9-483278803a4d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F0a8aa190df294cd39134627170308780%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/1.jpg saved to cache
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19478576-873d-5078-b0e9-483278803a4d
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592ff0b10>
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19478576-873d-5078-b0e9-483278803a4d/19478576-873d-5078-b0e9-483278803a4d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F0a8aa190df294cd39134627170308780%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/2.jpg saved to cache
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 19478576-873d-5078-b0e9-483278803a4d
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592c40c10>
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19478576-873d-5078-b0e9-483278803a4d/19478576-873d-5078-b0e9-483278803a4d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F0a8aa190df294cd39134627170308780%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/3.jpg saved to cache
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 19478576-873d-5078-b0e9-483278803a4d
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6eb50>
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19478576-873d-5078-b0e9-483278803a4d/19478576-873d-5078-b0e9-483278803a4d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F0a8aa190df294cd39134627170308780%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/4.jpg saved to cache
2026-03-27 16:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 19478576-873d-5078-b0e9-483278803a4d
2026-03-27 16:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e3a2631a-880c-54c8-b3f6-93e0dbfebd6a with identifier: 1988287
2026-03-27 16:47:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e3a2631a-880c-54c8-b3f6-93e0dbfebd6a with identifier: 1988287
2026-03-27 16:47:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e3a2631a-880c-54c8-b3f6-93e0dbfebd6a with identifier: 1988287 to the API
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'e3a2631a-880c-54c8-b3f6-93e0dbfebd6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 17918,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3a2631a-880c-54c8-b3f6-93e0dbfebd6a/e3a2631a-880c-54c8-b3f6-93e0dbfebd6a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361201,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3a2631a-880c-54c8-b3f6-93e0dbfebd6a/e3a2631a-880c-54c8-b3f6-93e0dbfebd6a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361201,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3a2631a-880c-54c8-b3f6-93e0dbfebd6a/e3a2631a-880c-54c8-b3f6-93e0dbfebd6a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 278927,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3a2631a-880c-54c8-b3f6-93e0dbfebd6a/e3a2631a-880c-54c8-b3f6-93e0dbfebd6a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340067,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3a2631a-880c-54c8-b3f6-93e0dbfebd6a/e3a2631a-880c-54c8-b3f6-93e0dbfebd6a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357044,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3a2631a-880c-54c8-b3f6-93e0dbfebd6a/e3a2631a-880c-54c8-b3f6-93e0dbfebd6a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316926,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3a2631a-880c-54c8-b3f6-93e0dbfebd6a/e3a2631a-880c-54c8-b3f6-93e0dbfebd6a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285147,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3a2631a-880c-54c8-b3f6-93e0dbfebd6a/e3a2631a-880c-54c8-b3f6-93e0dbfebd6a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353970,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/et-/38d60ac9e5c14c2ca957cdaa85f6f386/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-24',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 PureTech 82ch Feel',
'transmission': 'manual',
'trim': 'C3 PureTech 82ch Feel',
'vin': None,
'year': 2018}
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988287%27 HTTP/1.1" 200 None
2026-03-27 16:47:31 [ayvens.fr] INFO: Saving data for 1988287: {'created_time': 1774630051.632571, 'last_price_update_time': 1774630051.632582, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988287') HTTP/1.1" 204 0
2026-03-27 16:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9ae732e922e6469ebb3aff465976ade2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/8.jpg not downloaded yet
2026-03-27 16:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:31 [ayvens.fr] INFO: Found listing with ID: 1988290
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988290%27 HTTP/1.1" 200 None
2026-03-27 16:47:31 [ayvens.fr] INFO: Scrape type for 1988290: 1
2026-03-27 16:47:31 [ayvens.fr] INFO: Extracting data for car ID: 1988290
2026-03-27 16:47:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6aa77b4e-d331-5aa1-977a-96ee72f0436f with identifier: 1988290
2026-03-27 16:47:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aa77b4e-d331-5aa1-977a-96ee72f0436f with scrape type 1
2026-03-27 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6aa77b4e-d331-5aa1-977a-96ee72f0436f
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7b4eaf3e053142378c332ee708210e49%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/1.jpg not downloaded yet
2026-03-27 16:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc4150>
2026-03-27 16:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19478576-873d-5078-b0e9-483278803a4d/19478576-873d-5078-b0e9-483278803a4d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F0a8aa190df294cd39134627170308780%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/8.jpg saved to cache
2026-03-27 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 19478576-873d-5078-b0e9-483278803a4d
2026-03-27 16:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7b4eaf3e053142378c332ee708210e49%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/2.jpg not downloaded yet
2026-03-27 16:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7b4eaf3e053142378c332ee708210e49%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/3.jpg not downloaded yet
2026-03-27 16:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591445a50>
2026-03-27 16:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19478576-873d-5078-b0e9-483278803a4d/19478576-873d-5078-b0e9-483278803a4d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F0a8aa190df294cd39134627170308780%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/5.jpg saved to cache
2026-03-27 16:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 19478576-873d-5078-b0e9-483278803a4d
2026-03-27 16:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051b6d0>
2026-03-27 16:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19478576-873d-5078-b0e9-483278803a4d/19478576-873d-5078-b0e9-483278803a4d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F0a8aa190df294cd39134627170308780%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/7.jpg saved to cache
2026-03-27 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 19478576-873d-5078-b0e9-483278803a4d
2026-03-27 16:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfc250>
2026-03-27 16:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c322516-08fb-5136-b126-4718c0da6b1e/8c322516-08fb-5136-b126-4718c0da6b1e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9ae732e922e6469ebb3aff465976ade2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/1.jpg saved to cache
2026-03-27 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c322516-08fb-5136-b126-4718c0da6b1e
2026-03-27 16:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b078d0>
2026-03-27 16:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19478576-873d-5078-b0e9-483278803a4d/19478576-873d-5078-b0e9-483278803a4d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F0a8aa190df294cd39134627170308780%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/6.jpg saved to cache
2026-03-27 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 19478576-873d-5078-b0e9-483278803a4d
2026-03-27 16:47:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19478576-873d-5078-b0e9-483278803a4d, skipping ID generation
2026-03-27 16:47:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19478576-873d-5078-b0e9-483278803a4d with scrape type 1
2026-03-27 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19478576-873d-5078-b0e9-483278803a4d sending to next pipeline
2026-03-27 16:47:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 19478576-873d-5078-b0e9-483278803a4d, identifier: 1988288
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7b4eaf3e053142378c332ee708210e49%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/4.jpg not downloaded yet
2026-03-27 16:47:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 19478576-873d-5078-b0e9-483278803a4d with identifier: 1988288
2026-03-27 16:47:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 19478576-873d-5078-b0e9-483278803a4d with identifier: 1988288
2026-03-27 16:47:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 19478576-873d-5078-b0e9-483278803a4d with identifier: 1988288 to the API
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 128,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '19478576-873d-5078-b0e9-483278803a4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'PASSAT SW',
'odometer': 128777,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19478576-873d-5078-b0e9-483278803a4d/19478576-873d-5078-b0e9-483278803a4d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529240,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19478576-873d-5078-b0e9-483278803a4d/19478576-873d-5078-b0e9-483278803a4d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529240,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19478576-873d-5078-b0e9-483278803a4d/19478576-873d-5078-b0e9-483278803a4d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541370,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19478576-873d-5078-b0e9-483278803a4d/19478576-873d-5078-b0e9-483278803a4d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409039,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19478576-873d-5078-b0e9-483278803a4d/19478576-873d-5078-b0e9-483278803a4d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446987,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19478576-873d-5078-b0e9-483278803a4d/19478576-873d-5078-b0e9-483278803a4d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426101,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19478576-873d-5078-b0e9-483278803a4d/19478576-873d-5078-b0e9-483278803a4d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418425,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19478576-873d-5078-b0e9-483278803a4d/19478576-873d-5078-b0e9-483278803a4d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287710,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/0a8aa190df294cd39134627170308780/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-17',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN PASSAT SW Passat SW 2.0 TDI EVO 150ch Business DSG7',
'transmission': 'automatic',
'trim': 'Passat SW 2.0 TDI EVO 150ch Business DSG7',
'vin': None,
'year': 2021}
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988288%27 HTTP/1.1" 200 None
2026-03-27 16:47:32 [ayvens.fr] INFO: Saving data for 1988288: {'created_time': 1774630052.678953, 'last_price_update_time': 1774630052.678965, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988288') HTTP/1.1" 204 0
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7b4eaf3e053142378c332ee708210e49%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/5.jpg not downloaded yet
2026-03-27 16:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc5c10>
2026-03-27 16:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c322516-08fb-5136-b126-4718c0da6b1e/8c322516-08fb-5136-b126-4718c0da6b1e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9ae732e922e6469ebb3aff465976ade2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/3.jpg saved to cache
2026-03-27 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c322516-08fb-5136-b126-4718c0da6b1e
2026-03-27 16:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d53810>
2026-03-27 16:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c322516-08fb-5136-b126-4718c0da6b1e/8c322516-08fb-5136-b126-4718c0da6b1e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9ae732e922e6469ebb3aff465976ade2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/2.jpg saved to cache
2026-03-27 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c322516-08fb-5136-b126-4718c0da6b1e
2026-03-27 16:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d746d0>
2026-03-27 16:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c322516-08fb-5136-b126-4718c0da6b1e/8c322516-08fb-5136-b126-4718c0da6b1e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9ae732e922e6469ebb3aff465976ade2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/4.jpg saved to cache
2026-03-27 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c322516-08fb-5136-b126-4718c0da6b1e
2026-03-27 16:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7b4eaf3e053142378c332ee708210e49%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/6.jpg not downloaded yet
2026-03-27 16:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7b4eaf3e053142378c332ee708210e49%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/7.jpg not downloaded yet
2026-03-27 16:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7b4eaf3e053142378c332ee708210e49%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/8.jpg not downloaded yet
2026-03-27 16:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:33 [ayvens.fr] INFO: Found listing with ID: 1988291
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988291%27 HTTP/1.1" 200 None
2026-03-27 16:47:33 [ayvens.fr] INFO: Scrape type for 1988291: 1
2026-03-27 16:47:33 [ayvens.fr] INFO: Extracting data for car ID: 1988291
2026-03-27 16:47:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a72c7933-71b7-5d14-a331-e8e32fd55042 with identifier: 1988291
2026-03-27 16:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a72c7933-71b7-5d14-a331-e8e32fd55042 with scrape type 1
2026-03-27 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a72c7933-71b7-5d14-a331-e8e32fd55042
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7ed3b4bebf854074b64463d03be9e7c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/1.jpg not downloaded yet
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7ed3b4bebf854074b64463d03be9e7c8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/2.jpg not downloaded yet
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7ed3b4bebf854074b64463d03be9e7c8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/3.jpg not downloaded yet
2026-03-27 16:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dbbf50>
2026-03-27 16:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c322516-08fb-5136-b126-4718c0da6b1e/8c322516-08fb-5136-b126-4718c0da6b1e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9ae732e922e6469ebb3aff465976ade2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/5.jpg saved to cache
2026-03-27 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c322516-08fb-5136-b126-4718c0da6b1e
2026-03-27 16:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b19a50>
2026-03-27 16:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c322516-08fb-5136-b126-4718c0da6b1e/8c322516-08fb-5136-b126-4718c0da6b1e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9ae732e922e6469ebb3aff465976ade2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/7.jpg saved to cache
2026-03-27 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c322516-08fb-5136-b126-4718c0da6b1e
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7ed3b4bebf854074b64463d03be9e7c8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/4.jpg not downloaded yet
2026-03-27 16:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dbb8d0>
2026-03-27 16:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c322516-08fb-5136-b126-4718c0da6b1e/8c322516-08fb-5136-b126-4718c0da6b1e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9ae732e922e6469ebb3aff465976ade2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/6.jpg saved to cache
2026-03-27 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c322516-08fb-5136-b126-4718c0da6b1e
2026-03-27 16:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee0f90>
2026-03-27 16:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c322516-08fb-5136-b126-4718c0da6b1e/8c322516-08fb-5136-b126-4718c0da6b1e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F9ae732e922e6469ebb3aff465976ade2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/8.jpg saved to cache
2026-03-27 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c322516-08fb-5136-b126-4718c0da6b1e
2026-03-27 16:47:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c322516-08fb-5136-b126-4718c0da6b1e, skipping ID generation
2026-03-27 16:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c322516-08fb-5136-b126-4718c0da6b1e with scrape type 1
2026-03-27 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c322516-08fb-5136-b126-4718c0da6b1e sending to next pipeline
2026-03-27 16:47:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8c322516-08fb-5136-b126-4718c0da6b1e, identifier: 1988289
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7ed3b4bebf854074b64463d03be9e7c8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/5.jpg not downloaded yet
2026-03-27 16:47:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8c322516-08fb-5136-b126-4718c0da6b1e with identifier: 1988289
2026-03-27 16:47:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:47:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8c322516-08fb-5136-b126-4718c0da6b1e with identifier: 1988289
2026-03-27 16:47:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8c322516-08fb-5136-b126-4718c0da6b1e with identifier: 1988289 to the API
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'JAUNE FARO',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '8c322516-08fb-5136-b126-4718c0da6b1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'E-208',
'odometer': 64880,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c322516-08fb-5136-b126-4718c0da6b1e/8c322516-08fb-5136-b126-4718c0da6b1e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418265,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c322516-08fb-5136-b126-4718c0da6b1e/8c322516-08fb-5136-b126-4718c0da6b1e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418265,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c322516-08fb-5136-b126-4718c0da6b1e/8c322516-08fb-5136-b126-4718c0da6b1e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406332,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c322516-08fb-5136-b126-4718c0da6b1e/8c322516-08fb-5136-b126-4718c0da6b1e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431920,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c322516-08fb-5136-b126-4718c0da6b1e/8c322516-08fb-5136-b126-4718c0da6b1e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338583,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c322516-08fb-5136-b126-4718c0da6b1e/8c322516-08fb-5136-b126-4718c0da6b1e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401180,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c322516-08fb-5136-b126-4718c0da6b1e/8c322516-08fb-5136-b126-4718c0da6b1e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321119,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c322516-08fb-5136-b126-4718c0da6b1e/8c322516-08fb-5136-b126-4718c0da6b1e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346315,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/9ae732e922e6469ebb3aff465976ade2/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-10',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT E-208 208 e-208 136ch GT Line',
'transmission': 'automatic',
'trim': '208 e-208 136ch GT Line',
'vin': None,
'year': 2019}
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988289%27 HTTP/1.1" 200 None
2026-03-27 16:47:33 [ayvens.fr] INFO: Saving data for 1988289: {'created_time': 1774630053.910471, 'last_price_update_time': 1774630053.910483, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988289') HTTP/1.1" 204 0
2026-03-27 16:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7ed3b4bebf854074b64463d03be9e7c8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/6.jpg not downloaded yet
2026-03-27 16:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59285bc50>
2026-03-27 16:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aa77b4e-d331-5aa1-977a-96ee72f0436f/6aa77b4e-d331-5aa1-977a-96ee72f0436f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7b4eaf3e053142378c332ee708210e49%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/1.jpg saved to cache
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6aa77b4e-d331-5aa1-977a-96ee72f0436f
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591480510>
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aa77b4e-d331-5aa1-977a-96ee72f0436f/6aa77b4e-d331-5aa1-977a-96ee72f0436f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7b4eaf3e053142378c332ee708210e49%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/3.jpg saved to cache
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6aa77b4e-d331-5aa1-977a-96ee72f0436f
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592870510>
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aa77b4e-d331-5aa1-977a-96ee72f0436f/6aa77b4e-d331-5aa1-977a-96ee72f0436f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7b4eaf3e053142378c332ee708210e49%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/2.jpg saved to cache
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6aa77b4e-d331-5aa1-977a-96ee72f0436f
2026-03-27 16:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7ed3b4bebf854074b64463d03be9e7c8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/7.jpg not downloaded yet
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911c8bd0>
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aa77b4e-d331-5aa1-977a-96ee72f0436f/6aa77b4e-d331-5aa1-977a-96ee72f0436f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7b4eaf3e053142378c332ee708210e49%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/4.jpg saved to cache
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6aa77b4e-d331-5aa1-977a-96ee72f0436f
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4e450>
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aa77b4e-d331-5aa1-977a-96ee72f0436f/6aa77b4e-d331-5aa1-977a-96ee72f0436f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7b4eaf3e053142378c332ee708210e49%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/8.jpg saved to cache
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6aa77b4e-d331-5aa1-977a-96ee72f0436f
2026-03-27 16:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7ed3b4bebf854074b64463d03be9e7c8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/8.jpg not downloaded yet
2026-03-27 16:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:34 [ayvens.fr] INFO: Found listing with ID: 1988292
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988292%27 HTTP/1.1" 200 None
2026-03-27 16:47:34 [ayvens.fr] INFO: Scrape type for 1988292: 1
2026-03-27 16:47:34 [ayvens.fr] INFO: Extracting data for car ID: 1988292
2026-03-27 16:47:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db50fb40-ddf7-5ec2-b78f-cda094687587 with identifier: 1988292
2026-03-27 16:47:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db50fb40-ddf7-5ec2-b78f-cda094687587 with scrape type 1
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db50fb40-ddf7-5ec2-b78f-cda094687587
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F1c7258274d974fbfb9c08feb0b3516ee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/1.jpg not downloaded yet
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7e110>
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aa77b4e-d331-5aa1-977a-96ee72f0436f/6aa77b4e-d331-5aa1-977a-96ee72f0436f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7b4eaf3e053142378c332ee708210e49%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/6.jpg saved to cache
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6aa77b4e-d331-5aa1-977a-96ee72f0436f
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591114210>
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aa77b4e-d331-5aa1-977a-96ee72f0436f/6aa77b4e-d331-5aa1-977a-96ee72f0436f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7b4eaf3e053142378c332ee708210e49%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/7.jpg saved to cache
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6aa77b4e-d331-5aa1-977a-96ee72f0436f
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc593178b50>
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aa77b4e-d331-5aa1-977a-96ee72f0436f/6aa77b4e-d331-5aa1-977a-96ee72f0436f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F7b4eaf3e053142378c332ee708210e49%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/5.jpg saved to cache
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6aa77b4e-d331-5aa1-977a-96ee72f0436f
2026-03-27 16:47:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6aa77b4e-d331-5aa1-977a-96ee72f0436f, skipping ID generation
2026-03-27 16:47:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aa77b4e-d331-5aa1-977a-96ee72f0436f with scrape type 1
2026-03-27 16:47:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6aa77b4e-d331-5aa1-977a-96ee72f0436f sending to next pipeline
2026-03-27 16:47:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6aa77b4e-d331-5aa1-977a-96ee72f0436f, identifier: 1988290
2026-03-27 16:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6aa77b4e-d331-5aa1-977a-96ee72f0436f with identifier: 1988290
2026-03-27 16:47:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6aa77b4e-d331-5aa1-977a-96ee72f0436f with identifier: 1988290
2026-03-27 16:47:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6aa77b4e-d331-5aa1-977a-96ee72f0436f with identifier: 1988290 to the API
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '6aa77b4e-d331-5aa1-977a-96ee72f0436f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 121198,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa77b4e-d331-5aa1-977a-96ee72f0436f/6aa77b4e-d331-5aa1-977a-96ee72f0436f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392408,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa77b4e-d331-5aa1-977a-96ee72f0436f/6aa77b4e-d331-5aa1-977a-96ee72f0436f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392408,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa77b4e-d331-5aa1-977a-96ee72f0436f/6aa77b4e-d331-5aa1-977a-96ee72f0436f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245448,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa77b4e-d331-5aa1-977a-96ee72f0436f/6aa77b4e-d331-5aa1-977a-96ee72f0436f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294521,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa77b4e-d331-5aa1-977a-96ee72f0436f/6aa77b4e-d331-5aa1-977a-96ee72f0436f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329447,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa77b4e-d331-5aa1-977a-96ee72f0436f/6aa77b4e-d331-5aa1-977a-96ee72f0436f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299075,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa77b4e-d331-5aa1-977a-96ee72f0436f/6aa77b4e-d331-5aa1-977a-96ee72f0436f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324527,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa77b4e-d331-5aa1-977a-96ee72f0436f/6aa77b4e-d331-5aa1-977a-96ee72f0436f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212161,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/7b4eaf3e053142378c332ee708210e49/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-15',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE Megane Estate 1.5 Blue dCi 115ch Evolution EDC',
'transmission': 'automatic',
'trim': 'Megane Estate 1.5 Blue dCi 115ch Evolution EDC',
'vin': None,
'year': 2023}
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988290%27 HTTP/1.1" 200 None
2026-03-27 16:47:34 [ayvens.fr] INFO: Saving data for 1988290: {'created_time': 1774630054.984847, 'last_price_update_time': 1774630054.984859, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988290') HTTP/1.1" 204 0
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F1c7258274d974fbfb9c08feb0b3516ee%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/2.jpg not downloaded yet
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b18110>
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a72c7933-71b7-5d14-a331-e8e32fd55042/a72c7933-71b7-5d14-a331-e8e32fd55042_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7ed3b4bebf854074b64463d03be9e7c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/1.jpg saved to cache
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a72c7933-71b7-5d14-a331-e8e32fd55042
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de4910>
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a72c7933-71b7-5d14-a331-e8e32fd55042/a72c7933-71b7-5d14-a331-e8e32fd55042_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7ed3b4bebf854074b64463d03be9e7c8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/2.jpg saved to cache
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a72c7933-71b7-5d14-a331-e8e32fd55042
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F1c7258274d974fbfb9c08feb0b3516ee%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/3.jpg not downloaded yet
2026-03-27 16:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0f510>
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a72c7933-71b7-5d14-a331-e8e32fd55042/a72c7933-71b7-5d14-a331-e8e32fd55042_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7ed3b4bebf854074b64463d03be9e7c8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/3.jpg saved to cache
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a72c7933-71b7-5d14-a331-e8e32fd55042
2026-03-27 16:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F1c7258274d974fbfb9c08feb0b3516ee%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/4.jpg not downloaded yet
2026-03-27 16:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F1c7258274d974fbfb9c08feb0b3516ee%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/5.jpg not downloaded yet
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F1c7258274d974fbfb9c08feb0b3516ee%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/6.jpg not downloaded yet
2026-03-27 16:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F1c7258274d974fbfb9c08feb0b3516ee%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/7.jpg not downloaded yet
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0d110>
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a72c7933-71b7-5d14-a331-e8e32fd55042/a72c7933-71b7-5d14-a331-e8e32fd55042_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7ed3b4bebf854074b64463d03be9e7c8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/5.jpg saved to cache
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a72c7933-71b7-5d14-a331-e8e32fd55042
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F1c7258274d974fbfb9c08feb0b3516ee%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/8.jpg not downloaded yet
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F1c7258274d974fbfb9c08feb0b3516ee%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/9.jpg not downloaded yet
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f32910>
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a72c7933-71b7-5d14-a331-e8e32fd55042/a72c7933-71b7-5d14-a331-e8e32fd55042_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7ed3b4bebf854074b64463d03be9e7c8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/7.jpg saved to cache
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a72c7933-71b7-5d14-a331-e8e32fd55042
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b48fd0>
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a72c7933-71b7-5d14-a331-e8e32fd55042/a72c7933-71b7-5d14-a331-e8e32fd55042_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7ed3b4bebf854074b64463d03be9e7c8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/4.jpg saved to cache
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a72c7933-71b7-5d14-a331-e8e32fd55042
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c8a10>
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a72c7933-71b7-5d14-a331-e8e32fd55042/a72c7933-71b7-5d14-a331-e8e32fd55042_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7ed3b4bebf854074b64463d03be9e7c8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/6.jpg saved to cache
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a72c7933-71b7-5d14-a331-e8e32fd55042
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F1c7258274d974fbfb9c08feb0b3516ee%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/10.jpg not downloaded yet
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b50050>
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a72c7933-71b7-5d14-a331-e8e32fd55042/a72c7933-71b7-5d14-a331-e8e32fd55042_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7ed3b4bebf854074b64463d03be9e7c8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/8.jpg saved to cache
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a72c7933-71b7-5d14-a331-e8e32fd55042
2026-03-27 16:47:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a72c7933-71b7-5d14-a331-e8e32fd55042, skipping ID generation
2026-03-27 16:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a72c7933-71b7-5d14-a331-e8e32fd55042 with scrape type 1
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a72c7933-71b7-5d14-a331-e8e32fd55042 sending to next pipeline
2026-03-27 16:47:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a72c7933-71b7-5d14-a331-e8e32fd55042, identifier: 1988291
2026-03-27 16:47:35 [ayvens.fr] INFO: Found listing with ID: 1988293
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988293%27 HTTP/1.1" 200 None
2026-03-27 16:47:35 [ayvens.fr] INFO: Scrape type for 1988293: 1
2026-03-27 16:47:35 [ayvens.fr] INFO: Extracting data for car ID: 1988293
2026-03-27 16:47:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bf185ca-6afb-530d-8392-346fb3dcdb11 with identifier: 1988293
2026-03-27 16:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bf185ca-6afb-530d-8392-346fb3dcdb11 with scrape type 1
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8bf185ca-6afb-530d-8392-346fb3dcdb11
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2547648a01cd45ea8d69c9e43a21496d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/1.jpg not downloaded yet
2026-03-27 16:47:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a72c7933-71b7-5d14-a331-e8e32fd55042 with identifier: 1988291
2026-03-27 16:47:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a72c7933-71b7-5d14-a331-e8e32fd55042 with identifier: 1988291
2026-03-27 16:47:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a72c7933-71b7-5d14-a331-e8e32fd55042 with identifier: 1988291 to the API
2026-03-27 16:47:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 24,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'a72c7933-71b7-5d14-a331-e8e32fd55042',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'LYNK & CO',
'model': 'LC01',
'odometer': 17688,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a72c7933-71b7-5d14-a331-e8e32fd55042/a72c7933-71b7-5d14-a331-e8e32fd55042_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 482610,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a72c7933-71b7-5d14-a331-e8e32fd55042/a72c7933-71b7-5d14-a331-e8e32fd55042_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 482610,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a72c7933-71b7-5d14-a331-e8e32fd55042/a72c7933-71b7-5d14-a331-e8e32fd55042_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338833,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a72c7933-71b7-5d14-a331-e8e32fd55042/a72c7933-71b7-5d14-a331-e8e32fd55042_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 456307,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a72c7933-71b7-5d14-a331-e8e32fd55042/a72c7933-71b7-5d14-a331-e8e32fd55042_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345930,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a72c7933-71b7-5d14-a331-e8e32fd55042/a72c7933-71b7-5d14-a331-e8e32fd55042_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353575,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a72c7933-71b7-5d14-a331-e8e32fd55042/a72c7933-71b7-5d14-a331-e8e32fd55042_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 270118,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a72c7933-71b7-5d14-a331-e8e32fd55042/a72c7933-71b7-5d14-a331-e8e32fd55042_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393980,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7ed3b4bebf854074b64463d03be9e7c8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-03-05',
'seats_number': 5,
'seller_name': None,
'title': 'LYNK & CO LC01 01 1.5 PHEV 261ch DCTH 7',
'transmission': 'automatic',
'trim': '01 1.5 PHEV 261ch DCTH 7',
'vin': None,
'year': 2024}
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988291%27 HTTP/1.1" 200 None
2026-03-27 16:47:36 [ayvens.fr] INFO: Saving data for 1988291: {'created_time': 1774630056.278435, 'last_price_update_time': 1774630056.278446, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988291') HTTP/1.1" 204 0
2026-03-27 16:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2547648a01cd45ea8d69c9e43a21496d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/2.jpg not downloaded yet
2026-03-27 16:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2547648a01cd45ea8d69c9e43a21496d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/3.jpg not downloaded yet
2026-03-27 16:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2547648a01cd45ea8d69c9e43a21496d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/4.jpg not downloaded yet
2026-03-27 16:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2547648a01cd45ea8d69c9e43a21496d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/5.jpg not downloaded yet
2026-03-27 16:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2547648a01cd45ea8d69c9e43a21496d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/6.jpg not downloaded yet
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2547648a01cd45ea8d69c9e43a21496d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/7.jpg not downloaded yet
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2547648a01cd45ea8d69c9e43a21496d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/8.jpg not downloaded yet
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2547648a01cd45ea8d69c9e43a21496d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/9.jpg not downloaded yet
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e8f950>
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db50fb40-ddf7-5ec2-b78f-cda094687587/db50fb40-ddf7-5ec2-b78f-cda094687587_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F1c7258274d974fbfb9c08feb0b3516ee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/1.jpg saved to cache
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db50fb40-ddf7-5ec2-b78f-cda094687587
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2547648a01cd45ea8d69c9e43a21496d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/10.jpg not downloaded yet
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051b2d0>
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db50fb40-ddf7-5ec2-b78f-cda094687587/db50fb40-ddf7-5ec2-b78f-cda094687587_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F1c7258274d974fbfb9c08feb0b3516ee%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/2.jpg saved to cache
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db50fb40-ddf7-5ec2-b78f-cda094687587
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591114c90>
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db50fb40-ddf7-5ec2-b78f-cda094687587/db50fb40-ddf7-5ec2-b78f-cda094687587_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F1c7258274d974fbfb9c08feb0b3516ee%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/3.jpg saved to cache
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db50fb40-ddf7-5ec2-b78f-cda094687587
2026-03-27 16:47:36 [ayvens.fr] INFO: Found listing with ID: 1988294
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988294%27 HTTP/1.1" 200 None
2026-03-27 16:47:36 [ayvens.fr] INFO: Scrape type for 1988294: 1
2026-03-27 16:47:36 [ayvens.fr] INFO: Extracting data for car ID: 1988294
2026-03-27 16:47:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77a52b12-3730-5ed6-8044-dc2e5b63e85c with identifier: 1988294
2026-03-27 16:47:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77a52b12-3730-5ed6-8044-dc2e5b63e85c with scrape type 1
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 77a52b12-3730-5ed6-8044-dc2e5b63e85c
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F66740b85d4484f84a56409955a4e7767%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/1.jpg not downloaded yet
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905174d0>
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db50fb40-ddf7-5ec2-b78f-cda094687587/db50fb40-ddf7-5ec2-b78f-cda094687587_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F1c7258274d974fbfb9c08feb0b3516ee%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/5.jpg saved to cache
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db50fb40-ddf7-5ec2-b78f-cda094687587
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590590290>
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db50fb40-ddf7-5ec2-b78f-cda094687587/db50fb40-ddf7-5ec2-b78f-cda094687587_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F1c7258274d974fbfb9c08feb0b3516ee%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/4.jpg saved to cache
2026-03-27 16:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db50fb40-ddf7-5ec2-b78f-cda094687587
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050de10>
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db50fb40-ddf7-5ec2-b78f-cda094687587/db50fb40-ddf7-5ec2-b78f-cda094687587_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F1c7258274d974fbfb9c08feb0b3516ee%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/7.jpg saved to cache
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db50fb40-ddf7-5ec2-b78f-cda094687587
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2cf90>
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db50fb40-ddf7-5ec2-b78f-cda094687587/db50fb40-ddf7-5ec2-b78f-cda094687587_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F1c7258274d974fbfb9c08feb0b3516ee%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/6.jpg saved to cache
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db50fb40-ddf7-5ec2-b78f-cda094687587
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f12510>
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db50fb40-ddf7-5ec2-b78f-cda094687587/db50fb40-ddf7-5ec2-b78f-cda094687587_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F1c7258274d974fbfb9c08feb0b3516ee%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/8.jpg saved to cache
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db50fb40-ddf7-5ec2-b78f-cda094687587
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F66740b85d4484f84a56409955a4e7767%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/2.jpg not downloaded yet
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F66740b85d4484f84a56409955a4e7767%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/3.jpg not downloaded yet
2026-03-27 16:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F66740b85d4484f84a56409955a4e7767%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/4.jpg not downloaded yet
2026-03-27 16:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F66740b85d4484f84a56409955a4e7767%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/5.jpg not downloaded yet
2026-03-27 16:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F66740b85d4484f84a56409955a4e7767%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/6.jpg not downloaded yet
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F66740b85d4484f84a56409955a4e7767%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/7.jpg not downloaded yet
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F66740b85d4484f84a56409955a4e7767%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/8.jpg not downloaded yet
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F66740b85d4484f84a56409955a4e7767%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/9.jpg not downloaded yet
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F66740b85d4484f84a56409955a4e7767%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/10.jpg not downloaded yet
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592c74c10>
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db50fb40-ddf7-5ec2-b78f-cda094687587/db50fb40-ddf7-5ec2-b78f-cda094687587_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F1c7258274d974fbfb9c08feb0b3516ee%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/9.jpg saved to cache
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db50fb40-ddf7-5ec2-b78f-cda094687587
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f31210>
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf185ca-6afb-530d-8392-346fb3dcdb11/8bf185ca-6afb-530d-8392-346fb3dcdb11_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2547648a01cd45ea8d69c9e43a21496d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/3.jpg saved to cache
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8bf185ca-6afb-530d-8392-346fb3dcdb11
2026-03-27 16:47:37 [ayvens.fr] INFO: Found listing with ID: 1988295
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988295%27 HTTP/1.1" 200 None
2026-03-27 16:47:37 [ayvens.fr] INFO: Scrape type for 1988295: 1
2026-03-27 16:47:37 [ayvens.fr] INFO: Extracting data for car ID: 1988295
2026-03-27 16:47:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c309a83f-d6e3-5372-881b-556091397f7c with identifier: 1988295
2026-03-27 16:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c309a83f-d6e3-5372-881b-556091397f7c with scrape type 1
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c309a83f-d6e3-5372-881b-556091397f7c
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252Ffb65c3fb90434bb79829eb0382dd02b2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/1.jpg not downloaded yet
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066be50>
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf185ca-6afb-530d-8392-346fb3dcdb11/8bf185ca-6afb-530d-8392-346fb3dcdb11_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2547648a01cd45ea8d69c9e43a21496d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/2.jpg saved to cache
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8bf185ca-6afb-530d-8392-346fb3dcdb11
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b77690>
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db50fb40-ddf7-5ec2-b78f-cda094687587/db50fb40-ddf7-5ec2-b78f-cda094687587_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F1c7258274d974fbfb9c08feb0b3516ee%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/10.jpg saved to cache
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db50fb40-ddf7-5ec2-b78f-cda094687587
2026-03-27 16:47:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db50fb40-ddf7-5ec2-b78f-cda094687587, skipping ID generation
2026-03-27 16:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db50fb40-ddf7-5ec2-b78f-cda094687587 with scrape type 1
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db50fb40-ddf7-5ec2-b78f-cda094687587 sending to next pipeline
2026-03-27 16:47:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: db50fb40-ddf7-5ec2-b78f-cda094687587, identifier: 1988292
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252Ffb65c3fb90434bb79829eb0382dd02b2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/2.jpg not downloaded yet
2026-03-27 16:47:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: db50fb40-ddf7-5ec2-b78f-cda094687587 with identifier: 1988292
2026-03-27 16:47:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:47:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: db50fb40-ddf7-5ec2-b78f-cda094687587 with identifier: 1988292
2026-03-27 16:47:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: db50fb40-ddf7-5ec2-b78f-cda094687587 with identifier: 1988292 to the API
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'BLANC NACR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'db50fb40-ddf7-5ec2-b78f-cda094687587',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 89812,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db50fb40-ddf7-5ec2-b78f-cda094687587/db50fb40-ddf7-5ec2-b78f-cda094687587_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460462,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db50fb40-ddf7-5ec2-b78f-cda094687587/db50fb40-ddf7-5ec2-b78f-cda094687587_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460462,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db50fb40-ddf7-5ec2-b78f-cda094687587/db50fb40-ddf7-5ec2-b78f-cda094687587_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411610,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db50fb40-ddf7-5ec2-b78f-cda094687587/db50fb40-ddf7-5ec2-b78f-cda094687587_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 497931,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db50fb40-ddf7-5ec2-b78f-cda094687587/db50fb40-ddf7-5ec2-b78f-cda094687587_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 491892,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db50fb40-ddf7-5ec2-b78f-cda094687587/db50fb40-ddf7-5ec2-b78f-cda094687587_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 661326,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db50fb40-ddf7-5ec2-b78f-cda094687587/db50fb40-ddf7-5ec2-b78f-cda094687587_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 576206,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db50fb40-ddf7-5ec2-b78f-cda094687587/db50fb40-ddf7-5ec2-b78f-cda094687587_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 632700,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db50fb40-ddf7-5ec2-b78f-cda094687587/db50fb40-ddf7-5ec2-b78f-cda094687587_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613659,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db50fb40-ddf7-5ec2-b78f-cda094687587/db50fb40-ddf7-5ec2-b78f-cda094687587_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711891,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/1c7258274d974fbfb9c08feb0b3516ee/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-04',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch Active Business S&S EAT8',
'transmission': 'automatic',
'trim': '3008 1.2 PureTech 130ch Active Business S&S EAT8',
'vin': None,
'year': 2020}
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988292%27 HTTP/1.1" 200 None
2026-03-27 16:47:38 [ayvens.fr] INFO: Saving data for 1988292: {'created_time': 1774630058.338801, 'last_price_update_time': 1774630058.338816, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988292') HTTP/1.1" 204 0
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d96410>
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf185ca-6afb-530d-8392-346fb3dcdb11/8bf185ca-6afb-530d-8392-346fb3dcdb11_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2547648a01cd45ea8d69c9e43a21496d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/6.jpg saved to cache
2026-03-27 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8bf185ca-6afb-530d-8392-346fb3dcdb11
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df52d0>
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf185ca-6afb-530d-8392-346fb3dcdb11/8bf185ca-6afb-530d-8392-346fb3dcdb11_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2547648a01cd45ea8d69c9e43a21496d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/4.jpg saved to cache
2026-03-27 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8bf185ca-6afb-530d-8392-346fb3dcdb11
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590668210>
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf185ca-6afb-530d-8392-346fb3dcdb11/8bf185ca-6afb-530d-8392-346fb3dcdb11_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2547648a01cd45ea8d69c9e43a21496d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/5.jpg saved to cache
2026-03-27 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8bf185ca-6afb-530d-8392-346fb3dcdb11
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b18cd0>
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf185ca-6afb-530d-8392-346fb3dcdb11/8bf185ca-6afb-530d-8392-346fb3dcdb11_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2547648a01cd45ea8d69c9e43a21496d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/1.jpg saved to cache
2026-03-27 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8bf185ca-6afb-530d-8392-346fb3dcdb11
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252Ffb65c3fb90434bb79829eb0382dd02b2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/3.jpg not downloaded yet
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252Ffb65c3fb90434bb79829eb0382dd02b2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/4.jpg not downloaded yet
2026-03-27 16:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252Ffb65c3fb90434bb79829eb0382dd02b2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/5.jpg not downloaded yet
2026-03-27 16:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252Ffb65c3fb90434bb79829eb0382dd02b2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/6.jpg not downloaded yet
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252Ffb65c3fb90434bb79829eb0382dd02b2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/7.jpg not downloaded yet
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252Ffb65c3fb90434bb79829eb0382dd02b2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/8.jpg not downloaded yet
2026-03-27 16:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252Ffb65c3fb90434bb79829eb0382dd02b2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/9.jpg not downloaded yet
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252Ffb65c3fb90434bb79829eb0382dd02b2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/10.jpg not downloaded yet
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df57d0>
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf185ca-6afb-530d-8392-346fb3dcdb11/8bf185ca-6afb-530d-8392-346fb3dcdb11_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2547648a01cd45ea8d69c9e43a21496d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/7.jpg saved to cache
2026-03-27 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8bf185ca-6afb-530d-8392-346fb3dcdb11
2026-03-27 16:47:38 [ayvens.fr] INFO: Found listing with ID: 1988296
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988296%27 HTTP/1.1" 200 None
2026-03-27 16:47:38 [ayvens.fr] INFO: Scrape type for 1988296: 1
2026-03-27 16:47:38 [ayvens.fr] INFO: Extracting data for car ID: 1988296
2026-03-27 16:47:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e830c415-f672-50c5-b291-d7a696555743 with identifier: 1988296
2026-03-27 16:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e830c415-f672-50c5-b291-d7a696555743 with scrape type 1
2026-03-27 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e830c415-f672-50c5-b291-d7a696555743
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fc10f6b82693f4b648ab86203b5d02526%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/1.jpg not downloaded yet
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fc9690>
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77a52b12-3730-5ed6-8044-dc2e5b63e85c/77a52b12-3730-5ed6-8044-dc2e5b63e85c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F66740b85d4484f84a56409955a4e7767%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/2.jpg saved to cache
2026-03-27 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 77a52b12-3730-5ed6-8044-dc2e5b63e85c
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e2c50>
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77a52b12-3730-5ed6-8044-dc2e5b63e85c/77a52b12-3730-5ed6-8044-dc2e5b63e85c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F66740b85d4484f84a56409955a4e7767%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/1.jpg saved to cache
2026-03-27 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77a52b12-3730-5ed6-8044-dc2e5b63e85c
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ad7a10>
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf185ca-6afb-530d-8392-346fb3dcdb11/8bf185ca-6afb-530d-8392-346fb3dcdb11_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2547648a01cd45ea8d69c9e43a21496d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/8.jpg saved to cache
2026-03-27 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8bf185ca-6afb-530d-8392-346fb3dcdb11
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dbad10>
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf185ca-6afb-530d-8392-346fb3dcdb11/8bf185ca-6afb-530d-8392-346fb3dcdb11_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2547648a01cd45ea8d69c9e43a21496d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/9.jpg saved to cache
2026-03-27 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8bf185ca-6afb-530d-8392-346fb3dcdb11
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df7cd0>
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf185ca-6afb-530d-8392-346fb3dcdb11/8bf185ca-6afb-530d-8392-346fb3dcdb11_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F2547648a01cd45ea8d69c9e43a21496d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/10.jpg saved to cache
2026-03-27 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8bf185ca-6afb-530d-8392-346fb3dcdb11
2026-03-27 16:47:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8bf185ca-6afb-530d-8392-346fb3dcdb11, skipping ID generation
2026-03-27 16:47:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bf185ca-6afb-530d-8392-346fb3dcdb11 with scrape type 1
2026-03-27 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8bf185ca-6afb-530d-8392-346fb3dcdb11 sending to next pipeline
2026-03-27 16:47:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8bf185ca-6afb-530d-8392-346fb3dcdb11, identifier: 1988293
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc593178a90>
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77a52b12-3730-5ed6-8044-dc2e5b63e85c/77a52b12-3730-5ed6-8044-dc2e5b63e85c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F66740b85d4484f84a56409955a4e7767%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/3.jpg saved to cache
2026-03-27 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 77a52b12-3730-5ed6-8044-dc2e5b63e85c
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fc10f6b82693f4b648ab86203b5d02526%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/2.jpg not downloaded yet
2026-03-27 16:47:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8bf185ca-6afb-530d-8392-346fb3dcdb11 with identifier: 1988293
2026-03-27 16:47:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8bf185ca-6afb-530d-8392-346fb3dcdb11 with identifier: 1988293
2026-03-27 16:47:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8bf185ca-6afb-530d-8392-346fb3dcdb11 with identifier: 1988293 to the API
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': 150,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '8bf185ca-6afb-530d-8392-346fb3dcdb11',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 66413,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf185ca-6afb-530d-8392-346fb3dcdb11/8bf185ca-6afb-530d-8392-346fb3dcdb11_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 609997,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf185ca-6afb-530d-8392-346fb3dcdb11/8bf185ca-6afb-530d-8392-346fb3dcdb11_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 609997,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf185ca-6afb-530d-8392-346fb3dcdb11/8bf185ca-6afb-530d-8392-346fb3dcdb11_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532799,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf185ca-6afb-530d-8392-346fb3dcdb11/8bf185ca-6afb-530d-8392-346fb3dcdb11_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 687937,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf185ca-6afb-530d-8392-346fb3dcdb11/8bf185ca-6afb-530d-8392-346fb3dcdb11_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 600317,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf185ca-6afb-530d-8392-346fb3dcdb11/8bf185ca-6afb-530d-8392-346fb3dcdb11_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 577685,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf185ca-6afb-530d-8392-346fb3dcdb11/8bf185ca-6afb-530d-8392-346fb3dcdb11_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 591934,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf185ca-6afb-530d-8392-346fb3dcdb11/8bf185ca-6afb-530d-8392-346fb3dcdb11_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544399,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf185ca-6afb-530d-8392-346fb3dcdb11/8bf185ca-6afb-530d-8392-346fb3dcdb11_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 683197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf185ca-6afb-530d-8392-346fb3dcdb11/8bf185ca-6afb-530d-8392-346fb3dcdb11_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 625772,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/2547648a01cd45ea8d69c9e43a21496d/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-15',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Allure Pack EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch S&S Allure Pack EAT8',
'vin': None,
'year': 2023}
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988293%27 HTTP/1.1" 200 None
2026-03-27 16:47:39 [ayvens.fr] INFO: Saving data for 1988293: {'created_time': 1774630059.896157, 'last_price_update_time': 1774630059.896168, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988293') HTTP/1.1" 204 0
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fc10f6b82693f4b648ab86203b5d02526%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/3.jpg not downloaded yet
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d51050>
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c309a83f-d6e3-5372-881b-556091397f7c/c309a83f-d6e3-5372-881b-556091397f7c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252Ffb65c3fb90434bb79829eb0382dd02b2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/1.jpg saved to cache
2026-03-27 16:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c309a83f-d6e3-5372-881b-556091397f7c
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fc10f6b82693f4b648ab86203b5d02526%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/4.jpg not downloaded yet
2026-03-27 16:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fc10f6b82693f4b648ab86203b5d02526%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/5.jpg not downloaded yet
2026-03-27 16:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fc10f6b82693f4b648ab86203b5d02526%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/6.jpg not downloaded yet
2026-03-27 16:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fc10f6b82693f4b648ab86203b5d02526%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/7.jpg not downloaded yet
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fc10f6b82693f4b648ab86203b5d02526%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/8.jpg not downloaded yet
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fc10f6b82693f4b648ab86203b5d02526%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/9.jpg not downloaded yet
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fc10f6b82693f4b648ab86203b5d02526%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/10.jpg not downloaded yet
2026-03-27 16:47:40 [ayvens.fr] INFO: Found listing with ID: 1988297
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988297%27 HTTP/1.1" 200 None
2026-03-27 16:47:40 [ayvens.fr] INFO: Scrape type for 1988297: 1
2026-03-27 16:47:40 [ayvens.fr] INFO: Extracting data for car ID: 1988297
2026-03-27 16:47:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cbda0af-1f9c-5385-b645-6dd7af909859 with identifier: 1988297
2026-03-27 16:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cbda0af-1f9c-5385-b645-6dd7af909859 with scrape type 1
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3cbda0af-1f9c-5385-b645-6dd7af909859
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F86abcf59175e4b8290541d9dffd506e3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/1.jpg not downloaded yet
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591183450>
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77a52b12-3730-5ed6-8044-dc2e5b63e85c/77a52b12-3730-5ed6-8044-dc2e5b63e85c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F66740b85d4484f84a56409955a4e7767%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/5.jpg saved to cache
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 77a52b12-3730-5ed6-8044-dc2e5b63e85c
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b77110>
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77a52b12-3730-5ed6-8044-dc2e5b63e85c/77a52b12-3730-5ed6-8044-dc2e5b63e85c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F66740b85d4484f84a56409955a4e7767%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/4.jpg saved to cache
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 77a52b12-3730-5ed6-8044-dc2e5b63e85c
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c0210>
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c309a83f-d6e3-5372-881b-556091397f7c/c309a83f-d6e3-5372-881b-556091397f7c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252Ffb65c3fb90434bb79829eb0382dd02b2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/2.jpg saved to cache
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c309a83f-d6e3-5372-881b-556091397f7c
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e14790>
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77a52b12-3730-5ed6-8044-dc2e5b63e85c/77a52b12-3730-5ed6-8044-dc2e5b63e85c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F66740b85d4484f84a56409955a4e7767%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/6.jpg saved to cache
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 77a52b12-3730-5ed6-8044-dc2e5b63e85c
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F86abcf59175e4b8290541d9dffd506e3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/2.jpg not downloaded yet
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c3b50>
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77a52b12-3730-5ed6-8044-dc2e5b63e85c/77a52b12-3730-5ed6-8044-dc2e5b63e85c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F66740b85d4484f84a56409955a4e7767%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/8.jpg saved to cache
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 77a52b12-3730-5ed6-8044-dc2e5b63e85c
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591209a10>
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77a52b12-3730-5ed6-8044-dc2e5b63e85c/77a52b12-3730-5ed6-8044-dc2e5b63e85c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F66740b85d4484f84a56409955a4e7767%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/10.jpg saved to cache
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 77a52b12-3730-5ed6-8044-dc2e5b63e85c
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590519d90>
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77a52b12-3730-5ed6-8044-dc2e5b63e85c/77a52b12-3730-5ed6-8044-dc2e5b63e85c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F66740b85d4484f84a56409955a4e7767%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/7.jpg saved to cache
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 77a52b12-3730-5ed6-8044-dc2e5b63e85c
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a9950>
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77a52b12-3730-5ed6-8044-dc2e5b63e85c/77a52b12-3730-5ed6-8044-dc2e5b63e85c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F66740b85d4484f84a56409955a4e7767%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/9.jpg saved to cache
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 77a52b12-3730-5ed6-8044-dc2e5b63e85c
2026-03-27 16:47:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77a52b12-3730-5ed6-8044-dc2e5b63e85c, skipping ID generation
2026-03-27 16:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77a52b12-3730-5ed6-8044-dc2e5b63e85c with scrape type 1
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77a52b12-3730-5ed6-8044-dc2e5b63e85c sending to next pipeline
2026-03-27 16:47:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 77a52b12-3730-5ed6-8044-dc2e5b63e85c, identifier: 1988294
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F86abcf59175e4b8290541d9dffd506e3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/3.jpg not downloaded yet
2026-03-27 16:47:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 77a52b12-3730-5ed6-8044-dc2e5b63e85c with identifier: 1988294
2026-03-27 16:47:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:47:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 77a52b12-3730-5ed6-8044-dc2e5b63e85c with identifier: 1988294
2026-03-27 16:47:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 77a52b12-3730-5ed6-8044-dc2e5b63e85c with identifier: 1988294 to the API
2026-03-27 16:47:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'MONOTON GRIS CASSIOPEE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '77a52b12-3730-5ed6-8044-dc2e5b63e85c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 35241,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77a52b12-3730-5ed6-8044-dc2e5b63e85c/77a52b12-3730-5ed6-8044-dc2e5b63e85c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 526376,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77a52b12-3730-5ed6-8044-dc2e5b63e85c/77a52b12-3730-5ed6-8044-dc2e5b63e85c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 526376,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77a52b12-3730-5ed6-8044-dc2e5b63e85c/77a52b12-3730-5ed6-8044-dc2e5b63e85c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 605786,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77a52b12-3730-5ed6-8044-dc2e5b63e85c/77a52b12-3730-5ed6-8044-dc2e5b63e85c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460674,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77a52b12-3730-5ed6-8044-dc2e5b63e85c/77a52b12-3730-5ed6-8044-dc2e5b63e85c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480938,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77a52b12-3730-5ed6-8044-dc2e5b63e85c/77a52b12-3730-5ed6-8044-dc2e5b63e85c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 490329,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77a52b12-3730-5ed6-8044-dc2e5b63e85c/77a52b12-3730-5ed6-8044-dc2e5b63e85c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613223,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77a52b12-3730-5ed6-8044-dc2e5b63e85c/77a52b12-3730-5ed6-8044-dc2e5b63e85c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607572,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77a52b12-3730-5ed6-8044-dc2e5b63e85c/77a52b12-3730-5ed6-8044-dc2e5b63e85c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 626196,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77a52b12-3730-5ed6-8044-dc2e5b63e85c/77a52b12-3730-5ed6-8044-dc2e5b63e85c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 666100,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/66740b85d4484f84a56409955a4e7767/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-15',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CAPTUR Captur 1.6 E-Tech hybride 145ch Business',
'transmission': 'automatic',
'trim': 'Captur 1.6 E-Tech hybride 145ch Business',
'vin': None,
'year': 2022}
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988294%27 HTTP/1.1" 200 None
2026-03-27 16:47:41 [ayvens.fr] INFO: Saving data for 1988294: {'created_time': 1774630061.34365, 'last_price_update_time': 1774630061.343663, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988294') HTTP/1.1" 204 0
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F86abcf59175e4b8290541d9dffd506e3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/4.jpg not downloaded yet
2026-03-27 16:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F86abcf59175e4b8290541d9dffd506e3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/5.jpg not downloaded yet
2026-03-27 16:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F86abcf59175e4b8290541d9dffd506e3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/6.jpg not downloaded yet
2026-03-27 16:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F86abcf59175e4b8290541d9dffd506e3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/7.jpg not downloaded yet
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F86abcf59175e4b8290541d9dffd506e3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/8.jpg not downloaded yet
2026-03-27 16:47:41 [ayvens.fr] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae1350>
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c309a83f-d6e3-5372-881b-556091397f7c/c309a83f-d6e3-5372-881b-556091397f7c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252Ffb65c3fb90434bb79829eb0382dd02b2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/5.jpg saved to cache
2026-03-27 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c309a83f-d6e3-5372-881b-556091397f7c
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904fcbd0>
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c309a83f-d6e3-5372-881b-556091397f7c/c309a83f-d6e3-5372-881b-556091397f7c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252Ffb65c3fb90434bb79829eb0382dd02b2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/4.jpg saved to cache
2026-03-27 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c309a83f-d6e3-5372-881b-556091397f7c
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9f150>
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c309a83f-d6e3-5372-881b-556091397f7c/c309a83f-d6e3-5372-881b-556091397f7c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252Ffb65c3fb90434bb79829eb0382dd02b2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/8.jpg saved to cache
2026-03-27 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c309a83f-d6e3-5372-881b-556091397f7c
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59102d410>
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c309a83f-d6e3-5372-881b-556091397f7c/c309a83f-d6e3-5372-881b-556091397f7c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252Ffb65c3fb90434bb79829eb0382dd02b2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/3.jpg saved to cache
2026-03-27 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c309a83f-d6e3-5372-881b-556091397f7c
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3c850>
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c309a83f-d6e3-5372-881b-556091397f7c/c309a83f-d6e3-5372-881b-556091397f7c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252Ffb65c3fb90434bb79829eb0382dd02b2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/7.jpg saved to cache
2026-03-27 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c309a83f-d6e3-5372-881b-556091397f7c
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59102c190>
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c309a83f-d6e3-5372-881b-556091397f7c/c309a83f-d6e3-5372-881b-556091397f7c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252Ffb65c3fb90434bb79829eb0382dd02b2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/10.jpg saved to cache
2026-03-27 16:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c309a83f-d6e3-5372-881b-556091397f7c
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59102d410>
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c309a83f-d6e3-5372-881b-556091397f7c/c309a83f-d6e3-5372-881b-556091397f7c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252Ffb65c3fb90434bb79829eb0382dd02b2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/9.jpg saved to cache
2026-03-27 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c309a83f-d6e3-5372-881b-556091397f7c
2026-03-27 16:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b18f10>
2026-03-27 16:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c309a83f-d6e3-5372-881b-556091397f7c/c309a83f-d6e3-5372-881b-556091397f7c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fet-%252Ffb65c3fb90434bb79829eb0382dd02b2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/6.jpg saved to cache
2026-03-27 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c309a83f-d6e3-5372-881b-556091397f7c
2026-03-27 16:47:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c309a83f-d6e3-5372-881b-556091397f7c, skipping ID generation
2026-03-27 16:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c309a83f-d6e3-5372-881b-556091397f7c with scrape type 1
2026-03-27 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c309a83f-d6e3-5372-881b-556091397f7c sending to next pipeline
2026-03-27 16:47:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c309a83f-d6e3-5372-881b-556091397f7c, identifier: 1988295
2026-03-27 16:47:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c309a83f-d6e3-5372-881b-556091397f7c with identifier: 1988295
2026-03-27 16:47:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c309a83f-d6e3-5372-881b-556091397f7c with identifier: 1988295
2026-03-27 16:47:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c309a83f-d6e3-5372-881b-556091397f7c with identifier: 1988295 to the API
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 82,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'c309a83f-d6e3-5372-881b-556091397f7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 86371,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c309a83f-d6e3-5372-881b-556091397f7c/c309a83f-d6e3-5372-881b-556091397f7c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 451005,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c309a83f-d6e3-5372-881b-556091397f7c/c309a83f-d6e3-5372-881b-556091397f7c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 451005,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c309a83f-d6e3-5372-881b-556091397f7c/c309a83f-d6e3-5372-881b-556091397f7c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433680,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c309a83f-d6e3-5372-881b-556091397f7c/c309a83f-d6e3-5372-881b-556091397f7c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 490605,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c309a83f-d6e3-5372-881b-556091397f7c/c309a83f-d6e3-5372-881b-556091397f7c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480139,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c309a83f-d6e3-5372-881b-556091397f7c/c309a83f-d6e3-5372-881b-556091397f7c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 545841,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c309a83f-d6e3-5372-881b-556091397f7c/c309a83f-d6e3-5372-881b-556091397f7c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 569436,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c309a83f-d6e3-5372-881b-556091397f7c/c309a83f-d6e3-5372-881b-556091397f7c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564718,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c309a83f-d6e3-5372-881b-556091397f7c/c309a83f-d6e3-5372-881b-556091397f7c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544179,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c309a83f-d6e3-5372-881b-556091397f7c/c309a83f-d6e3-5372-881b-556091397f7c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 592363,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/et-/fb65c3fb90434bb79829eb0382dd02b2/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-12',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.5 dCi 90ch energy Business 5p',
'transmission': 'manual',
'trim': 'Clio 1.5 dCi 90ch energy Business 5p',
'vin': None,
'year': 2018}
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988295%27 HTTP/1.1" 200 None
2026-03-27 16:47:42 [ayvens.fr] INFO: Saving data for 1988295: {'created_time': 1774630062.600977, 'last_price_update_time': 1774630062.600988, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988295') HTTP/1.1" 204 0
2026-03-27 16:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 16:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd16d0>
2026-03-27 16:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e830c415-f672-50c5-b291-d7a696555743/e830c415-f672-50c5-b291-d7a696555743_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fc10f6b82693f4b648ab86203b5d02526%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/2.jpg saved to cache
2026-03-27 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e830c415-f672-50c5-b291-d7a696555743
2026-03-27 16:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e8f210>
2026-03-27 16:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e830c415-f672-50c5-b291-d7a696555743/e830c415-f672-50c5-b291-d7a696555743_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fc10f6b82693f4b648ab86203b5d02526%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/1.jpg saved to cache
2026-03-27 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e830c415-f672-50c5-b291-d7a696555743
2026-03-27 16:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4b150>
2026-03-27 16:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e830c415-f672-50c5-b291-d7a696555743/e830c415-f672-50c5-b291-d7a696555743_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fc10f6b82693f4b648ab86203b5d02526%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/5.jpg saved to cache
2026-03-27 16:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e830c415-f672-50c5-b291-d7a696555743
2026-03-27 16:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfed90>
2026-03-27 16:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e830c415-f672-50c5-b291-d7a696555743/e830c415-f672-50c5-b291-d7a696555743_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fc10f6b82693f4b648ab86203b5d02526%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/3.jpg saved to cache
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e830c415-f672-50c5-b291-d7a696555743
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068e490>
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e830c415-f672-50c5-b291-d7a696555743/e830c415-f672-50c5-b291-d7a696555743_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fc10f6b82693f4b648ab86203b5d02526%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/6.jpg saved to cache
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e830c415-f672-50c5-b291-d7a696555743
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfed90>
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e830c415-f672-50c5-b291-d7a696555743/e830c415-f672-50c5-b291-d7a696555743_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fc10f6b82693f4b648ab86203b5d02526%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/7.jpg saved to cache
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e830c415-f672-50c5-b291-d7a696555743
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd2a90>
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e830c415-f672-50c5-b291-d7a696555743/e830c415-f672-50c5-b291-d7a696555743_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fc10f6b82693f4b648ab86203b5d02526%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/4.jpg saved to cache
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e830c415-f672-50c5-b291-d7a696555743
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dff390>
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e830c415-f672-50c5-b291-d7a696555743/e830c415-f672-50c5-b291-d7a696555743_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fc10f6b82693f4b648ab86203b5d02526%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/8.jpg saved to cache
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e830c415-f672-50c5-b291-d7a696555743
2026-03-27 16:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df6050>
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cbda0af-1f9c-5385-b645-6dd7af909859/3cbda0af-1f9c-5385-b645-6dd7af909859_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F86abcf59175e4b8290541d9dffd506e3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/6.jpg saved to cache
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3cbda0af-1f9c-5385-b645-6dd7af909859
2026-03-27 16:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d41ed0>
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cbda0af-1f9c-5385-b645-6dd7af909859/3cbda0af-1f9c-5385-b645-6dd7af909859_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F86abcf59175e4b8290541d9dffd506e3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/4.jpg saved to cache
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3cbda0af-1f9c-5385-b645-6dd7af909859
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0d390>
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cbda0af-1f9c-5385-b645-6dd7af909859/3cbda0af-1f9c-5385-b645-6dd7af909859_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F86abcf59175e4b8290541d9dffd506e3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/5.jpg saved to cache
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3cbda0af-1f9c-5385-b645-6dd7af909859
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590511d10>
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cbda0af-1f9c-5385-b645-6dd7af909859/3cbda0af-1f9c-5385-b645-6dd7af909859_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F86abcf59175e4b8290541d9dffd506e3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/1.jpg saved to cache
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3cbda0af-1f9c-5385-b645-6dd7af909859
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fc8090>
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cbda0af-1f9c-5385-b645-6dd7af909859/3cbda0af-1f9c-5385-b645-6dd7af909859_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F86abcf59175e4b8290541d9dffd506e3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/2.jpg saved to cache
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3cbda0af-1f9c-5385-b645-6dd7af909859
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590513150>
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cbda0af-1f9c-5385-b645-6dd7af909859/3cbda0af-1f9c-5385-b645-6dd7af909859_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F86abcf59175e4b8290541d9dffd506e3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/3.jpg saved to cache
2026-03-27 16:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3cbda0af-1f9c-5385-b645-6dd7af909859
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f33950>
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e830c415-f672-50c5-b291-d7a696555743/e830c415-f672-50c5-b291-d7a696555743_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fc10f6b82693f4b648ab86203b5d02526%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/10.jpg saved to cache
2026-03-27 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e830c415-f672-50c5-b291-d7a696555743
2026-03-27 16:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591053c50>
2026-03-27 16:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e830c415-f672-50c5-b291-d7a696555743/e830c415-f672-50c5-b291-d7a696555743_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fc10f6b82693f4b648ab86203b5d02526%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/9.jpg saved to cache
2026-03-27 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e830c415-f672-50c5-b291-d7a696555743
2026-03-27 16:47:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e830c415-f672-50c5-b291-d7a696555743, skipping ID generation
2026-03-27 16:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e830c415-f672-50c5-b291-d7a696555743 with scrape type 1
2026-03-27 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e830c415-f672-50c5-b291-d7a696555743 sending to next pipeline
2026-03-27 16:47:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e830c415-f672-50c5-b291-d7a696555743, identifier: 1988296
2026-03-27 16:47:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e830c415-f672-50c5-b291-d7a696555743 with identifier: 1988296
2026-03-27 16:47:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:47:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e830c415-f672-50c5-b291-d7a696555743 with identifier: 1988296
2026-03-27 16:47:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e830c415-f672-50c5-b291-d7a696555743 with identifier: 1988296 to the API
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'NOIR ETOILE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'e830c415-f672-50c5-b291-d7a696555743',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 103565,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e830c415-f672-50c5-b291-d7a696555743/e830c415-f672-50c5-b291-d7a696555743_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 632823,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e830c415-f672-50c5-b291-d7a696555743/e830c415-f672-50c5-b291-d7a696555743_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 632823,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e830c415-f672-50c5-b291-d7a696555743/e830c415-f672-50c5-b291-d7a696555743_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606499,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e830c415-f672-50c5-b291-d7a696555743/e830c415-f672-50c5-b291-d7a696555743_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 789281,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e830c415-f672-50c5-b291-d7a696555743/e830c415-f672-50c5-b291-d7a696555743_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 621260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e830c415-f672-50c5-b291-d7a696555743/e830c415-f672-50c5-b291-d7a696555743_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 635467,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e830c415-f672-50c5-b291-d7a696555743/e830c415-f672-50c5-b291-d7a696555743_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 686646,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e830c415-f672-50c5-b291-d7a696555743/e830c415-f672-50c5-b291-d7a696555743_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 919836,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e830c415-f672-50c5-b291-d7a696555743/e830c415-f672-50c5-b291-d7a696555743_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 942711,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e830c415-f672-50c5-b291-d7a696555743/e830c415-f672-50c5-b291-d7a696555743_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 783159,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/c10f6b82693f4b648ab86203b5d02526/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-19',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE Megane 1.3 TCe 140ch FAP Business EDC',
'transmission': 'automatic',
'trim': 'Megane 1.3 TCe 140ch FAP Business EDC',
'vin': None,
'year': 2020}
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988296%27 HTTP/1.1" 200 None
2026-03-27 16:47:44 [ayvens.fr] INFO: Saving data for 1988296: {'created_time': 1774630064.682209, 'last_price_update_time': 1774630064.682222, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988296') HTTP/1.1" 204 0
2026-03-27 16:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b2990>
2026-03-27 16:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cbda0af-1f9c-5385-b645-6dd7af909859/3cbda0af-1f9c-5385-b645-6dd7af909859_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F86abcf59175e4b8290541d9dffd506e3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/7.jpg saved to cache
2026-03-27 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3cbda0af-1f9c-5385-b645-6dd7af909859
2026-03-27 16:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910c4990>
2026-03-27 16:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cbda0af-1f9c-5385-b645-6dd7af909859/3cbda0af-1f9c-5385-b645-6dd7af909859_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F86abcf59175e4b8290541d9dffd506e3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/8.jpg saved to cache
2026-03-27 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3cbda0af-1f9c-5385-b645-6dd7af909859
2026-03-27 16:47:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3cbda0af-1f9c-5385-b645-6dd7af909859, skipping ID generation
2026-03-27 16:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cbda0af-1f9c-5385-b645-6dd7af909859 with scrape type 1
2026-03-27 16:47:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3cbda0af-1f9c-5385-b645-6dd7af909859 sending to next pipeline
2026-03-27 16:47:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3cbda0af-1f9c-5385-b645-6dd7af909859, identifier: 1988297
2026-03-27 16:47:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3cbda0af-1f9c-5385-b645-6dd7af909859 with identifier: 1988297
2026-03-27 16:47:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3cbda0af-1f9c-5385-b645-6dd7af909859 with identifier: 1988297
2026-03-27 16:47:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3cbda0af-1f9c-5385-b645-6dd7af909859 with identifier: 1988297 to the API
2026-03-27 16:47:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '3cbda0af-1f9c-5385-b645-6dd7af909859',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE E-TECH',
'odometer': 24105,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cbda0af-1f9c-5385-b645-6dd7af909859/3cbda0af-1f9c-5385-b645-6dd7af909859_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332771,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cbda0af-1f9c-5385-b645-6dd7af909859/3cbda0af-1f9c-5385-b645-6dd7af909859_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332771,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cbda0af-1f9c-5385-b645-6dd7af909859/3cbda0af-1f9c-5385-b645-6dd7af909859_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327974,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cbda0af-1f9c-5385-b645-6dd7af909859/3cbda0af-1f9c-5385-b645-6dd7af909859_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294196,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cbda0af-1f9c-5385-b645-6dd7af909859/3cbda0af-1f9c-5385-b645-6dd7af909859_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307618,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cbda0af-1f9c-5385-b645-6dd7af909859/3cbda0af-1f9c-5385-b645-6dd7af909859_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325011,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cbda0af-1f9c-5385-b645-6dd7af909859/3cbda0af-1f9c-5385-b645-6dd7af909859_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260498,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cbda0af-1f9c-5385-b645-6dd7af909859/3cbda0af-1f9c-5385-b645-6dd7af909859_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 247913,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/86abcf59175e4b8290541d9dffd506e3/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-25',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE E-TECH Megane E-Tech Electric EV40 130ch Equilibre '
'standard charge',
'transmission': 'automatic',
'trim': 'Megane E-Tech Electric EV40 130ch Equilibre standard charge',
'vin': None,
'year': 2022}
2026-03-27 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988297%27 HTTP/1.1" 200 None
2026-03-27 16:47:45 [ayvens.fr] INFO: Saving data for 1988297: {'created_time': 1774630065.537488, 'last_price_update_time': 1774630065.537499, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988297') HTTP/1.1" 204 0
2026-03-27 16:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 16:47:54 [ayvens.fr] INFO: Found listing with ID: 1988298
2026-03-27 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988298%27 HTTP/1.1" 200 None
2026-03-27 16:47:54 [ayvens.fr] INFO: Scrape type for 1988298: 1
2026-03-27 16:47:54 [ayvens.fr] INFO: Extracting data for car ID: 1988298
2026-03-27 16:47:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95181c9c-3ccb-5469-8fc4-6c4f8be32954 with identifier: 1988298
2026-03-27 16:47:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95181c9c-3ccb-5469-8fc4-6c4f8be32954 with scrape type 1
2026-03-27 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 95181c9c-3ccb-5469-8fc4-6c4f8be32954
2026-03-27 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3577563c06be47279720d6f30c3c9df1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/1.jpg not downloaded yet
2026-03-27 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3577563c06be47279720d6f30c3c9df1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/2.jpg not downloaded yet
2026-03-27 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3577563c06be47279720d6f30c3c9df1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/3.jpg not downloaded yet
2026-03-27 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3577563c06be47279720d6f30c3c9df1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/4.jpg not downloaded yet
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3577563c06be47279720d6f30c3c9df1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/5.jpg not downloaded yet
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3577563c06be47279720d6f30c3c9df1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/6.jpg not downloaded yet
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3577563c06be47279720d6f30c3c9df1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/7.jpg not downloaded yet
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3577563c06be47279720d6f30c3c9df1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/8.jpg not downloaded yet
2026-03-27 16:47:55 [ayvens.fr] INFO: Found listing with ID: 1988299
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988299%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [ayvens.fr] INFO: Scrape type for 1988299: 1
2026-03-27 16:47:55 [ayvens.fr] INFO: Extracting data for car ID: 1988299
2026-03-27 16:47:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68c9d8b9-af30-50c6-b94a-c06485cae669 with identifier: 1988299
2026-03-27 16:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68c9d8b9-af30-50c6-b94a-c06485cae669 with scrape type 1
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 68c9d8b9-af30-50c6-b94a-c06485cae669
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F8b870bbc91304a98b755cda0cd834ce4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/1.jpg not downloaded yet
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F8b870bbc91304a98b755cda0cd834ce4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/2.jpg not downloaded yet
2026-03-27 16:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F8b870bbc91304a98b755cda0cd834ce4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/3.jpg not downloaded yet
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F8b870bbc91304a98b755cda0cd834ce4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/4.jpg not downloaded yet
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F8b870bbc91304a98b755cda0cd834ce4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/5.jpg not downloaded yet
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F8b870bbc91304a98b755cda0cd834ce4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/6.jpg not downloaded yet
2026-03-27 16:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F8b870bbc91304a98b755cda0cd834ce4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/7.jpg not downloaded yet
2026-03-27 16:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F8b870bbc91304a98b755cda0cd834ce4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/8.jpg not downloaded yet
2026-03-27 16:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:55 [ayvens.fr] INFO: Found listing with ID: 1988300
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988300%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [ayvens.fr] INFO: Scrape type for 1988300: 1
2026-03-27 16:47:55 [ayvens.fr] INFO: Extracting data for car ID: 1988300
2026-03-27 16:47:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 257d2dcd-de99-5627-af11-3d7410822efb with identifier: 1988300
2026-03-27 16:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 257d2dcd-de99-5627-af11-3d7410822efb with scrape type 1
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 257d2dcd-de99-5627-af11-3d7410822efb
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fc182e3c39eb549069163a7ed39049638%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/1.jpg not downloaded yet
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fc182e3c39eb549069163a7ed39049638%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/2.jpg not downloaded yet
2026-03-27 16:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d80f90>
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95181c9c-3ccb-5469-8fc4-6c4f8be32954/95181c9c-3ccb-5469-8fc4-6c4f8be32954_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3577563c06be47279720d6f30c3c9df1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/2.jpg saved to cache
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95181c9c-3ccb-5469-8fc4-6c4f8be32954
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fc182e3c39eb549069163a7ed39049638%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/3.jpg not downloaded yet
2026-03-27 16:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fc182e3c39eb549069163a7ed39049638%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/4.jpg not downloaded yet
2026-03-27 16:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fc182e3c39eb549069163a7ed39049638%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/5.jpg not downloaded yet
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ed9e90>
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95181c9c-3ccb-5469-8fc4-6c4f8be32954/95181c9c-3ccb-5469-8fc4-6c4f8be32954_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3577563c06be47279720d6f30c3c9df1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/5.jpg saved to cache
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95181c9c-3ccb-5469-8fc4-6c4f8be32954
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59307f750>
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95181c9c-3ccb-5469-8fc4-6c4f8be32954/95181c9c-3ccb-5469-8fc4-6c4f8be32954_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3577563c06be47279720d6f30c3c9df1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/3.jpg saved to cache
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95181c9c-3ccb-5469-8fc4-6c4f8be32954
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904fdd90>
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95181c9c-3ccb-5469-8fc4-6c4f8be32954/95181c9c-3ccb-5469-8fc4-6c4f8be32954_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3577563c06be47279720d6f30c3c9df1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/1.jpg saved to cache
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95181c9c-3ccb-5469-8fc4-6c4f8be32954
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d82010>
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95181c9c-3ccb-5469-8fc4-6c4f8be32954/95181c9c-3ccb-5469-8fc4-6c4f8be32954_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3577563c06be47279720d6f30c3c9df1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/7.jpg saved to cache
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95181c9c-3ccb-5469-8fc4-6c4f8be32954
2026-03-27 16:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fc182e3c39eb549069163a7ed39049638%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/6.jpg not downloaded yet
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fc182e3c39eb549069163a7ed39049638%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/7.jpg not downloaded yet
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fc8290>
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95181c9c-3ccb-5469-8fc4-6c4f8be32954/95181c9c-3ccb-5469-8fc4-6c4f8be32954_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3577563c06be47279720d6f30c3c9df1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/6.jpg saved to cache
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95181c9c-3ccb-5469-8fc4-6c4f8be32954
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd85d0>
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c9d8b9-af30-50c6-b94a-c06485cae669/68c9d8b9-af30-50c6-b94a-c06485cae669_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F8b870bbc91304a98b755cda0cd834ce4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/1.jpg saved to cache
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68c9d8b9-af30-50c6-b94a-c06485cae669
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d8da50>
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95181c9c-3ccb-5469-8fc4-6c4f8be32954/95181c9c-3ccb-5469-8fc4-6c4f8be32954_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3577563c06be47279720d6f30c3c9df1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/8.jpg saved to cache
2026-03-27 16:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95181c9c-3ccb-5469-8fc4-6c4f8be32954
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dda810>
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95181c9c-3ccb-5469-8fc4-6c4f8be32954/95181c9c-3ccb-5469-8fc4-6c4f8be32954_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3577563c06be47279720d6f30c3c9df1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/4.jpg saved to cache
2026-03-27 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95181c9c-3ccb-5469-8fc4-6c4f8be32954
2026-03-27 16:47:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95181c9c-3ccb-5469-8fc4-6c4f8be32954, skipping ID generation
2026-03-27 16:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95181c9c-3ccb-5469-8fc4-6c4f8be32954 with scrape type 1
2026-03-27 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95181c9c-3ccb-5469-8fc4-6c4f8be32954 sending to next pipeline
2026-03-27 16:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 95181c9c-3ccb-5469-8fc4-6c4f8be32954, identifier: 1988298
2026-03-27 16:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fc182e3c39eb549069163a7ed39049638%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/8.jpg not downloaded yet
2026-03-27 16:47:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 95181c9c-3ccb-5469-8fc4-6c4f8be32954 with identifier: 1988298
2026-03-27 16:47:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 95181c9c-3ccb-5469-8fc4-6c4f8be32954 with identifier: 1988298
2026-03-27 16:47:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 95181c9c-3ccb-5469-8fc4-6c4f8be32954 with identifier: 1988298 to the API
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '95181c9c-3ccb-5469-8fc4-6c4f8be32954',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE E-TECH',
'odometer': 36141,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95181c9c-3ccb-5469-8fc4-6c4f8be32954/95181c9c-3ccb-5469-8fc4-6c4f8be32954_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302490,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95181c9c-3ccb-5469-8fc4-6c4f8be32954/95181c9c-3ccb-5469-8fc4-6c4f8be32954_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302490,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95181c9c-3ccb-5469-8fc4-6c4f8be32954/95181c9c-3ccb-5469-8fc4-6c4f8be32954_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305520,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95181c9c-3ccb-5469-8fc4-6c4f8be32954/95181c9c-3ccb-5469-8fc4-6c4f8be32954_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 266195,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95181c9c-3ccb-5469-8fc4-6c4f8be32954/95181c9c-3ccb-5469-8fc4-6c4f8be32954_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245377,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95181c9c-3ccb-5469-8fc4-6c4f8be32954/95181c9c-3ccb-5469-8fc4-6c4f8be32954_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281760,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95181c9c-3ccb-5469-8fc4-6c4f8be32954/95181c9c-3ccb-5469-8fc4-6c4f8be32954_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 278479,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95181c9c-3ccb-5469-8fc4-6c4f8be32954/95181c9c-3ccb-5469-8fc4-6c4f8be32954_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255030,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3577563c06be47279720d6f30c3c9df1/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-25',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE E-TECH Megane E-Tech Electric EV40 130ch Equilibre '
'standard charge',
'transmission': 'automatic',
'trim': 'Megane E-Tech Electric EV40 130ch Equilibre standard charge',
'vin': None,
'year': 2022}
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988298%27 HTTP/1.1" 200 None
2026-03-27 16:47:56 [ayvens.fr] INFO: Saving data for 1988298: {'created_time': 1774630076.749885, 'last_price_update_time': 1774630076.749895, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988298') HTTP/1.1" 204 0
2026-03-27 16:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:56 [ayvens.fr] INFO: Found listing with ID: 1988301
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988301%27 HTTP/1.1" 200 None
2026-03-27 16:47:56 [ayvens.fr] INFO: Scrape type for 1988301: 1
2026-03-27 16:47:56 [ayvens.fr] INFO: Extracting data for car ID: 1988301
2026-03-27 16:47:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f79f079-b50f-5198-a019-71ec8443c200 with identifier: 1988301
2026-03-27 16:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f79f079-b50f-5198-a019-71ec8443c200 with scrape type 1
2026-03-27 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4f79f079-b50f-5198-a019-71ec8443c200
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F04a1996c1da5463f97f9b7ea8d73f0a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/1.jpg not downloaded yet
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F04a1996c1da5463f97f9b7ea8d73f0a9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/2.jpg not downloaded yet
2026-03-27 16:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe3190>
2026-03-27 16:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c9d8b9-af30-50c6-b94a-c06485cae669/68c9d8b9-af30-50c6-b94a-c06485cae669_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F8b870bbc91304a98b755cda0cd834ce4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/3.jpg saved to cache
2026-03-27 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 68c9d8b9-af30-50c6-b94a-c06485cae669
2026-03-27 16:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd8750>
2026-03-27 16:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c9d8b9-af30-50c6-b94a-c06485cae669/68c9d8b9-af30-50c6-b94a-c06485cae669_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F8b870bbc91304a98b755cda0cd834ce4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/4.jpg saved to cache
2026-03-27 16:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 68c9d8b9-af30-50c6-b94a-c06485cae669
2026-03-27 16:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b18c50>
2026-03-27 16:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c9d8b9-af30-50c6-b94a-c06485cae669/68c9d8b9-af30-50c6-b94a-c06485cae669_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F8b870bbc91304a98b755cda0cd834ce4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/6.jpg saved to cache
2026-03-27 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 68c9d8b9-af30-50c6-b94a-c06485cae669
2026-03-27 16:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F04a1996c1da5463f97f9b7ea8d73f0a9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/3.jpg not downloaded yet
2026-03-27 16:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F04a1996c1da5463f97f9b7ea8d73f0a9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/4.jpg not downloaded yet
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b77890>
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c9d8b9-af30-50c6-b94a-c06485cae669/68c9d8b9-af30-50c6-b94a-c06485cae669_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F8b870bbc91304a98b755cda0cd834ce4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/5.jpg saved to cache
2026-03-27 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68c9d8b9-af30-50c6-b94a-c06485cae669
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c00d0>
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c9d8b9-af30-50c6-b94a-c06485cae669/68c9d8b9-af30-50c6-b94a-c06485cae669_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F8b870bbc91304a98b755cda0cd834ce4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/2.jpg saved to cache
2026-03-27 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 68c9d8b9-af30-50c6-b94a-c06485cae669
2026-03-27 16:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F04a1996c1da5463f97f9b7ea8d73f0a9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/5.jpg not downloaded yet
2026-03-27 16:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F04a1996c1da5463f97f9b7ea8d73f0a9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/6.jpg not downloaded yet
2026-03-27 16:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051ea50>
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c9d8b9-af30-50c6-b94a-c06485cae669/68c9d8b9-af30-50c6-b94a-c06485cae669_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F8b870bbc91304a98b755cda0cd834ce4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/7.jpg saved to cache
2026-03-27 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 68c9d8b9-af30-50c6-b94a-c06485cae669
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910013d0>
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c9d8b9-af30-50c6-b94a-c06485cae669/68c9d8b9-af30-50c6-b94a-c06485cae669_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F8b870bbc91304a98b755cda0cd834ce4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/8.jpg saved to cache
2026-03-27 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 68c9d8b9-af30-50c6-b94a-c06485cae669
2026-03-27 16:47:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68c9d8b9-af30-50c6-b94a-c06485cae669, skipping ID generation
2026-03-27 16:47:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68c9d8b9-af30-50c6-b94a-c06485cae669 with scrape type 1
2026-03-27 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68c9d8b9-af30-50c6-b94a-c06485cae669 sending to next pipeline
2026-03-27 16:47:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 68c9d8b9-af30-50c6-b94a-c06485cae669, identifier: 1988299
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd9d10>
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_257d2dcd-de99-5627-af11-3d7410822efb/257d2dcd-de99-5627-af11-3d7410822efb_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fc182e3c39eb549069163a7ed39049638%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/2.jpg saved to cache
2026-03-27 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 257d2dcd-de99-5627-af11-3d7410822efb
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b5a310>
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_257d2dcd-de99-5627-af11-3d7410822efb/257d2dcd-de99-5627-af11-3d7410822efb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fc182e3c39eb549069163a7ed39049638%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/1.jpg saved to cache
2026-03-27 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 257d2dcd-de99-5627-af11-3d7410822efb
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F04a1996c1da5463f97f9b7ea8d73f0a9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/7.jpg not downloaded yet
2026-03-27 16:47:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 68c9d8b9-af30-50c6-b94a-c06485cae669 with identifier: 1988299
2026-03-27 16:47:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:47:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 68c9d8b9-af30-50c6-b94a-c06485cae669 with identifier: 1988299
2026-03-27 16:47:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 68c9d8b9-af30-50c6-b94a-c06485cae669 with identifier: 1988299 to the API
2026-03-27 16:47:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 150,
'color': 'NOIR INTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '68c9d8b9-af30-50c6-b94a-c06485cae669',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'TOURAN',
'odometer': 83481,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c9d8b9-af30-50c6-b94a-c06485cae669/68c9d8b9-af30-50c6-b94a-c06485cae669_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350386,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c9d8b9-af30-50c6-b94a-c06485cae669/68c9d8b9-af30-50c6-b94a-c06485cae669_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350386,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c9d8b9-af30-50c6-b94a-c06485cae669/68c9d8b9-af30-50c6-b94a-c06485cae669_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337088,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c9d8b9-af30-50c6-b94a-c06485cae669/68c9d8b9-af30-50c6-b94a-c06485cae669_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337209,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c9d8b9-af30-50c6-b94a-c06485cae669/68c9d8b9-af30-50c6-b94a-c06485cae669_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379441,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c9d8b9-af30-50c6-b94a-c06485cae669/68c9d8b9-af30-50c6-b94a-c06485cae669_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321723,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c9d8b9-af30-50c6-b94a-c06485cae669/68c9d8b9-af30-50c6-b94a-c06485cae669_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352546,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c9d8b9-af30-50c6-b94a-c06485cae669/68c9d8b9-af30-50c6-b94a-c06485cae669_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 470568,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/8b870bbc91304a98b755cda0cd834ce4/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-28',
'seats_number': 7,
'seller_name': None,
'title': 'VOLKSWAGEN TOURAN Touran 2.0 TDI 115ch FAP Lounge Business DSG7 7 '
'places',
'transmission': 'automatic',
'trim': 'Touran 2.0 TDI 115ch FAP Lounge Business DSG7 7 places',
'vin': None,
'year': 2020}
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988299%27 HTTP/1.1" 200 None
2026-03-27 16:47:58 [ayvens.fr] INFO: Saving data for 1988299: {'created_time': 1774630078.243536, 'last_price_update_time': 1774630078.24355, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988299') HTTP/1.1" 204 0
2026-03-27 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F04a1996c1da5463f97f9b7ea8d73f0a9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/8.jpg not downloaded yet
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c2650>
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_257d2dcd-de99-5627-af11-3d7410822efb/257d2dcd-de99-5627-af11-3d7410822efb_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fc182e3c39eb549069163a7ed39049638%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/3.jpg saved to cache
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 257d2dcd-de99-5627-af11-3d7410822efb
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d77950>
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_257d2dcd-de99-5627-af11-3d7410822efb/257d2dcd-de99-5627-af11-3d7410822efb_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fc182e3c39eb549069163a7ed39049638%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/6.jpg saved to cache
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 257d2dcd-de99-5627-af11-3d7410822efb
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d8dd90>
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_257d2dcd-de99-5627-af11-3d7410822efb/257d2dcd-de99-5627-af11-3d7410822efb_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fc182e3c39eb549069163a7ed39049638%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/4.jpg saved to cache
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 257d2dcd-de99-5627-af11-3d7410822efb
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d8c150>
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_257d2dcd-de99-5627-af11-3d7410822efb/257d2dcd-de99-5627-af11-3d7410822efb_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fc182e3c39eb549069163a7ed39049638%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/7.jpg saved to cache
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 257d2dcd-de99-5627-af11-3d7410822efb
2026-03-27 16:47:58 [ayvens.fr] INFO: Found listing with ID: 1988302
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988302%27 HTTP/1.1" 200 None
2026-03-27 16:47:58 [ayvens.fr] INFO: Scrape type for 1988302: 1
2026-03-27 16:47:58 [ayvens.fr] INFO: Extracting data for car ID: 1988302
2026-03-27 16:47:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37610c70-0ed3-5770-b6b1-600b02dde4d5 with identifier: 1988302
2026-03-27 16:47:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37610c70-0ed3-5770-b6b1-600b02dde4d5 with scrape type 1
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 37610c70-0ed3-5770-b6b1-600b02dde4d5
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F12035b5622d84b37a670b3e86494b083%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/1.jpg not downloaded yet
2026-03-27 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F12035b5622d84b37a670b3e86494b083%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/2.jpg not downloaded yet
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3ed50>
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_257d2dcd-de99-5627-af11-3d7410822efb/257d2dcd-de99-5627-af11-3d7410822efb_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fc182e3c39eb549069163a7ed39049638%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/5.jpg saved to cache
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 257d2dcd-de99-5627-af11-3d7410822efb
2026-03-27 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F12035b5622d84b37a670b3e86494b083%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/3.jpg not downloaded yet
2026-03-27 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F12035b5622d84b37a670b3e86494b083%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/4.jpg not downloaded yet
2026-03-27 16:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F12035b5622d84b37a670b3e86494b083%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/5.jpg not downloaded yet
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590519a90>
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f79f079-b50f-5198-a019-71ec8443c200/4f79f079-b50f-5198-a019-71ec8443c200_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F04a1996c1da5463f97f9b7ea8d73f0a9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/4.jpg saved to cache
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f79f079-b50f-5198-a019-71ec8443c200
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ad4a90>
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_257d2dcd-de99-5627-af11-3d7410822efb/257d2dcd-de99-5627-af11-3d7410822efb_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fc182e3c39eb549069163a7ed39049638%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/8.jpg saved to cache
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 257d2dcd-de99-5627-af11-3d7410822efb
2026-03-27 16:47:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 257d2dcd-de99-5627-af11-3d7410822efb, skipping ID generation
2026-03-27 16:47:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 257d2dcd-de99-5627-af11-3d7410822efb with scrape type 1
2026-03-27 16:47:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 257d2dcd-de99-5627-af11-3d7410822efb sending to next pipeline
2026-03-27 16:47:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 257d2dcd-de99-5627-af11-3d7410822efb, identifier: 1988300
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F12035b5622d84b37a670b3e86494b083%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/6.jpg not downloaded yet
2026-03-27 16:47:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 257d2dcd-de99-5627-af11-3d7410822efb with identifier: 1988300
2026-03-27 16:47:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:47:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 257d2dcd-de99-5627-af11-3d7410822efb with identifier: 1988300
2026-03-27 16:47:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 257d2dcd-de99-5627-af11-3d7410822efb with identifier: 1988300 to the API
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:47:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'BLEU AVATAR METALLISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '257d2dcd-de99-5627-af11-3d7410822efb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 77825,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_257d2dcd-de99-5627-af11-3d7410822efb/257d2dcd-de99-5627-af11-3d7410822efb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 467150,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_257d2dcd-de99-5627-af11-3d7410822efb/257d2dcd-de99-5627-af11-3d7410822efb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 467150,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_257d2dcd-de99-5627-af11-3d7410822efb/257d2dcd-de99-5627-af11-3d7410822efb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 593700,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_257d2dcd-de99-5627-af11-3d7410822efb/257d2dcd-de99-5627-af11-3d7410822efb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408564,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_257d2dcd-de99-5627-af11-3d7410822efb/257d2dcd-de99-5627-af11-3d7410822efb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371309,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_257d2dcd-de99-5627-af11-3d7410822efb/257d2dcd-de99-5627-af11-3d7410822efb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369735,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_257d2dcd-de99-5627-af11-3d7410822efb/257d2dcd-de99-5627-af11-3d7410822efb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182128,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_257d2dcd-de99-5627-af11-3d7410822efb/257d2dcd-de99-5627-af11-3d7410822efb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343611,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/c182e3c39eb549069163a7ed39049638/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-22',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 SW 308 SW 1.2 PureTech 130ch S&S Active Pack',
'transmission': 'manual',
'trim': '308 SW 1.2 PureTech 130ch S&S Active Pack',
'vin': None,
'year': 2024}
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988300%27 HTTP/1.1" 200 None
2026-03-27 16:47:59 [ayvens.fr] INFO: Saving data for 1988300: {'created_time': 1774630079.560588, 'last_price_update_time': 1774630079.560601, 'auction_closing_time': 1774969200.0}
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988300') HTTP/1.1" 204 0
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F12035b5622d84b37a670b3e86494b083%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/7.jpg not downloaded yet
2026-03-27 16:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59102c510>
2026-03-27 16:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f79f079-b50f-5198-a019-71ec8443c200/4f79f079-b50f-5198-a019-71ec8443c200_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F04a1996c1da5463f97f9b7ea8d73f0a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/1.jpg saved to cache
2026-03-27 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f79f079-b50f-5198-a019-71ec8443c200
2026-03-27 16:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590529a50>
2026-03-27 16:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f79f079-b50f-5198-a019-71ec8443c200/4f79f079-b50f-5198-a019-71ec8443c200_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F04a1996c1da5463f97f9b7ea8d73f0a9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/2.jpg saved to cache
2026-03-27 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f79f079-b50f-5198-a019-71ec8443c200
2026-03-27 16:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ab8450>
2026-03-27 16:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f79f079-b50f-5198-a019-71ec8443c200/4f79f079-b50f-5198-a019-71ec8443c200_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F04a1996c1da5463f97f9b7ea8d73f0a9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/3.jpg saved to cache
2026-03-27 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f79f079-b50f-5198-a019-71ec8443c200
2026-03-27 16:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590529d10>
2026-03-27 16:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f79f079-b50f-5198-a019-71ec8443c200/4f79f079-b50f-5198-a019-71ec8443c200_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F04a1996c1da5463f97f9b7ea8d73f0a9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/5.jpg saved to cache
2026-03-27 16:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f79f079-b50f-5198-a019-71ec8443c200
2026-03-27 16:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590521f50>
2026-03-27 16:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f79f079-b50f-5198-a019-71ec8443c200/4f79f079-b50f-5198-a019-71ec8443c200_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F04a1996c1da5463f97f9b7ea8d73f0a9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/6.jpg saved to cache
2026-03-27 16:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f79f079-b50f-5198-a019-71ec8443c200
2026-03-27 16:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590528290>
2026-03-27 16:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f79f079-b50f-5198-a019-71ec8443c200/4f79f079-b50f-5198-a019-71ec8443c200_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F04a1996c1da5463f97f9b7ea8d73f0a9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/7.jpg saved to cache
2026-03-27 16:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f79f079-b50f-5198-a019-71ec8443c200
2026-03-27 16:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F12035b5622d84b37a670b3e86494b083%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/8.jpg not downloaded yet
2026-03-27 16:48:00 [ayvens.fr] INFO: Found listing with ID: 1988303
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988303%27 HTTP/1.1" 200 None
2026-03-27 16:48:00 [ayvens.fr] INFO: Scrape type for 1988303: 1
2026-03-27 16:48:00 [ayvens.fr] INFO: Extracting data for car ID: 1988303
2026-03-27 16:48:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6 with identifier: 1988303
2026-03-27 16:48:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6 with scrape type 1
2026-03-27 16:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F502cc61f34cb4b1e81afddb0be076d00%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/1.jpg not downloaded yet
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F502cc61f34cb4b1e81afddb0be076d00%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/2.jpg not downloaded yet
2026-03-27 16:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F502cc61f34cb4b1e81afddb0be076d00%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/3.jpg not downloaded yet
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F502cc61f34cb4b1e81afddb0be076d00%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/4.jpg not downloaded yet
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F502cc61f34cb4b1e81afddb0be076d00%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/5.jpg not downloaded yet
2026-03-27 16:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee2690>
2026-03-27 16:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f79f079-b50f-5198-a019-71ec8443c200/4f79f079-b50f-5198-a019-71ec8443c200_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F04a1996c1da5463f97f9b7ea8d73f0a9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/8.jpg saved to cache
2026-03-27 16:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f79f079-b50f-5198-a019-71ec8443c200
2026-03-27 16:48:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f79f079-b50f-5198-a019-71ec8443c200, skipping ID generation
2026-03-27 16:48:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f79f079-b50f-5198-a019-71ec8443c200 with scrape type 1
2026-03-27 16:48:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f79f079-b50f-5198-a019-71ec8443c200 sending to next pipeline
2026-03-27 16:48:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4f79f079-b50f-5198-a019-71ec8443c200, identifier: 1988301
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F502cc61f34cb4b1e81afddb0be076d00%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/6.jpg not downloaded yet
2026-03-27 16:48:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4f79f079-b50f-5198-a019-71ec8443c200 with identifier: 1988301
2026-03-27 16:48:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4f79f079-b50f-5198-a019-71ec8443c200 with identifier: 1988301
2026-03-27 16:48:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4f79f079-b50f-5198-a019-71ec8443c200 with identifier: 1988301 to the API
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 151,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '4f79f079-b50f-5198-a019-71ec8443c200',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SORENTO',
'odometer': 76356,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f79f079-b50f-5198-a019-71ec8443c200/4f79f079-b50f-5198-a019-71ec8443c200_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f79f079-b50f-5198-a019-71ec8443c200/4f79f079-b50f-5198-a019-71ec8443c200_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f79f079-b50f-5198-a019-71ec8443c200/4f79f079-b50f-5198-a019-71ec8443c200_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395363,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f79f079-b50f-5198-a019-71ec8443c200/4f79f079-b50f-5198-a019-71ec8443c200_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345430,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f79f079-b50f-5198-a019-71ec8443c200/4f79f079-b50f-5198-a019-71ec8443c200_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408869,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f79f079-b50f-5198-a019-71ec8443c200/4f79f079-b50f-5198-a019-71ec8443c200_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356768,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f79f079-b50f-5198-a019-71ec8443c200/4f79f079-b50f-5198-a019-71ec8443c200_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290889,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f79f079-b50f-5198-a019-71ec8443c200/4f79f079-b50f-5198-a019-71ec8443c200_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218295,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/04a1996c1da5463f97f9b7ea8d73f0a9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SORENTO Sorento 1.6 T-GDi 230ch HEV Premium BVA6 4x2',
'transmission': 'automatic',
'trim': 'Sorento 1.6 T-GDi 230ch HEV Premium BVA6 4x2',
'vin': None,
'year': 2022}
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988301%27 HTTP/1.1" 200 None
2026-03-27 16:48:01 [ayvens.fr] INFO: Saving data for 1988301: {'created_time': 1774630081.035428, 'last_price_update_time': 1774630081.03544, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988301') HTTP/1.1" 204 0
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d43f10>
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37610c70-0ed3-5770-b6b1-600b02dde4d5/37610c70-0ed3-5770-b6b1-600b02dde4d5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F12035b5622d84b37a670b3e86494b083%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/1.jpg saved to cache
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37610c70-0ed3-5770-b6b1-600b02dde4d5
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ed9ed0>
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37610c70-0ed3-5770-b6b1-600b02dde4d5/37610c70-0ed3-5770-b6b1-600b02dde4d5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F12035b5622d84b37a670b3e86494b083%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/3.jpg saved to cache
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37610c70-0ed3-5770-b6b1-600b02dde4d5
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d8e350>
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37610c70-0ed3-5770-b6b1-600b02dde4d5/37610c70-0ed3-5770-b6b1-600b02dde4d5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F12035b5622d84b37a670b3e86494b083%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/2.jpg saved to cache
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37610c70-0ed3-5770-b6b1-600b02dde4d5
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d40450>
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37610c70-0ed3-5770-b6b1-600b02dde4d5/37610c70-0ed3-5770-b6b1-600b02dde4d5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F12035b5622d84b37a670b3e86494b083%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/4.jpg saved to cache
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37610c70-0ed3-5770-b6b1-600b02dde4d5
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051f5d0>
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37610c70-0ed3-5770-b6b1-600b02dde4d5/37610c70-0ed3-5770-b6b1-600b02dde4d5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F12035b5622d84b37a670b3e86494b083%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/5.jpg saved to cache
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37610c70-0ed3-5770-b6b1-600b02dde4d5
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F502cc61f34cb4b1e81afddb0be076d00%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/7.jpg not downloaded yet
2026-03-27 16:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F502cc61f34cb4b1e81afddb0be076d00%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/8.jpg not downloaded yet
2026-03-27 16:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:01 [ayvens.fr] INFO: Found listing with ID: 1988304
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988304%27 HTTP/1.1" 200 None
2026-03-27 16:48:01 [ayvens.fr] INFO: Scrape type for 1988304: 1
2026-03-27 16:48:01 [ayvens.fr] INFO: Extracting data for car ID: 1988304
2026-03-27 16:48:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5686f98-9775-5574-a7ea-3746bbe146a9 with identifier: 1988304
2026-03-27 16:48:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5686f98-9775-5574-a7ea-3746bbe146a9 with scrape type 1
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e5686f98-9775-5574-a7ea-3746bbe146a9
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F95b7dd6f7dcc4921ab499d624b4a9ff9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/1.jpg not downloaded yet
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F95b7dd6f7dcc4921ab499d624b4a9ff9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/2.jpg not downloaded yet
2026-03-27 16:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F95b7dd6f7dcc4921ab499d624b4a9ff9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/3.jpg not downloaded yet
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F95b7dd6f7dcc4921ab499d624b4a9ff9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/4.jpg not downloaded yet
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F95b7dd6f7dcc4921ab499d624b4a9ff9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/5.jpg not downloaded yet
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F95b7dd6f7dcc4921ab499d624b4a9ff9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/6.jpg not downloaded yet
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590644c90>
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37610c70-0ed3-5770-b6b1-600b02dde4d5/37610c70-0ed3-5770-b6b1-600b02dde4d5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F12035b5622d84b37a670b3e86494b083%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/7.jpg saved to cache
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37610c70-0ed3-5770-b6b1-600b02dde4d5
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df42d0>
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6/2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F502cc61f34cb4b1e81afddb0be076d00%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/2.jpg saved to cache
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3db10>
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6/2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F502cc61f34cb4b1e81afddb0be076d00%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/1.jpg saved to cache
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F95b7dd6f7dcc4921ab499d624b4a9ff9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/7.jpg not downloaded yet
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b19910>
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37610c70-0ed3-5770-b6b1-600b02dde4d5/37610c70-0ed3-5770-b6b1-600b02dde4d5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F12035b5622d84b37a670b3e86494b083%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/6.jpg saved to cache
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37610c70-0ed3-5770-b6b1-600b02dde4d5
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dade90>
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6/2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F502cc61f34cb4b1e81afddb0be076d00%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/3.jpg saved to cache
2026-03-27 16:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f10810>
2026-03-27 16:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6/2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F502cc61f34cb4b1e81afddb0be076d00%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/4.jpg saved to cache
2026-03-27 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F95b7dd6f7dcc4921ab499d624b4a9ff9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/8.jpg not downloaded yet
2026-03-27 16:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:02 [ayvens.fr] INFO: Found listing with ID: 1988305
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988305%27 HTTP/1.1" 200 None
2026-03-27 16:48:02 [ayvens.fr] INFO: Scrape type for 1988305: 1
2026-03-27 16:48:02 [ayvens.fr] INFO: Extracting data for car ID: 1988305
2026-03-27 16:48:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d2172c1-4f65-58b0-a275-76b291e78f26 with identifier: 1988305
2026-03-27 16:48:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d2172c1-4f65-58b0-a275-76b291e78f26 with scrape type 1
2026-03-27 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1d2172c1-4f65-58b0-a275-76b291e78f26
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fd8649863566f4d8ca67816fabe678f2b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/1.jpg not downloaded yet
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dad190>
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37610c70-0ed3-5770-b6b1-600b02dde4d5/37610c70-0ed3-5770-b6b1-600b02dde4d5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F12035b5622d84b37a670b3e86494b083%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/8.jpg saved to cache
2026-03-27 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37610c70-0ed3-5770-b6b1-600b02dde4d5
2026-03-27 16:48:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37610c70-0ed3-5770-b6b1-600b02dde4d5, skipping ID generation
2026-03-27 16:48:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37610c70-0ed3-5770-b6b1-600b02dde4d5 with scrape type 1
2026-03-27 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37610c70-0ed3-5770-b6b1-600b02dde4d5 sending to next pipeline
2026-03-27 16:48:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 37610c70-0ed3-5770-b6b1-600b02dde4d5, identifier: 1988302
2026-03-27 16:48:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 37610c70-0ed3-5770-b6b1-600b02dde4d5 with identifier: 1988302
2026-03-27 16:48:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:48:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 37610c70-0ed3-5770-b6b1-600b02dde4d5 with identifier: 1988302
2026-03-27 16:48:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 37610c70-0ed3-5770-b6b1-600b02dde4d5 with identifier: 1988302 to the API
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'BLANC NACRE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '37610c70-0ed3-5770-b6b1-600b02dde4d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'NIRO',
'odometer': 83855,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37610c70-0ed3-5770-b6b1-600b02dde4d5/37610c70-0ed3-5770-b6b1-600b02dde4d5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525489,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37610c70-0ed3-5770-b6b1-600b02dde4d5/37610c70-0ed3-5770-b6b1-600b02dde4d5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525489,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37610c70-0ed3-5770-b6b1-600b02dde4d5/37610c70-0ed3-5770-b6b1-600b02dde4d5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 540531,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37610c70-0ed3-5770-b6b1-600b02dde4d5/37610c70-0ed3-5770-b6b1-600b02dde4d5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377970,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37610c70-0ed3-5770-b6b1-600b02dde4d5/37610c70-0ed3-5770-b6b1-600b02dde4d5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438115,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37610c70-0ed3-5770-b6b1-600b02dde4d5/37610c70-0ed3-5770-b6b1-600b02dde4d5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373359,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37610c70-0ed3-5770-b6b1-600b02dde4d5/37610c70-0ed3-5770-b6b1-600b02dde4d5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323284,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37610c70-0ed3-5770-b6b1-600b02dde4d5/37610c70-0ed3-5770-b6b1-600b02dde4d5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613404,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/12035b5622d84b37a670b3e86494b083/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-21',
'seats_number': 5,
'seller_name': None,
'title': 'KIA NIRO Niro 1.6 GDi 105ch ISG + electrique 43.5ch Design DCT6',
'transmission': 'automatic',
'trim': 'Niro 1.6 GDi 105ch ISG + electrique 43.5ch Design DCT6',
'vin': None,
'year': 2021}
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988302%27 HTTP/1.1" 200 None
2026-03-27 16:48:02 [ayvens.fr] INFO: Saving data for 1988302: {'created_time': 1774630082.649232, 'last_price_update_time': 1774630082.649244, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988302') HTTP/1.1" 204 0
2026-03-27 16:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fd8649863566f4d8ca67816fabe678f2b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/2.jpg not downloaded yet
2026-03-27 16:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fd8649863566f4d8ca67816fabe678f2b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/3.jpg not downloaded yet
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590af18d0>
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6/2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F502cc61f34cb4b1e81afddb0be076d00%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/5.jpg saved to cache
2026-03-27 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590514c90>
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6/2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F502cc61f34cb4b1e81afddb0be076d00%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/6.jpg saved to cache
2026-03-27 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fd8649863566f4d8ca67816fabe678f2b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/4.jpg not downloaded yet
2026-03-27 16:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fd8649863566f4d8ca67816fabe678f2b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/5.jpg not downloaded yet
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590623150>
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6/2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F502cc61f34cb4b1e81afddb0be076d00%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/7.jpg saved to cache
2026-03-27 16:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee2010>
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6/2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F502cc61f34cb4b1e81afddb0be076d00%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/8.jpg saved to cache
2026-03-27 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6
2026-03-27 16:48:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6, skipping ID generation
2026-03-27 16:48:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6 with scrape type 1
2026-03-27 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6 sending to next pipeline
2026-03-27 16:48:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6, identifier: 1988303
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d58350>
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5686f98-9775-5574-a7ea-3746bbe146a9/e5686f98-9775-5574-a7ea-3746bbe146a9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F95b7dd6f7dcc4921ab499d624b4a9ff9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/1.jpg saved to cache
2026-03-27 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5686f98-9775-5574-a7ea-3746bbe146a9
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d523d0>
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5686f98-9775-5574-a7ea-3746bbe146a9/e5686f98-9775-5574-a7ea-3746bbe146a9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F95b7dd6f7dcc4921ab499d624b4a9ff9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/2.jpg saved to cache
2026-03-27 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e5686f98-9775-5574-a7ea-3746bbe146a9
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a1b10>
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5686f98-9775-5574-a7ea-3746bbe146a9/e5686f98-9775-5574-a7ea-3746bbe146a9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F95b7dd6f7dcc4921ab499d624b4a9ff9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/4.jpg saved to cache
2026-03-27 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e5686f98-9775-5574-a7ea-3746bbe146a9
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f33fd0>
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5686f98-9775-5574-a7ea-3746bbe146a9/e5686f98-9775-5574-a7ea-3746bbe146a9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F95b7dd6f7dcc4921ab499d624b4a9ff9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/3.jpg saved to cache
2026-03-27 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e5686f98-9775-5574-a7ea-3746bbe146a9
2026-03-27 16:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fd8649863566f4d8ca67816fabe678f2b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/6.jpg not downloaded yet
2026-03-27 16:48:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6 with identifier: 1988303
2026-03-27 16:48:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:48:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6 with identifier: 1988303
2026-03-27 16:48:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6 with identifier: 1988303 to the API
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 103,
'color': 'BLANC PUR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'COROLLA TS',
'odometer': 84393,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6/2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285377,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6/2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285377,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6/2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283983,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6/2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273075,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6/2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309947,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6/2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239774,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6/2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431103,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6/2bb963b5-72b2-5ee4-be7f-3d97a4e7ebb6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343590,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/502cc61f34cb4b1e81afddb0be076d00/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-08',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA COROLLA TS Corolla Touring Spt 122h Dynamic Business + Stage '
'Hybrid Academy',
'transmission': 'automatic',
'trim': 'Corolla Touring Spt 122h Dynamic Business + Stage Hybrid Academy',
'vin': None,
'year': 2021}
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988303%27 HTTP/1.1" 200 None
2026-03-27 16:48:03 [ayvens.fr] INFO: Saving data for 1988303: {'created_time': 1774630083.713795, 'last_price_update_time': 1774630083.713807, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988303') HTTP/1.1" 204 0
2026-03-27 16:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fd8649863566f4d8ca67816fabe678f2b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/7.jpg not downloaded yet
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591050450>
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5686f98-9775-5574-a7ea-3746bbe146a9/e5686f98-9775-5574-a7ea-3746bbe146a9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F95b7dd6f7dcc4921ab499d624b4a9ff9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/6.jpg saved to cache
2026-03-27 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e5686f98-9775-5574-a7ea-3746bbe146a9
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d6ec50>
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5686f98-9775-5574-a7ea-3746bbe146a9/e5686f98-9775-5574-a7ea-3746bbe146a9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F95b7dd6f7dcc4921ab499d624b4a9ff9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/5.jpg saved to cache
2026-03-27 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e5686f98-9775-5574-a7ea-3746bbe146a9
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d51fd0>
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5686f98-9775-5574-a7ea-3746bbe146a9/e5686f98-9775-5574-a7ea-3746bbe146a9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F95b7dd6f7dcc4921ab499d624b4a9ff9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/8.jpg saved to cache
2026-03-27 16:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e5686f98-9775-5574-a7ea-3746bbe146a9
2026-03-27 16:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fd8649863566f4d8ca67816fabe678f2b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/8.jpg not downloaded yet
2026-03-27 16:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e08d50>
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5686f98-9775-5574-a7ea-3746bbe146a9/e5686f98-9775-5574-a7ea-3746bbe146a9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F95b7dd6f7dcc4921ab499d624b4a9ff9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/7.jpg saved to cache
2026-03-27 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e5686f98-9775-5574-a7ea-3746bbe146a9
2026-03-27 16:48:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5686f98-9775-5574-a7ea-3746bbe146a9, skipping ID generation
2026-03-27 16:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5686f98-9775-5574-a7ea-3746bbe146a9 with scrape type 1
2026-03-27 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5686f98-9775-5574-a7ea-3746bbe146a9 sending to next pipeline
2026-03-27 16:48:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e5686f98-9775-5574-a7ea-3746bbe146a9, identifier: 1988304
2026-03-27 16:48:04 [ayvens.fr] INFO: Found listing with ID: 1988306
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988306%27 HTTP/1.1" 200 None
2026-03-27 16:48:04 [ayvens.fr] INFO: Scrape type for 1988306: 1
2026-03-27 16:48:04 [ayvens.fr] INFO: Extracting data for car ID: 1988306
2026-03-27 16:48:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcdb5893-7127-5cb1-a554-272b7070d006 with identifier: 1988306
2026-03-27 16:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcdb5893-7127-5cb1-a554-272b7070d006 with scrape type 1
2026-03-27 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item bcdb5893-7127-5cb1-a554-272b7070d006
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df8e2ba18ea493f8f8ab3c93ccecc9c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/1.jpg not downloaded yet
2026-03-27 16:48:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e5686f98-9775-5574-a7ea-3746bbe146a9 with identifier: 1988304
2026-03-27 16:48:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:48:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e5686f98-9775-5574-a7ea-3746bbe146a9 with identifier: 1988304
2026-03-27 16:48:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e5686f98-9775-5574-a7ea-3746bbe146a9 with identifier: 1988304 to the API
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 48,
'color': 'GRIS TONNERRE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'e5686f98-9775-5574-a7ea-3746bbe146a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC40',
'odometer': 90775,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5686f98-9775-5574-a7ea-3746bbe146a9/e5686f98-9775-5574-a7ea-3746bbe146a9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347434,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5686f98-9775-5574-a7ea-3746bbe146a9/e5686f98-9775-5574-a7ea-3746bbe146a9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347434,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5686f98-9775-5574-a7ea-3746bbe146a9/e5686f98-9775-5574-a7ea-3746bbe146a9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414250,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5686f98-9775-5574-a7ea-3746bbe146a9/e5686f98-9775-5574-a7ea-3746bbe146a9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402506,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5686f98-9775-5574-a7ea-3746bbe146a9/e5686f98-9775-5574-a7ea-3746bbe146a9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384950,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5686f98-9775-5574-a7ea-3746bbe146a9/e5686f98-9775-5574-a7ea-3746bbe146a9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286974,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5686f98-9775-5574-a7ea-3746bbe146a9/e5686f98-9775-5574-a7ea-3746bbe146a9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268071,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5686f98-9775-5574-a7ea-3746bbe146a9/e5686f98-9775-5574-a7ea-3746bbe146a9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172940,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/95b7dd6f7dcc4921ab499d624b4a9ff9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-06',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC40 XC40 T4 Recharge 129 + 82ch R-Design DCT 7',
'transmission': 'automatic',
'trim': 'XC40 T4 Recharge 129 + 82ch R-Design DCT 7',
'vin': None,
'year': 2021}
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988304%27 HTTP/1.1" 200 None
2026-03-27 16:48:04 [ayvens.fr] INFO: Saving data for 1988304: {'created_time': 1774630084.590037, 'last_price_update_time': 1774630084.590049, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988304') HTTP/1.1" 204 0
2026-03-27 16:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df8e2ba18ea493f8f8ab3c93ccecc9c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/2.jpg not downloaded yet
2026-03-27 16:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d47510>
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d2172c1-4f65-58b0-a275-76b291e78f26/1d2172c1-4f65-58b0-a275-76b291e78f26_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fd8649863566f4d8ca67816fabe678f2b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/1.jpg saved to cache
2026-03-27 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d2172c1-4f65-58b0-a275-76b291e78f26
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee3850>
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d2172c1-4f65-58b0-a275-76b291e78f26/1d2172c1-4f65-58b0-a275-76b291e78f26_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fd8649863566f4d8ca67816fabe678f2b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/3.jpg saved to cache
2026-03-27 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d2172c1-4f65-58b0-a275-76b291e78f26
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d8e8d0>
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d2172c1-4f65-58b0-a275-76b291e78f26/1d2172c1-4f65-58b0-a275-76b291e78f26_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fd8649863566f4d8ca67816fabe678f2b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/2.jpg saved to cache
2026-03-27 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d2172c1-4f65-58b0-a275-76b291e78f26
2026-03-27 16:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df8e2ba18ea493f8f8ab3c93ccecc9c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/3.jpg not downloaded yet
2026-03-27 16:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df8e2ba18ea493f8f8ab3c93ccecc9c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/4.jpg not downloaded yet
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abc1d0>
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d2172c1-4f65-58b0-a275-76b291e78f26/1d2172c1-4f65-58b0-a275-76b291e78f26_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fd8649863566f4d8ca67816fabe678f2b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/4.jpg saved to cache
2026-03-27 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d2172c1-4f65-58b0-a275-76b291e78f26
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590512e10>
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d2172c1-4f65-58b0-a275-76b291e78f26/1d2172c1-4f65-58b0-a275-76b291e78f26_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fd8649863566f4d8ca67816fabe678f2b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/5.jpg saved to cache
2026-03-27 16:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d2172c1-4f65-58b0-a275-76b291e78f26
2026-03-27 16:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df8e2ba18ea493f8f8ab3c93ccecc9c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/5.jpg not downloaded yet
2026-03-27 16:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b43cd0>
2026-03-27 16:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d2172c1-4f65-58b0-a275-76b291e78f26/1d2172c1-4f65-58b0-a275-76b291e78f26_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fd8649863566f4d8ca67816fabe678f2b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/6.jpg saved to cache
2026-03-27 16:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d2172c1-4f65-58b0-a275-76b291e78f26
2026-03-27 16:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066aa90>
2026-03-27 16:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d2172c1-4f65-58b0-a275-76b291e78f26/1d2172c1-4f65-58b0-a275-76b291e78f26_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fd8649863566f4d8ca67816fabe678f2b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/7.jpg saved to cache
2026-03-27 16:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d2172c1-4f65-58b0-a275-76b291e78f26
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df8e2ba18ea493f8f8ab3c93ccecc9c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/6.jpg not downloaded yet
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df8e2ba18ea493f8f8ab3c93ccecc9c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/7.jpg not downloaded yet
2026-03-27 16:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59102d350>
2026-03-27 16:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d2172c1-4f65-58b0-a275-76b291e78f26/1d2172c1-4f65-58b0-a275-76b291e78f26_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fd8649863566f4d8ca67816fabe678f2b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/8.jpg saved to cache
2026-03-27 16:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d2172c1-4f65-58b0-a275-76b291e78f26
2026-03-27 16:48:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d2172c1-4f65-58b0-a275-76b291e78f26, skipping ID generation
2026-03-27 16:48:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d2172c1-4f65-58b0-a275-76b291e78f26 with scrape type 1
2026-03-27 16:48:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d2172c1-4f65-58b0-a275-76b291e78f26 sending to next pipeline
2026-03-27 16:48:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1d2172c1-4f65-58b0-a275-76b291e78f26, identifier: 1988305
2026-03-27 16:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1d2172c1-4f65-58b0-a275-76b291e78f26 with identifier: 1988305
2026-03-27 16:48:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1d2172c1-4f65-58b0-a275-76b291e78f26 with identifier: 1988305
2026-03-27 16:48:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1d2172c1-4f65-58b0-a275-76b291e78f26 with identifier: 1988305 to the API
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '1d2172c1-4f65-58b0-a275-76b291e78f26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'STONIC',
'odometer': 58820,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d2172c1-4f65-58b0-a275-76b291e78f26/1d2172c1-4f65-58b0-a275-76b291e78f26_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279739,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d2172c1-4f65-58b0-a275-76b291e78f26/1d2172c1-4f65-58b0-a275-76b291e78f26_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279739,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d2172c1-4f65-58b0-a275-76b291e78f26/1d2172c1-4f65-58b0-a275-76b291e78f26_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316657,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d2172c1-4f65-58b0-a275-76b291e78f26/1d2172c1-4f65-58b0-a275-76b291e78f26_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309386,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d2172c1-4f65-58b0-a275-76b291e78f26/1d2172c1-4f65-58b0-a275-76b291e78f26_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368130,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d2172c1-4f65-58b0-a275-76b291e78f26/1d2172c1-4f65-58b0-a275-76b291e78f26_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257461,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d2172c1-4f65-58b0-a275-76b291e78f26/1d2172c1-4f65-58b0-a275-76b291e78f26_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316994,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d2172c1-4f65-58b0-a275-76b291e78f26/1d2172c1-4f65-58b0-a275-76b291e78f26_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174868,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/d8649863566f4d8ca67816fabe678f2b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-25',
'seats_number': 5,
'seller_name': None,
'title': 'KIA STONIC Stonic 1.0 T-GDi 100ch Active Business',
'transmission': 'manual',
'trim': 'Stonic 1.0 T-GDi 100ch Active Business',
'vin': None,
'year': 2021}
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988305%27 HTTP/1.1" 200 None
2026-03-27 16:48:05 [ayvens.fr] INFO: Saving data for 1988305: {'created_time': 1774630085.902115, 'last_price_update_time': 1774630085.902127, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988305') HTTP/1.1" 204 0
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df8e2ba18ea493f8f8ab3c93ccecc9c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/8.jpg not downloaded yet
2026-03-27 16:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:05 [ayvens.fr] INFO: Found listing with ID: 1988307
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988307%27 HTTP/1.1" 200 None
2026-03-27 16:48:05 [ayvens.fr] INFO: Scrape type for 1988307: 1
2026-03-27 16:48:05 [ayvens.fr] INFO: Extracting data for car ID: 1988307
2026-03-27 16:48:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6cdab96-0713-5fd3-bc16-027edb4d3200 with identifier: 1988307
2026-03-27 16:48:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6cdab96-0713-5fd3-bc16-027edb4d3200 with scrape type 1
2026-03-27 16:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d6cdab96-0713-5fd3-bc16-027edb4d3200
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fdeb7791803dd4216acb37ca417446dd8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/1.jpg not downloaded yet
2026-03-27 16:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abe6d0>
2026-03-27 16:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcdb5893-7127-5cb1-a554-272b7070d006/bcdb5893-7127-5cb1-a554-272b7070d006_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df8e2ba18ea493f8f8ab3c93ccecc9c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/2.jpg saved to cache
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bcdb5893-7127-5cb1-a554-272b7070d006
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068ec90>
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcdb5893-7127-5cb1-a554-272b7070d006/bcdb5893-7127-5cb1-a554-272b7070d006_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df8e2ba18ea493f8f8ab3c93ccecc9c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/1.jpg saved to cache
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bcdb5893-7127-5cb1-a554-272b7070d006
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fdeb7791803dd4216acb37ca417446dd8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/2.jpg not downloaded yet
2026-03-27 16:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fdeb7791803dd4216acb37ca417446dd8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/3.jpg not downloaded yet
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfe0d0>
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcdb5893-7127-5cb1-a554-272b7070d006/bcdb5893-7127-5cb1-a554-272b7070d006_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df8e2ba18ea493f8f8ab3c93ccecc9c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/3.jpg saved to cache
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bcdb5893-7127-5cb1-a554-272b7070d006
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fdeb7791803dd4216acb37ca417446dd8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/4.jpg not downloaded yet
2026-03-27 16:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fdeb7791803dd4216acb37ca417446dd8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/5.jpg not downloaded yet
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590621e10>
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcdb5893-7127-5cb1-a554-272b7070d006/bcdb5893-7127-5cb1-a554-272b7070d006_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df8e2ba18ea493f8f8ab3c93ccecc9c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/5.jpg saved to cache
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bcdb5893-7127-5cb1-a554-272b7070d006
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591053710>
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcdb5893-7127-5cb1-a554-272b7070d006/bcdb5893-7127-5cb1-a554-272b7070d006_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df8e2ba18ea493f8f8ab3c93ccecc9c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/4.jpg saved to cache
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bcdb5893-7127-5cb1-a554-272b7070d006
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fdeb7791803dd4216acb37ca417446dd8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/6.jpg not downloaded yet
2026-03-27 16:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fdeb7791803dd4216acb37ca417446dd8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/7.jpg not downloaded yet
2026-03-27 16:48:06 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at 4 pages/min), scraped 108 items (at 35 items/min)
2026-03-27 16:48:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d32d0>
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcdb5893-7127-5cb1-a554-272b7070d006/bcdb5893-7127-5cb1-a554-272b7070d006_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df8e2ba18ea493f8f8ab3c93ccecc9c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/6.jpg saved to cache
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bcdb5893-7127-5cb1-a554-272b7070d006
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee2ed0>
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcdb5893-7127-5cb1-a554-272b7070d006/bcdb5893-7127-5cb1-a554-272b7070d006_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df8e2ba18ea493f8f8ab3c93ccecc9c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/7.jpg saved to cache
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bcdb5893-7127-5cb1-a554-272b7070d006
2026-03-27 16:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fdeb7791803dd4216acb37ca417446dd8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/8.jpg not downloaded yet
2026-03-27 16:48:06 [ayvens.fr] INFO: Found listing with ID: 1988308
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988308%27 HTTP/1.1" 200 None
2026-03-27 16:48:06 [ayvens.fr] INFO: Scrape type for 1988308: 1
2026-03-27 16:48:06 [ayvens.fr] INFO: Extracting data for car ID: 1988308
2026-03-27 16:48:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe89fb92-93e4-513d-9b1e-e79c761cb6a8 with identifier: 1988308
2026-03-27 16:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe89fb92-93e4-513d-9b1e-e79c761cb6a8 with scrape type 1
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item fe89fb92-93e4-513d-9b1e-e79c761cb6a8
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F9e774867692f4b30ba136ab7ca651fbe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/1.jpg not downloaded yet
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0a590>
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcdb5893-7127-5cb1-a554-272b7070d006/bcdb5893-7127-5cb1-a554-272b7070d006_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F2df8e2ba18ea493f8f8ab3c93ccecc9c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/8.jpg saved to cache
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bcdb5893-7127-5cb1-a554-272b7070d006
2026-03-27 16:48:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bcdb5893-7127-5cb1-a554-272b7070d006, skipping ID generation
2026-03-27 16:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcdb5893-7127-5cb1-a554-272b7070d006 with scrape type 1
2026-03-27 16:48:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bcdb5893-7127-5cb1-a554-272b7070d006 sending to next pipeline
2026-03-27 16:48:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: bcdb5893-7127-5cb1-a554-272b7070d006, identifier: 1988306
2026-03-27 16:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: bcdb5893-7127-5cb1-a554-272b7070d006 with identifier: 1988306
2026-03-27 16:48:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: bcdb5893-7127-5cb1-a554-272b7070d006 with identifier: 1988306
2026-03-27 16:48:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: bcdb5893-7127-5cb1-a554-272b7070d006 with identifier: 1988306 to the API
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 32,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'bcdb5893-7127-5cb1-a554-272b7070d006',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 5',
'odometer': 116256,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcdb5893-7127-5cb1-a554-272b7070d006/bcdb5893-7127-5cb1-a554-272b7070d006_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378085,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcdb5893-7127-5cb1-a554-272b7070d006/bcdb5893-7127-5cb1-a554-272b7070d006_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378085,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcdb5893-7127-5cb1-a554-272b7070d006/bcdb5893-7127-5cb1-a554-272b7070d006_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389145,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcdb5893-7127-5cb1-a554-272b7070d006/bcdb5893-7127-5cb1-a554-272b7070d006_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385670,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcdb5893-7127-5cb1-a554-272b7070d006/bcdb5893-7127-5cb1-a554-272b7070d006_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377625,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcdb5893-7127-5cb1-a554-272b7070d006/bcdb5893-7127-5cb1-a554-272b7070d006_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369133,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcdb5893-7127-5cb1-a554-272b7070d006/bcdb5893-7127-5cb1-a554-272b7070d006_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323232,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcdb5893-7127-5cb1-a554-272b7070d006/bcdb5893-7127-5cb1-a554-272b7070d006_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304470,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/2df8e2ba18ea493f8f8ab3c93ccecc9c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-04',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 5 Série 5 520eA 204ch Luxury Steptronic',
'transmission': 'automatic',
'trim': 'Série 5 520eA 204ch Luxury Steptronic',
'vin': None,
'year': 2022}
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988306%27 HTTP/1.1" 200 None
2026-03-27 16:48:07 [ayvens.fr] INFO: Saving data for 1988306: {'created_time': 1774630087.381314, 'last_price_update_time': 1774630087.381327, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988306') HTTP/1.1" 204 0
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F9e774867692f4b30ba136ab7ca651fbe%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/2.jpg not downloaded yet
2026-03-27 16:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9d350>
2026-03-27 16:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cdab96-0713-5fd3-bc16-027edb4d3200/d6cdab96-0713-5fd3-bc16-027edb4d3200_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fdeb7791803dd4216acb37ca417446dd8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/1.jpg saved to cache
2026-03-27 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6cdab96-0713-5fd3-bc16-027edb4d3200
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F9e774867692f4b30ba136ab7ca651fbe%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/3.jpg not downloaded yet
2026-03-27 16:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d47750>
2026-03-27 16:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cdab96-0713-5fd3-bc16-027edb4d3200/d6cdab96-0713-5fd3-bc16-027edb4d3200_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fdeb7791803dd4216acb37ca417446dd8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/2.jpg saved to cache
2026-03-27 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6cdab96-0713-5fd3-bc16-027edb4d3200
2026-03-27 16:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066f510>
2026-03-27 16:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cdab96-0713-5fd3-bc16-027edb4d3200/d6cdab96-0713-5fd3-bc16-027edb4d3200_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fdeb7791803dd4216acb37ca417446dd8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/3.jpg saved to cache
2026-03-27 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6cdab96-0713-5fd3-bc16-027edb4d3200
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F9e774867692f4b30ba136ab7ca651fbe%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/4.jpg not downloaded yet
2026-03-27 16:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F9e774867692f4b30ba136ab7ca651fbe%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/5.jpg not downloaded yet
2026-03-27 16:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b59c10>
2026-03-27 16:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cdab96-0713-5fd3-bc16-027edb4d3200/d6cdab96-0713-5fd3-bc16-027edb4d3200_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fdeb7791803dd4216acb37ca417446dd8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/4.jpg saved to cache
2026-03-27 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6cdab96-0713-5fd3-bc16-027edb4d3200
2026-03-27 16:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4d3d0>
2026-03-27 16:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cdab96-0713-5fd3-bc16-027edb4d3200/d6cdab96-0713-5fd3-bc16-027edb4d3200_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fdeb7791803dd4216acb37ca417446dd8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/5.jpg saved to cache
2026-03-27 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6cdab96-0713-5fd3-bc16-027edb4d3200
2026-03-27 16:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590513150>
2026-03-27 16:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cdab96-0713-5fd3-bc16-027edb4d3200/d6cdab96-0713-5fd3-bc16-027edb4d3200_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fdeb7791803dd4216acb37ca417446dd8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/7.jpg saved to cache
2026-03-27 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6cdab96-0713-5fd3-bc16-027edb4d3200
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F9e774867692f4b30ba136ab7ca651fbe%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/6.jpg not downloaded yet
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F9e774867692f4b30ba136ab7ca651fbe%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/7.jpg not downloaded yet
2026-03-27 16:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59102c8d0>
2026-03-27 16:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cdab96-0713-5fd3-bc16-027edb4d3200/d6cdab96-0713-5fd3-bc16-027edb4d3200_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fdeb7791803dd4216acb37ca417446dd8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/6.jpg saved to cache
2026-03-27 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6cdab96-0713-5fd3-bc16-027edb4d3200
2026-03-27 16:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d76ed0>
2026-03-27 16:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6cdab96-0713-5fd3-bc16-027edb4d3200/d6cdab96-0713-5fd3-bc16-027edb4d3200_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252Fdeb7791803dd4216acb37ca417446dd8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/8.jpg saved to cache
2026-03-27 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6cdab96-0713-5fd3-bc16-027edb4d3200
2026-03-27 16:48:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6cdab96-0713-5fd3-bc16-027edb4d3200, skipping ID generation
2026-03-27 16:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6cdab96-0713-5fd3-bc16-027edb4d3200 with scrape type 1
2026-03-27 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6cdab96-0713-5fd3-bc16-027edb4d3200 sending to next pipeline
2026-03-27 16:48:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d6cdab96-0713-5fd3-bc16-027edb4d3200, identifier: 1988307
2026-03-27 16:48:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d6cdab96-0713-5fd3-bc16-027edb4d3200 with identifier: 1988307
2026-03-27 16:48:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d6cdab96-0713-5fd3-bc16-027edb4d3200 with identifier: 1988307
2026-03-27 16:48:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d6cdab96-0713-5fd3-bc16-027edb4d3200 with identifier: 1988307 to the API
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'd6cdab96-0713-5fd3-bc16-027edb4d3200',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'DS AUTOMOBILES',
'model': 'DS4',
'odometer': 57192,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cdab96-0713-5fd3-bc16-027edb4d3200/d6cdab96-0713-5fd3-bc16-027edb4d3200_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408109,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cdab96-0713-5fd3-bc16-027edb4d3200/d6cdab96-0713-5fd3-bc16-027edb4d3200_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408109,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cdab96-0713-5fd3-bc16-027edb4d3200/d6cdab96-0713-5fd3-bc16-027edb4d3200_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321555,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cdab96-0713-5fd3-bc16-027edb4d3200/d6cdab96-0713-5fd3-bc16-027edb4d3200_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303755,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cdab96-0713-5fd3-bc16-027edb4d3200/d6cdab96-0713-5fd3-bc16-027edb4d3200_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305101,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cdab96-0713-5fd3-bc16-027edb4d3200/d6cdab96-0713-5fd3-bc16-027edb4d3200_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347113,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cdab96-0713-5fd3-bc16-027edb4d3200/d6cdab96-0713-5fd3-bc16-027edb4d3200_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256991,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6cdab96-0713-5fd3-bc16-027edb4d3200/d6cdab96-0713-5fd3-bc16-027edb4d3200_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358542,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/deb7791803dd4216acb37ca417446dd8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'DS AUTOMOBILES DS4 DS 4 PureTech 130ch Performance Line Automatique',
'transmission': 'automatic',
'trim': 'DS 4 PureTech 130ch Performance Line Automatique',
'vin': None,
'year': 2024}
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988307%27 HTTP/1.1" 200 None
2026-03-27 16:48:08 [ayvens.fr] INFO: Saving data for 1988307: {'created_time': 1774630088.9624, 'last_price_update_time': 1774630088.96241, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988307') HTTP/1.1" 204 0
2026-03-27 16:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F9e774867692f4b30ba136ab7ca651fbe%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/8.jpg not downloaded yet
2026-03-27 16:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:08 [ayvens.fr] INFO: Found listing with ID: 1988309
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988309%27 HTTP/1.1" 200 None
2026-03-27 16:48:09 [ayvens.fr] INFO: Scrape type for 1988309: 1
2026-03-27 16:48:09 [ayvens.fr] INFO: Extracting data for car ID: 1988309
2026-03-27 16:48:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed3b2ccb-4ae2-5b6b-8238-b8946452d624 with identifier: 1988309
2026-03-27 16:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed3b2ccb-4ae2-5b6b-8238-b8946452d624 with scrape type 1
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ed3b2ccb-4ae2-5b6b-8238-b8946452d624
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F76728813157845ef8f5316348bacf590%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/1.jpg not downloaded yet
2026-03-27 16:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F76728813157845ef8f5316348bacf590%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/2.jpg not downloaded yet
2026-03-27 16:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F76728813157845ef8f5316348bacf590%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/3.jpg not downloaded yet
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F76728813157845ef8f5316348bacf590%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/4.jpg not downloaded yet
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590621a50>
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe89fb92-93e4-513d-9b1e-e79c761cb6a8/fe89fb92-93e4-513d-9b1e-e79c761cb6a8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F9e774867692f4b30ba136ab7ca651fbe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/1.jpg saved to cache
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe89fb92-93e4-513d-9b1e-e79c761cb6a8
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F76728813157845ef8f5316348bacf590%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/5.jpg not downloaded yet
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066a4d0>
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe89fb92-93e4-513d-9b1e-e79c761cb6a8/fe89fb92-93e4-513d-9b1e-e79c761cb6a8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F9e774867692f4b30ba136ab7ca651fbe%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/3.jpg saved to cache
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe89fb92-93e4-513d-9b1e-e79c761cb6a8
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa03d0>
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe89fb92-93e4-513d-9b1e-e79c761cb6a8/fe89fb92-93e4-513d-9b1e-e79c761cb6a8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F9e774867692f4b30ba136ab7ca651fbe%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/2.jpg saved to cache
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe89fb92-93e4-513d-9b1e-e79c761cb6a8
2026-03-27 16:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F76728813157845ef8f5316348bacf590%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/6.jpg not downloaded yet
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b51010>
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe89fb92-93e4-513d-9b1e-e79c761cb6a8/fe89fb92-93e4-513d-9b1e-e79c761cb6a8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F9e774867692f4b30ba136ab7ca651fbe%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/4.jpg saved to cache
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe89fb92-93e4-513d-9b1e-e79c761cb6a8
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b37f90>
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe89fb92-93e4-513d-9b1e-e79c761cb6a8/fe89fb92-93e4-513d-9b1e-e79c761cb6a8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F9e774867692f4b30ba136ab7ca651fbe%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/5.jpg saved to cache
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe89fb92-93e4-513d-9b1e-e79c761cb6a8
2026-03-27 16:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F76728813157845ef8f5316348bacf590%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/7.jpg not downloaded yet
2026-03-27 16:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6f550>
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe89fb92-93e4-513d-9b1e-e79c761cb6a8/fe89fb92-93e4-513d-9b1e-e79c761cb6a8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F9e774867692f4b30ba136ab7ca651fbe%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/6.jpg saved to cache
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fe89fb92-93e4-513d-9b1e-e79c761cb6a8
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F76728813157845ef8f5316348bacf590%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/8.jpg not downloaded yet
2026-03-27 16:48:09 [ayvens.fr] INFO: Found listing with ID: 1988310
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988310%27 HTTP/1.1" 200 None
2026-03-27 16:48:09 [ayvens.fr] INFO: Scrape type for 1988310: 1
2026-03-27 16:48:09 [ayvens.fr] INFO: Extracting data for car ID: 1988310
2026-03-27 16:48:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9a4862e-064e-5c60-8a6c-700dda735787 with identifier: 1988310
2026-03-27 16:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9a4862e-064e-5c60-8a6c-700dda735787 with scrape type 1
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c9a4862e-064e-5c60-8a6c-700dda735787
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F398998ca43ca443ab08cbca26246cc63%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/1.jpg not downloaded yet
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df7510>
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe89fb92-93e4-513d-9b1e-e79c761cb6a8/fe89fb92-93e4-513d-9b1e-e79c761cb6a8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F9e774867692f4b30ba136ab7ca651fbe%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/8.jpg saved to cache
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fe89fb92-93e4-513d-9b1e-e79c761cb6a8
2026-03-27 16:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F398998ca43ca443ab08cbca26246cc63%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/2.jpg not downloaded yet
2026-03-27 16:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066d610>
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe89fb92-93e4-513d-9b1e-e79c761cb6a8/fe89fb92-93e4-513d-9b1e-e79c761cb6a8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F9e774867692f4b30ba136ab7ca651fbe%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/7.jpg saved to cache
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fe89fb92-93e4-513d-9b1e-e79c761cb6a8
2026-03-27 16:48:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe89fb92-93e4-513d-9b1e-e79c761cb6a8, skipping ID generation
2026-03-27 16:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe89fb92-93e4-513d-9b1e-e79c761cb6a8 with scrape type 1
2026-03-27 16:48:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe89fb92-93e4-513d-9b1e-e79c761cb6a8 sending to next pipeline
2026-03-27 16:48:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: fe89fb92-93e4-513d-9b1e-e79c761cb6a8, identifier: 1988308
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F398998ca43ca443ab08cbca26246cc63%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/3.jpg not downloaded yet
2026-03-27 16:48:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: fe89fb92-93e4-513d-9b1e-e79c761cb6a8 with identifier: 1988308
2026-03-27 16:48:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: fe89fb92-93e4-513d-9b1e-e79c761cb6a8 with identifier: 1988308
2026-03-27 16:48:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: fe89fb92-93e4-513d-9b1e-e79c761cb6a8 with identifier: 1988308 to the API
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'fe89fb92-93e4-513d-9b1e-e79c761cb6a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 68913,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe89fb92-93e4-513d-9b1e-e79c761cb6a8/fe89fb92-93e4-513d-9b1e-e79c761cb6a8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376518,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe89fb92-93e4-513d-9b1e-e79c761cb6a8/fe89fb92-93e4-513d-9b1e-e79c761cb6a8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376518,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe89fb92-93e4-513d-9b1e-e79c761cb6a8/fe89fb92-93e4-513d-9b1e-e79c761cb6a8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322259,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe89fb92-93e4-513d-9b1e-e79c761cb6a8/fe89fb92-93e4-513d-9b1e-e79c761cb6a8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299022,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe89fb92-93e4-513d-9b1e-e79c761cb6a8/fe89fb92-93e4-513d-9b1e-e79c761cb6a8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346583,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe89fb92-93e4-513d-9b1e-e79c761cb6a8/fe89fb92-93e4-513d-9b1e-e79c761cb6a8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342237,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe89fb92-93e4-513d-9b1e-e79c761cb6a8/fe89fb92-93e4-513d-9b1e-e79c761cb6a8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316709,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe89fb92-93e4-513d-9b1e-e79c761cb6a8/fe89fb92-93e4-513d-9b1e-e79c761cb6a8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293121,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/9e774867692f4b30ba136ab7ca651fbe/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-09-17',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 210ch HEV GT-line Premium BVA6',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 210ch HEV GT-line Premium BVA6',
'vin': None,
'year': 2024}
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988308%27 HTTP/1.1" 200 None
2026-03-27 16:48:10 [ayvens.fr] INFO: Saving data for 1988308: {'created_time': 1774630090.458123, 'last_price_update_time': 1774630090.458137, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988308') HTTP/1.1" 204 0
2026-03-27 16:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F398998ca43ca443ab08cbca26246cc63%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/4.jpg not downloaded yet
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592f04950>
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed3b2ccb-4ae2-5b6b-8238-b8946452d624/ed3b2ccb-4ae2-5b6b-8238-b8946452d624_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F76728813157845ef8f5316348bacf590%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/1.jpg saved to cache
2026-03-27 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed3b2ccb-4ae2-5b6b-8238-b8946452d624
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b34090>
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed3b2ccb-4ae2-5b6b-8238-b8946452d624/ed3b2ccb-4ae2-5b6b-8238-b8946452d624_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F76728813157845ef8f5316348bacf590%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/2.jpg saved to cache
2026-03-27 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed3b2ccb-4ae2-5b6b-8238-b8946452d624
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d6dcd0>
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed3b2ccb-4ae2-5b6b-8238-b8946452d624/ed3b2ccb-4ae2-5b6b-8238-b8946452d624_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F76728813157845ef8f5316348bacf590%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/4.jpg saved to cache
2026-03-27 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed3b2ccb-4ae2-5b6b-8238-b8946452d624
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590510f50>
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed3b2ccb-4ae2-5b6b-8238-b8946452d624/ed3b2ccb-4ae2-5b6b-8238-b8946452d624_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F76728813157845ef8f5316348bacf590%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/3.jpg saved to cache
2026-03-27 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed3b2ccb-4ae2-5b6b-8238-b8946452d624
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F398998ca43ca443ab08cbca26246cc63%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/5.jpg not downloaded yet
2026-03-27 16:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F398998ca43ca443ab08cbca26246cc63%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/6.jpg not downloaded yet
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa3490>
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed3b2ccb-4ae2-5b6b-8238-b8946452d624/ed3b2ccb-4ae2-5b6b-8238-b8946452d624_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F76728813157845ef8f5316348bacf590%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/5.jpg saved to cache
2026-03-27 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed3b2ccb-4ae2-5b6b-8238-b8946452d624
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b5a110>
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed3b2ccb-4ae2-5b6b-8238-b8946452d624/ed3b2ccb-4ae2-5b6b-8238-b8946452d624_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F76728813157845ef8f5316348bacf590%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/6.jpg saved to cache
2026-03-27 16:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed3b2ccb-4ae2-5b6b-8238-b8946452d624
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2f6d0>
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed3b2ccb-4ae2-5b6b-8238-b8946452d624/ed3b2ccb-4ae2-5b6b-8238-b8946452d624_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F76728813157845ef8f5316348bacf590%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/7.jpg saved to cache
2026-03-27 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed3b2ccb-4ae2-5b6b-8238-b8946452d624
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F398998ca43ca443ab08cbca26246cc63%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/7.jpg not downloaded yet
2026-03-27 16:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903cec90>
2026-03-27 16:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed3b2ccb-4ae2-5b6b-8238-b8946452d624/ed3b2ccb-4ae2-5b6b-8238-b8946452d624_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F76728813157845ef8f5316348bacf590%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/8.jpg saved to cache
2026-03-27 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed3b2ccb-4ae2-5b6b-8238-b8946452d624
2026-03-27 16:48:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed3b2ccb-4ae2-5b6b-8238-b8946452d624, skipping ID generation
2026-03-27 16:48:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed3b2ccb-4ae2-5b6b-8238-b8946452d624 with scrape type 1
2026-03-27 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed3b2ccb-4ae2-5b6b-8238-b8946452d624 sending to next pipeline
2026-03-27 16:48:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ed3b2ccb-4ae2-5b6b-8238-b8946452d624, identifier: 1988309
2026-03-27 16:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F398998ca43ca443ab08cbca26246cc63%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/8.jpg not downloaded yet
2026-03-27 16:48:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ed3b2ccb-4ae2-5b6b-8238-b8946452d624 with identifier: 1988309
2026-03-27 16:48:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:48:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ed3b2ccb-4ae2-5b6b-8238-b8946452d624 with identifier: 1988309
2026-03-27 16:48:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ed3b2ccb-4ae2-5b6b-8238-b8946452d624 with identifier: 1988309 to the API
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 84,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'ed3b2ccb-4ae2-5b6b-8238-b8946452d624',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS HYBRID',
'odometer': 60912,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed3b2ccb-4ae2-5b6b-8238-b8946452d624/ed3b2ccb-4ae2-5b6b-8238-b8946452d624_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485253,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed3b2ccb-4ae2-5b6b-8238-b8946452d624/ed3b2ccb-4ae2-5b6b-8238-b8946452d624_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485253,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed3b2ccb-4ae2-5b6b-8238-b8946452d624/ed3b2ccb-4ae2-5b6b-8238-b8946452d624_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 499496,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed3b2ccb-4ae2-5b6b-8238-b8946452d624/ed3b2ccb-4ae2-5b6b-8238-b8946452d624_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 452984,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed3b2ccb-4ae2-5b6b-8238-b8946452d624/ed3b2ccb-4ae2-5b6b-8238-b8946452d624_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333543,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed3b2ccb-4ae2-5b6b-8238-b8946452d624/ed3b2ccb-4ae2-5b6b-8238-b8946452d624_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314808,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed3b2ccb-4ae2-5b6b-8238-b8946452d624/ed3b2ccb-4ae2-5b6b-8238-b8946452d624_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317372,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed3b2ccb-4ae2-5b6b-8238-b8946452d624/ed3b2ccb-4ae2-5b6b-8238-b8946452d624_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339700,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/76728813157845ef8f5316348bacf590/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-05',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA YARIS HYBRID Yaris 100h France 5p',
'transmission': 'automatic',
'trim': 'Yaris 100h France 5p',
'vin': None,
'year': 2019}
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988309%27 HTTP/1.1" 200 None
2026-03-27 16:48:11 [ayvens.fr] INFO: Saving data for 1988309: {'created_time': 1774630091.692034, 'last_price_update_time': 1774630091.692045, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988309') HTTP/1.1" 204 0
2026-03-27 16:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:11 [ayvens.fr] INFO: Found listing with ID: 1988311
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988311%27 HTTP/1.1" 200 None
2026-03-27 16:48:11 [ayvens.fr] INFO: Scrape type for 1988311: 1
2026-03-27 16:48:11 [ayvens.fr] INFO: Extracting data for car ID: 1988311
2026-03-27 16:48:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efdbca4a-5896-59dc-ae03-0d6b8349e1b3 with identifier: 1988311
2026-03-27 16:48:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efdbca4a-5896-59dc-ae03-0d6b8349e1b3 with scrape type 1
2026-03-27 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item efdbca4a-5896-59dc-ae03-0d6b8349e1b3
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F6db3bcdfdf6645769f3ca4de3dedd2d2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/1.jpg not downloaded yet
2026-03-27 16:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903cc690>
2026-03-27 16:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9a4862e-064e-5c60-8a6c-700dda735787/c9a4862e-064e-5c60-8a6c-700dda735787_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F398998ca43ca443ab08cbca26246cc63%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/1.jpg saved to cache
2026-03-27 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9a4862e-064e-5c60-8a6c-700dda735787
2026-03-27 16:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050e290>
2026-03-27 16:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9a4862e-064e-5c60-8a6c-700dda735787/c9a4862e-064e-5c60-8a6c-700dda735787_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F398998ca43ca443ab08cbca26246cc63%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/2.jpg saved to cache
2026-03-27 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9a4862e-064e-5c60-8a6c-700dda735787
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F6db3bcdfdf6645769f3ca4de3dedd2d2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/2.jpg not downloaded yet
2026-03-27 16:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F6db3bcdfdf6645769f3ca4de3dedd2d2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/3.jpg not downloaded yet
2026-03-27 16:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d77110>
2026-03-27 16:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9a4862e-064e-5c60-8a6c-700dda735787/c9a4862e-064e-5c60-8a6c-700dda735787_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F398998ca43ca443ab08cbca26246cc63%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/3.jpg saved to cache
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9a4862e-064e-5c60-8a6c-700dda735787
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd0810>
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9a4862e-064e-5c60-8a6c-700dda735787/c9a4862e-064e-5c60-8a6c-700dda735787_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F398998ca43ca443ab08cbca26246cc63%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/4.jpg saved to cache
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9a4862e-064e-5c60-8a6c-700dda735787
2026-03-27 16:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F6db3bcdfdf6645769f3ca4de3dedd2d2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/4.jpg not downloaded yet
2026-03-27 16:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F6db3bcdfdf6645769f3ca4de3dedd2d2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/5.jpg not downloaded yet
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c0d50>
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9a4862e-064e-5c60-8a6c-700dda735787/c9a4862e-064e-5c60-8a6c-700dda735787_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F398998ca43ca443ab08cbca26246cc63%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/5.jpg saved to cache
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9a4862e-064e-5c60-8a6c-700dda735787
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F6db3bcdfdf6645769f3ca4de3dedd2d2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/6.jpg not downloaded yet
2026-03-27 16:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F6db3bcdfdf6645769f3ca4de3dedd2d2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/7.jpg not downloaded yet
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e8dbd0>
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9a4862e-064e-5c60-8a6c-700dda735787/c9a4862e-064e-5c60-8a6c-700dda735787_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F398998ca43ca443ab08cbca26246cc63%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/7.jpg saved to cache
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9a4862e-064e-5c60-8a6c-700dda735787
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59102e190>
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9a4862e-064e-5c60-8a6c-700dda735787/c9a4862e-064e-5c60-8a6c-700dda735787_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F398998ca43ca443ab08cbca26246cc63%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/6.jpg saved to cache
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9a4862e-064e-5c60-8a6c-700dda735787
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F6db3bcdfdf6645769f3ca4de3dedd2d2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/8.jpg not downloaded yet
2026-03-27 16:48:12 [ayvens.fr] INFO: Found listing with ID: 1988312
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988312%27 HTTP/1.1" 200 None
2026-03-27 16:48:12 [ayvens.fr] INFO: Scrape type for 1988312: 1
2026-03-27 16:48:12 [ayvens.fr] INFO: Extracting data for car ID: 1988312
2026-03-27 16:48:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98ccb980-5899-5db6-9f0a-4f2bcf5d6b39 with identifier: 1988312
2026-03-27 16:48:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98ccb980-5899-5db6-9f0a-4f2bcf5d6b39 with scrape type 1
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98ccb980-5899-5db6-9f0a-4f2bcf5d6b39
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fbbd7f3ec6525419aa48bf9b98d4e3e43%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/1.jpg not downloaded yet
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590668410>
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9a4862e-064e-5c60-8a6c-700dda735787/c9a4862e-064e-5c60-8a6c-700dda735787_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F398998ca43ca443ab08cbca26246cc63%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/8.jpg saved to cache
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9a4862e-064e-5c60-8a6c-700dda735787
2026-03-27 16:48:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9a4862e-064e-5c60-8a6c-700dda735787, skipping ID generation
2026-03-27 16:48:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9a4862e-064e-5c60-8a6c-700dda735787 with scrape type 1
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9a4862e-064e-5c60-8a6c-700dda735787 sending to next pipeline
2026-03-27 16:48:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c9a4862e-064e-5c60-8a6c-700dda735787, identifier: 1988310
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d76b10>
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efdbca4a-5896-59dc-ae03-0d6b8349e1b3/efdbca4a-5896-59dc-ae03-0d6b8349e1b3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F6db3bcdfdf6645769f3ca4de3dedd2d2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/1.jpg saved to cache
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efdbca4a-5896-59dc-ae03-0d6b8349e1b3
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fbbd7f3ec6525419aa48bf9b98d4e3e43%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/2.jpg not downloaded yet
2026-03-27 16:48:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c9a4862e-064e-5c60-8a6c-700dda735787 with identifier: 1988310
2026-03-27 16:48:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c9a4862e-064e-5c60-8a6c-700dda735787 with identifier: 1988310
2026-03-27 16:48:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c9a4862e-064e-5c60-8a6c-700dda735787 with identifier: 1988310 to the API
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 145,
'color': 'BLANC NACR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'c9a4862e-064e-5c60-8a6c-700dda735787',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 80258,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9a4862e-064e-5c60-8a6c-700dda735787/c9a4862e-064e-5c60-8a6c-700dda735787_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346963,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9a4862e-064e-5c60-8a6c-700dda735787/c9a4862e-064e-5c60-8a6c-700dda735787_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346963,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9a4862e-064e-5c60-8a6c-700dda735787/c9a4862e-064e-5c60-8a6c-700dda735787_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307721,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9a4862e-064e-5c60-8a6c-700dda735787/c9a4862e-064e-5c60-8a6c-700dda735787_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337028,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9a4862e-064e-5c60-8a6c-700dda735787/c9a4862e-064e-5c60-8a6c-700dda735787_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309301,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9a4862e-064e-5c60-8a6c-700dda735787/c9a4862e-064e-5c60-8a6c-700dda735787_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318666,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9a4862e-064e-5c60-8a6c-700dda735787/c9a4862e-064e-5c60-8a6c-700dda735787_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238158,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9a4862e-064e-5c60-8a6c-700dda735787/c9a4862e-064e-5c60-8a6c-700dda735787_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276379,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/398998ca43ca443ab08cbca26246cc63/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '3008 1.2 PureTech 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988310%27 HTTP/1.1" 200 None
2026-03-27 16:48:13 [ayvens.fr] INFO: Saving data for 1988310: {'created_time': 1774630093.099477, 'last_price_update_time': 1774630093.099487, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988310') HTTP/1.1" 204 0
2026-03-27 16:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fbbd7f3ec6525419aa48bf9b98d4e3e43%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/3.jpg not downloaded yet
2026-03-27 16:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fbbd7f3ec6525419aa48bf9b98d4e3e43%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/4.jpg not downloaded yet
2026-03-27 16:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fbbd7f3ec6525419aa48bf9b98d4e3e43%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/5.jpg not downloaded yet
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fbbd7f3ec6525419aa48bf9b98d4e3e43%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/6.jpg not downloaded yet
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fbbd7f3ec6525419aa48bf9b98d4e3e43%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/7.jpg not downloaded yet
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fbbd7f3ec6525419aa48bf9b98d4e3e43%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/8.jpg not downloaded yet
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4d550>
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efdbca4a-5896-59dc-ae03-0d6b8349e1b3/efdbca4a-5896-59dc-ae03-0d6b8349e1b3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F6db3bcdfdf6645769f3ca4de3dedd2d2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/3.jpg saved to cache
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item efdbca4a-5896-59dc-ae03-0d6b8349e1b3
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fbbd7f3ec6525419aa48bf9b98d4e3e43%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/9.jpg not downloaded yet
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c3990>
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efdbca4a-5896-59dc-ae03-0d6b8349e1b3/efdbca4a-5896-59dc-ae03-0d6b8349e1b3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F6db3bcdfdf6645769f3ca4de3dedd2d2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/2.jpg saved to cache
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item efdbca4a-5896-59dc-ae03-0d6b8349e1b3
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d43910>
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efdbca4a-5896-59dc-ae03-0d6b8349e1b3/efdbca4a-5896-59dc-ae03-0d6b8349e1b3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F6db3bcdfdf6645769f3ca4de3dedd2d2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/4.jpg saved to cache
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item efdbca4a-5896-59dc-ae03-0d6b8349e1b3
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fbbd7f3ec6525419aa48bf9b98d4e3e43%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/10.jpg not downloaded yet
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b0590>
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efdbca4a-5896-59dc-ae03-0d6b8349e1b3/efdbca4a-5896-59dc-ae03-0d6b8349e1b3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F6db3bcdfdf6645769f3ca4de3dedd2d2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/5.jpg saved to cache
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item efdbca4a-5896-59dc-ae03-0d6b8349e1b3
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c84d0>
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efdbca4a-5896-59dc-ae03-0d6b8349e1b3/efdbca4a-5896-59dc-ae03-0d6b8349e1b3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F6db3bcdfdf6645769f3ca4de3dedd2d2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/6.jpg saved to cache
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item efdbca4a-5896-59dc-ae03-0d6b8349e1b3
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051e650>
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efdbca4a-5896-59dc-ae03-0d6b8349e1b3/efdbca4a-5896-59dc-ae03-0d6b8349e1b3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F6db3bcdfdf6645769f3ca4de3dedd2d2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/7.jpg saved to cache
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item efdbca4a-5896-59dc-ae03-0d6b8349e1b3
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904ca390>
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efdbca4a-5896-59dc-ae03-0d6b8349e1b3/efdbca4a-5896-59dc-ae03-0d6b8349e1b3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F6db3bcdfdf6645769f3ca4de3dedd2d2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/8.jpg saved to cache
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item efdbca4a-5896-59dc-ae03-0d6b8349e1b3
2026-03-27 16:48:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efdbca4a-5896-59dc-ae03-0d6b8349e1b3, skipping ID generation
2026-03-27 16:48:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efdbca4a-5896-59dc-ae03-0d6b8349e1b3 with scrape type 1
2026-03-27 16:48:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efdbca4a-5896-59dc-ae03-0d6b8349e1b3 sending to next pipeline
2026-03-27 16:48:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: efdbca4a-5896-59dc-ae03-0d6b8349e1b3, identifier: 1988311
2026-03-27 16:48:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: efdbca4a-5896-59dc-ae03-0d6b8349e1b3 with identifier: 1988311
2026-03-27 16:48:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: efdbca4a-5896-59dc-ae03-0d6b8349e1b3 with identifier: 1988311
2026-03-27 16:48:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: efdbca4a-5896-59dc-ae03-0d6b8349e1b3 with identifier: 1988311 to the API
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'efdbca4a-5896-59dc-ae03-0d6b8349e1b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308',
'odometer': 75857,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efdbca4a-5896-59dc-ae03-0d6b8349e1b3/efdbca4a-5896-59dc-ae03-0d6b8349e1b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313379,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efdbca4a-5896-59dc-ae03-0d6b8349e1b3/efdbca4a-5896-59dc-ae03-0d6b8349e1b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313379,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efdbca4a-5896-59dc-ae03-0d6b8349e1b3/efdbca4a-5896-59dc-ae03-0d6b8349e1b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344168,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efdbca4a-5896-59dc-ae03-0d6b8349e1b3/efdbca4a-5896-59dc-ae03-0d6b8349e1b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298293,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efdbca4a-5896-59dc-ae03-0d6b8349e1b3/efdbca4a-5896-59dc-ae03-0d6b8349e1b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334827,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efdbca4a-5896-59dc-ae03-0d6b8349e1b3/efdbca4a-5896-59dc-ae03-0d6b8349e1b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334223,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efdbca4a-5896-59dc-ae03-0d6b8349e1b3/efdbca4a-5896-59dc-ae03-0d6b8349e1b3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348589,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efdbca4a-5896-59dc-ae03-0d6b8349e1b3/efdbca4a-5896-59dc-ae03-0d6b8349e1b3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306747,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/6db3bcdfdf6645769f3ca4de3dedd2d2/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-15',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 308 1.2 PureTech 110ch S&S Active Business',
'transmission': 'manual',
'trim': '308 1.2 PureTech 110ch S&S Active Business',
'vin': None,
'year': 2020}
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988311%27 HTTP/1.1" 200 None
2026-03-27 16:48:14 [ayvens.fr] INFO: Saving data for 1988311: {'created_time': 1774630094.332274, 'last_price_update_time': 1774630094.332284, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988311') HTTP/1.1" 204 0
2026-03-27 16:48:14 [ayvens.fr] INFO: Found listing with ID: 1988313
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988313%27 HTTP/1.1" 200 None
2026-03-27 16:48:14 [ayvens.fr] INFO: Scrape type for 1988313: 1
2026-03-27 16:48:14 [ayvens.fr] INFO: Extracting data for car ID: 1988313
2026-03-27 16:48:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0096cbdf-364d-5cc1-a341-48b6f764b88f with identifier: 1988313
2026-03-27 16:48:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0096cbdf-364d-5cc1-a341-48b6f764b88f with scrape type 1
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0096cbdf-364d-5cc1-a341-48b6f764b88f
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F716f1d7b64094e438f2a41f3c5974058%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/1.jpg not downloaded yet
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F716f1d7b64094e438f2a41f3c5974058%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/2.jpg not downloaded yet
2026-03-27 16:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F716f1d7b64094e438f2a41f3c5974058%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/3.jpg not downloaded yet
2026-03-27 16:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F716f1d7b64094e438f2a41f3c5974058%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/4.jpg not downloaded yet
2026-03-27 16:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F716f1d7b64094e438f2a41f3c5974058%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/5.jpg not downloaded yet
2026-03-27 16:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F716f1d7b64094e438f2a41f3c5974058%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/6.jpg not downloaded yet
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F716f1d7b64094e438f2a41f3c5974058%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/7.jpg not downloaded yet
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F716f1d7b64094e438f2a41f3c5974058%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/8.jpg not downloaded yet
2026-03-27 16:48:14 [ayvens.fr] INFO: Found listing with ID: 1988314
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988314%27 HTTP/1.1" 200 None
2026-03-27 16:48:14 [ayvens.fr] INFO: Scrape type for 1988314: 1
2026-03-27 16:48:14 [ayvens.fr] INFO: Extracting data for car ID: 1988314
2026-03-27 16:48:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bee520b9-4b11-5af4-9381-9116a94b3bc3 with identifier: 1988314
2026-03-27 16:48:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bee520b9-4b11-5af4-9381-9116a94b3bc3 with scrape type 1
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item bee520b9-4b11-5af4-9381-9116a94b3bc3
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F5bf85922fc894026981cd81348564414%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/1.jpg not downloaded yet
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F5bf85922fc894026981cd81348564414%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/2.jpg not downloaded yet
2026-03-27 16:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59063c090>
2026-03-27 16:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ccb980-5899-5db6-9f0a-4f2bcf5d6b39/98ccb980-5899-5db6-9f0a-4f2bcf5d6b39_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fbbd7f3ec6525419aa48bf9b98d4e3e43%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/5.jpg saved to cache
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98ccb980-5899-5db6-9f0a-4f2bcf5d6b39
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F5bf85922fc894026981cd81348564414%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/3.jpg not downloaded yet
2026-03-27 16:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fc8510>
2026-03-27 16:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ccb980-5899-5db6-9f0a-4f2bcf5d6b39/98ccb980-5899-5db6-9f0a-4f2bcf5d6b39_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fbbd7f3ec6525419aa48bf9b98d4e3e43%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/1.jpg saved to cache
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98ccb980-5899-5db6-9f0a-4f2bcf5d6b39
2026-03-27 16:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abb110>
2026-03-27 16:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ccb980-5899-5db6-9f0a-4f2bcf5d6b39/98ccb980-5899-5db6-9f0a-4f2bcf5d6b39_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fbbd7f3ec6525419aa48bf9b98d4e3e43%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/2.jpg saved to cache
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98ccb980-5899-5db6-9f0a-4f2bcf5d6b39
2026-03-27 16:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0cb50>
2026-03-27 16:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ccb980-5899-5db6-9f0a-4f2bcf5d6b39/98ccb980-5899-5db6-9f0a-4f2bcf5d6b39_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fbbd7f3ec6525419aa48bf9b98d4e3e43%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/6.jpg saved to cache
2026-03-27 16:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98ccb980-5899-5db6-9f0a-4f2bcf5d6b39
2026-03-27 16:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590af3390>
2026-03-27 16:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ccb980-5899-5db6-9f0a-4f2bcf5d6b39/98ccb980-5899-5db6-9f0a-4f2bcf5d6b39_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fbbd7f3ec6525419aa48bf9b98d4e3e43%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/4.jpg saved to cache
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98ccb980-5899-5db6-9f0a-4f2bcf5d6b39
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a2690>
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ccb980-5899-5db6-9f0a-4f2bcf5d6b39/98ccb980-5899-5db6-9f0a-4f2bcf5d6b39_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fbbd7f3ec6525419aa48bf9b98d4e3e43%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/3.jpg saved to cache
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98ccb980-5899-5db6-9f0a-4f2bcf5d6b39
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590514850>
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ccb980-5899-5db6-9f0a-4f2bcf5d6b39/98ccb980-5899-5db6-9f0a-4f2bcf5d6b39_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fbbd7f3ec6525419aa48bf9b98d4e3e43%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/7.jpg saved to cache
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98ccb980-5899-5db6-9f0a-4f2bcf5d6b39
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b18a90>
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ccb980-5899-5db6-9f0a-4f2bcf5d6b39/98ccb980-5899-5db6-9f0a-4f2bcf5d6b39_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fbbd7f3ec6525419aa48bf9b98d4e3e43%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/8.jpg saved to cache
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98ccb980-5899-5db6-9f0a-4f2bcf5d6b39
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F5bf85922fc894026981cd81348564414%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/4.jpg not downloaded yet
2026-03-27 16:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F5bf85922fc894026981cd81348564414%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/5.jpg not downloaded yet
2026-03-27 16:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F5bf85922fc894026981cd81348564414%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/6.jpg not downloaded yet
2026-03-27 16:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F5bf85922fc894026981cd81348564414%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/7.jpg not downloaded yet
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F5bf85922fc894026981cd81348564414%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/8.jpg not downloaded yet
2026-03-27 16:48:15 [ayvens.fr] INFO: Found listing with ID: 1988315
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988315%27 HTTP/1.1" 200 None
2026-03-27 16:48:15 [ayvens.fr] INFO: Scrape type for 1988315: 1
2026-03-27 16:48:15 [ayvens.fr] INFO: Extracting data for car ID: 1988315
2026-03-27 16:48:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a80a2c8-0370-55b7-8933-9f33e36813e3 with identifier: 1988315
2026-03-27 16:48:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a80a2c8-0370-55b7-8933-9f33e36813e3 with scrape type 1
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 9a80a2c8-0370-55b7-8933-9f33e36813e3
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F127a42bb1bce4d31ac92c5fe99cb8d83%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/1.jpg not downloaded yet
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F127a42bb1bce4d31ac92c5fe99cb8d83%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/2.jpg not downloaded yet
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee2e10>
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0096cbdf-364d-5cc1-a341-48b6f764b88f/0096cbdf-364d-5cc1-a341-48b6f764b88f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F716f1d7b64094e438f2a41f3c5974058%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/1.jpg saved to cache
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0096cbdf-364d-5cc1-a341-48b6f764b88f
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590615d50>
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0096cbdf-364d-5cc1-a341-48b6f764b88f/0096cbdf-364d-5cc1-a341-48b6f764b88f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F716f1d7b64094e438f2a41f3c5974058%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/5.jpg saved to cache
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0096cbdf-364d-5cc1-a341-48b6f764b88f
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4e6d0>
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0096cbdf-364d-5cc1-a341-48b6f764b88f/0096cbdf-364d-5cc1-a341-48b6f764b88f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F716f1d7b64094e438f2a41f3c5974058%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/4.jpg saved to cache
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0096cbdf-364d-5cc1-a341-48b6f764b88f
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590617f10>
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0096cbdf-364d-5cc1-a341-48b6f764b88f/0096cbdf-364d-5cc1-a341-48b6f764b88f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F716f1d7b64094e438f2a41f3c5974058%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/6.jpg saved to cache
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0096cbdf-364d-5cc1-a341-48b6f764b88f
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F127a42bb1bce4d31ac92c5fe99cb8d83%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/3.jpg not downloaded yet
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F127a42bb1bce4d31ac92c5fe99cb8d83%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/4.jpg not downloaded yet
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F127a42bb1bce4d31ac92c5fe99cb8d83%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/5.jpg not downloaded yet
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d44a50>
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0096cbdf-364d-5cc1-a341-48b6f764b88f/0096cbdf-364d-5cc1-a341-48b6f764b88f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F716f1d7b64094e438f2a41f3c5974058%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/3.jpg saved to cache
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0096cbdf-364d-5cc1-a341-48b6f764b88f
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590528390>
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0096cbdf-364d-5cc1-a341-48b6f764b88f/0096cbdf-364d-5cc1-a341-48b6f764b88f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F716f1d7b64094e438f2a41f3c5974058%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/2.jpg saved to cache
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0096cbdf-364d-5cc1-a341-48b6f764b88f
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4a050>
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ccb980-5899-5db6-9f0a-4f2bcf5d6b39/98ccb980-5899-5db6-9f0a-4f2bcf5d6b39_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fbbd7f3ec6525419aa48bf9b98d4e3e43%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/10.jpg saved to cache
2026-03-27 16:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 98ccb980-5899-5db6-9f0a-4f2bcf5d6b39
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6f790>
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ccb980-5899-5db6-9f0a-4f2bcf5d6b39/98ccb980-5899-5db6-9f0a-4f2bcf5d6b39_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fbbd7f3ec6525419aa48bf9b98d4e3e43%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/9.jpg saved to cache
2026-03-27 16:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 98ccb980-5899-5db6-9f0a-4f2bcf5d6b39
2026-03-27 16:48:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98ccb980-5899-5db6-9f0a-4f2bcf5d6b39, skipping ID generation
2026-03-27 16:48:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98ccb980-5899-5db6-9f0a-4f2bcf5d6b39 with scrape type 1
2026-03-27 16:48:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98ccb980-5899-5db6-9f0a-4f2bcf5d6b39 sending to next pipeline
2026-03-27 16:48:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 98ccb980-5899-5db6-9f0a-4f2bcf5d6b39, identifier: 1988312
2026-03-27 16:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 98ccb980-5899-5db6-9f0a-4f2bcf5d6b39 with identifier: 1988312
2026-03-27 16:48:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:48:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 98ccb980-5899-5db6-9f0a-4f2bcf5d6b39 with identifier: 1988312
2026-03-27 16:48:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 98ccb980-5899-5db6-9f0a-4f2bcf5d6b39 with identifier: 1988312 to the API
2026-03-27 16:48:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 143,
'color': 'BLEU C',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '98ccb980-5899-5db6-9f0a-4f2bcf5d6b39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 106383,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ccb980-5899-5db6-9f0a-4f2bcf5d6b39/98ccb980-5899-5db6-9f0a-4f2bcf5d6b39_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 572064,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ccb980-5899-5db6-9f0a-4f2bcf5d6b39/98ccb980-5899-5db6-9f0a-4f2bcf5d6b39_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 572064,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ccb980-5899-5db6-9f0a-4f2bcf5d6b39/98ccb980-5899-5db6-9f0a-4f2bcf5d6b39_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 601688,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ccb980-5899-5db6-9f0a-4f2bcf5d6b39/98ccb980-5899-5db6-9f0a-4f2bcf5d6b39_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436144,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ccb980-5899-5db6-9f0a-4f2bcf5d6b39/98ccb980-5899-5db6-9f0a-4f2bcf5d6b39_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397383,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ccb980-5899-5db6-9f0a-4f2bcf5d6b39/98ccb980-5899-5db6-9f0a-4f2bcf5d6b39_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556094,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ccb980-5899-5db6-9f0a-4f2bcf5d6b39/98ccb980-5899-5db6-9f0a-4f2bcf5d6b39_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606046,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ccb980-5899-5db6-9f0a-4f2bcf5d6b39/98ccb980-5899-5db6-9f0a-4f2bcf5d6b39_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 632318,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ccb980-5899-5db6-9f0a-4f2bcf5d6b39/98ccb980-5899-5db6-9f0a-4f2bcf5d6b39_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 623401,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ccb980-5899-5db6-9f0a-4f2bcf5d6b39/98ccb980-5899-5db6-9f0a-4f2bcf5d6b39_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 579338,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/bbd7f3ec6525419aa48bf9b98d4e3e43/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-11',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.5 BlueHDi 130ch S&S Allure Pack EAT8',
'transmission': 'automatic',
'trim': '5008 1.5 BlueHDi 130ch S&S Allure Pack EAT8',
'vin': None,
'year': 2021}
2026-03-27 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988312%27 HTTP/1.1" 200 None
2026-03-27 16:48:16 [ayvens.fr] INFO: Saving data for 1988312: {'created_time': 1774630096.759562, 'last_price_update_time': 1774630096.759575, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988312') HTTP/1.1" 204 0
2026-03-27 16:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F127a42bb1bce4d31ac92c5fe99cb8d83%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/6.jpg not downloaded yet
2026-03-27 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F127a42bb1bce4d31ac92c5fe99cb8d83%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/7.jpg not downloaded yet
2026-03-27 16:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9e350>
2026-03-27 16:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee520b9-4b11-5af4-9381-9116a94b3bc3/bee520b9-4b11-5af4-9381-9116a94b3bc3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F5bf85922fc894026981cd81348564414%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/2.jpg saved to cache
2026-03-27 16:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bee520b9-4b11-5af4-9381-9116a94b3bc3
2026-03-27 16:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2da90>
2026-03-27 16:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee520b9-4b11-5af4-9381-9116a94b3bc3/bee520b9-4b11-5af4-9381-9116a94b3bc3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F5bf85922fc894026981cd81348564414%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/4.jpg saved to cache
2026-03-27 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bee520b9-4b11-5af4-9381-9116a94b3bc3
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066fad0>
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0096cbdf-364d-5cc1-a341-48b6f764b88f/0096cbdf-364d-5cc1-a341-48b6f764b88f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F716f1d7b64094e438f2a41f3c5974058%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/7.jpg saved to cache
2026-03-27 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0096cbdf-364d-5cc1-a341-48b6f764b88f
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59052a510>
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee520b9-4b11-5af4-9381-9116a94b3bc3/bee520b9-4b11-5af4-9381-9116a94b3bc3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F5bf85922fc894026981cd81348564414%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/5.jpg saved to cache
2026-03-27 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bee520b9-4b11-5af4-9381-9116a94b3bc3
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F127a42bb1bce4d31ac92c5fe99cb8d83%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/8.jpg not downloaded yet
2026-03-27 16:48:17 [ayvens.fr] INFO: Found listing with ID: 1988316
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988316%27 HTTP/1.1" 200 None
2026-03-27 16:48:17 [ayvens.fr] INFO: Scrape type for 1988316: 1
2026-03-27 16:48:17 [ayvens.fr] INFO: Extracting data for car ID: 1988316
2026-03-27 16:48:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac7db117-adfc-54ab-a229-32fbd613dbb4 with identifier: 1988316
2026-03-27 16:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac7db117-adfc-54ab-a229-32fbd613dbb4 with scrape type 1
2026-03-27 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ac7db117-adfc-54ab-a229-32fbd613dbb4
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F0f77623e9d0644acbfd3296ad78339e0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/1.jpg not downloaded yet
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068cd10>
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0096cbdf-364d-5cc1-a341-48b6f764b88f/0096cbdf-364d-5cc1-a341-48b6f764b88f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F716f1d7b64094e438f2a41f3c5974058%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/8.jpg saved to cache
2026-03-27 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0096cbdf-364d-5cc1-a341-48b6f764b88f
2026-03-27 16:48:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0096cbdf-364d-5cc1-a341-48b6f764b88f, skipping ID generation
2026-03-27 16:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0096cbdf-364d-5cc1-a341-48b6f764b88f with scrape type 1
2026-03-27 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0096cbdf-364d-5cc1-a341-48b6f764b88f sending to next pipeline
2026-03-27 16:48:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0096cbdf-364d-5cc1-a341-48b6f764b88f, identifier: 1988313
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3c310>
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee520b9-4b11-5af4-9381-9116a94b3bc3/bee520b9-4b11-5af4-9381-9116a94b3bc3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F5bf85922fc894026981cd81348564414%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/1.jpg saved to cache
2026-03-27 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bee520b9-4b11-5af4-9381-9116a94b3bc3
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068c4d0>
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee520b9-4b11-5af4-9381-9116a94b3bc3/bee520b9-4b11-5af4-9381-9116a94b3bc3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F5bf85922fc894026981cd81348564414%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/3.jpg saved to cache
2026-03-27 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bee520b9-4b11-5af4-9381-9116a94b3bc3
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59287aa10>
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee520b9-4b11-5af4-9381-9116a94b3bc3/bee520b9-4b11-5af4-9381-9116a94b3bc3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F5bf85922fc894026981cd81348564414%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/6.jpg saved to cache
2026-03-27 16:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bee520b9-4b11-5af4-9381-9116a94b3bc3
2026-03-27 16:48:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0096cbdf-364d-5cc1-a341-48b6f764b88f with identifier: 1988313
2026-03-27 16:48:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:48:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0096cbdf-364d-5cc1-a341-48b6f764b88f with identifier: 1988313
2026-03-27 16:48:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0096cbdf-364d-5cc1-a341-48b6f764b88f with identifier: 1988313 to the API
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'BLEU SAPHIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '0096cbdf-364d-5cc1-a341-48b6f764b88f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'EV6',
'odometer': 107098,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0096cbdf-364d-5cc1-a341-48b6f764b88f/0096cbdf-364d-5cc1-a341-48b6f764b88f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436251,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0096cbdf-364d-5cc1-a341-48b6f764b88f/0096cbdf-364d-5cc1-a341-48b6f764b88f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436251,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0096cbdf-364d-5cc1-a341-48b6f764b88f/0096cbdf-364d-5cc1-a341-48b6f764b88f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 463263,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0096cbdf-364d-5cc1-a341-48b6f764b88f/0096cbdf-364d-5cc1-a341-48b6f764b88f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377443,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0096cbdf-364d-5cc1-a341-48b6f764b88f/0096cbdf-364d-5cc1-a341-48b6f764b88f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358251,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0096cbdf-364d-5cc1-a341-48b6f764b88f/0096cbdf-364d-5cc1-a341-48b6f764b88f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376127,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0096cbdf-364d-5cc1-a341-48b6f764b88f/0096cbdf-364d-5cc1-a341-48b6f764b88f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281183,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0096cbdf-364d-5cc1-a341-48b6f764b88f/0096cbdf-364d-5cc1-a341-48b6f764b88f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344559,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/716f1d7b64094e438f2a41f3c5974058/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-07',
'seats_number': 5,
'seller_name': None,
'title': 'KIA EV6 EV6 9ch Air Active Business 2WD',
'transmission': 'automatic',
'trim': 'EV6 9ch Air Active Business 2WD',
'vin': None,
'year': 2023}
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988313%27 HTTP/1.1" 200 None
2026-03-27 16:48:18 [ayvens.fr] INFO: Saving data for 1988313: {'created_time': 1774630098.024798, 'last_price_update_time': 1774630098.024814, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988313') HTTP/1.1" 204 0
2026-03-27 16:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F0f77623e9d0644acbfd3296ad78339e0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/2.jpg not downloaded yet
2026-03-27 16:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F0f77623e9d0644acbfd3296ad78339e0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/3.jpg not downloaded yet
2026-03-27 16:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F0f77623e9d0644acbfd3296ad78339e0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/4.jpg not downloaded yet
2026-03-27 16:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F0f77623e9d0644acbfd3296ad78339e0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/5.jpg not downloaded yet
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F0f77623e9d0644acbfd3296ad78339e0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/6.jpg not downloaded yet
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F0f77623e9d0644acbfd3296ad78339e0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/7.jpg not downloaded yet
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F0f77623e9d0644acbfd3296ad78339e0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/8.jpg not downloaded yet
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906967d0>
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee520b9-4b11-5af4-9381-9116a94b3bc3/bee520b9-4b11-5af4-9381-9116a94b3bc3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F5bf85922fc894026981cd81348564414%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/8.jpg saved to cache
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bee520b9-4b11-5af4-9381-9116a94b3bc3
2026-03-27 16:48:18 [ayvens.fr] INFO: Found listing with ID: 1988317
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988317%27 HTTP/1.1" 200 None
2026-03-27 16:48:18 [ayvens.fr] INFO: Scrape type for 1988317: 1
2026-03-27 16:48:18 [ayvens.fr] INFO: Extracting data for car ID: 1988317
2026-03-27 16:48:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 747150fc-7732-5d7b-b58e-54b20bc6c821 with identifier: 1988317
2026-03-27 16:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747150fc-7732-5d7b-b58e-54b20bc6c821 with scrape type 1
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 747150fc-7732-5d7b-b58e-54b20bc6c821
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6eac414c63984e78acdfa3ffa85dd058%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/1.jpg not downloaded yet
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6eac414c63984e78acdfa3ffa85dd058%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/2.jpg not downloaded yet
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c2f50>
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee520b9-4b11-5af4-9381-9116a94b3bc3/bee520b9-4b11-5af4-9381-9116a94b3bc3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F5bf85922fc894026981cd81348564414%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/7.jpg saved to cache
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bee520b9-4b11-5af4-9381-9116a94b3bc3
2026-03-27 16:48:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bee520b9-4b11-5af4-9381-9116a94b3bc3, skipping ID generation
2026-03-27 16:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bee520b9-4b11-5af4-9381-9116a94b3bc3 with scrape type 1
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bee520b9-4b11-5af4-9381-9116a94b3bc3 sending to next pipeline
2026-03-27 16:48:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: bee520b9-4b11-5af4-9381-9116a94b3bc3, identifier: 1988314
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068d110>
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80a2c8-0370-55b7-8933-9f33e36813e3/9a80a2c8-0370-55b7-8933-9f33e36813e3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F127a42bb1bce4d31ac92c5fe99cb8d83%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/3.jpg saved to cache
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a80a2c8-0370-55b7-8933-9f33e36813e3
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903cc990>
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80a2c8-0370-55b7-8933-9f33e36813e3/9a80a2c8-0370-55b7-8933-9f33e36813e3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F127a42bb1bce4d31ac92c5fe99cb8d83%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/5.jpg saved to cache
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a80a2c8-0370-55b7-8933-9f33e36813e3
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d80450>
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80a2c8-0370-55b7-8933-9f33e36813e3/9a80a2c8-0370-55b7-8933-9f33e36813e3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F127a42bb1bce4d31ac92c5fe99cb8d83%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/1.jpg saved to cache
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a80a2c8-0370-55b7-8933-9f33e36813e3
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905aafd0>
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80a2c8-0370-55b7-8933-9f33e36813e3/9a80a2c8-0370-55b7-8933-9f33e36813e3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F127a42bb1bce4d31ac92c5fe99cb8d83%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/4.jpg saved to cache
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a80a2c8-0370-55b7-8933-9f33e36813e3
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0ca90>
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80a2c8-0370-55b7-8933-9f33e36813e3/9a80a2c8-0370-55b7-8933-9f33e36813e3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F127a42bb1bce4d31ac92c5fe99cb8d83%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/6.jpg saved to cache
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a80a2c8-0370-55b7-8933-9f33e36813e3
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59120ad10>
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80a2c8-0370-55b7-8933-9f33e36813e3/9a80a2c8-0370-55b7-8933-9f33e36813e3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F127a42bb1bce4d31ac92c5fe99cb8d83%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/2.jpg saved to cache
2026-03-27 16:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a80a2c8-0370-55b7-8933-9f33e36813e3
2026-03-27 16:48:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: bee520b9-4b11-5af4-9381-9116a94b3bc3 with identifier: 1988314
2026-03-27 16:48:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: bee520b9-4b11-5af4-9381-9116a94b3bc3 with identifier: 1988314
2026-03-27 16:48:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: bee520b9-4b11-5af4-9381-9116a94b3bc3 with identifier: 1988314 to the API
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 144,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'bee520b9-4b11-5af4-9381-9116a94b3bc3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 45727,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee520b9-4b11-5af4-9381-9116a94b3bc3/bee520b9-4b11-5af4-9381-9116a94b3bc3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327062,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee520b9-4b11-5af4-9381-9116a94b3bc3/bee520b9-4b11-5af4-9381-9116a94b3bc3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327062,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee520b9-4b11-5af4-9381-9116a94b3bc3/bee520b9-4b11-5af4-9381-9116a94b3bc3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352187,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee520b9-4b11-5af4-9381-9116a94b3bc3/bee520b9-4b11-5af4-9381-9116a94b3bc3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322616,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee520b9-4b11-5af4-9381-9116a94b3bc3/bee520b9-4b11-5af4-9381-9116a94b3bc3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304022,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee520b9-4b11-5af4-9381-9116a94b3bc3/bee520b9-4b11-5af4-9381-9116a94b3bc3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336868,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee520b9-4b11-5af4-9381-9116a94b3bc3/bee520b9-4b11-5af4-9381-9116a94b3bc3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290589,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee520b9-4b11-5af4-9381-9116a94b3bc3/bee520b9-4b11-5af4-9381-9116a94b3bc3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240544,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/5bf85922fc894026981cd81348564414/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-03',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN QASHQAI Qashqai 1.3 Mild Hybrid 158ch N-Connecta Xtronic',
'transmission': 'automatic',
'trim': 'Qashqai 1.3 Mild Hybrid 158ch N-Connecta Xtronic',
'vin': None,
'year': 2022}
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988314%27 HTTP/1.1" 200 None
2026-03-27 16:48:19 [ayvens.fr] INFO: Saving data for 1988314: {'created_time': 1774630099.332864, 'last_price_update_time': 1774630099.332875, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988314') HTTP/1.1" 204 0
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6eac414c63984e78acdfa3ffa85dd058%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/3.jpg not downloaded yet
2026-03-27 16:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6eac414c63984e78acdfa3ffa85dd058%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/4.jpg not downloaded yet
2026-03-27 16:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6eac414c63984e78acdfa3ffa85dd058%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/5.jpg not downloaded yet
2026-03-27 16:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6eac414c63984e78acdfa3ffa85dd058%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/6.jpg not downloaded yet
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6eac414c63984e78acdfa3ffa85dd058%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/7.jpg not downloaded yet
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6eac414c63984e78acdfa3ffa85dd058%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/8.jpg not downloaded yet
2026-03-27 16:48:19 [ayvens.fr] INFO: Found listing with ID: 1988318
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988318%27 HTTP/1.1" 200 None
2026-03-27 16:48:19 [ayvens.fr] INFO: Scrape type for 1988318: 1
2026-03-27 16:48:19 [ayvens.fr] INFO: Extracting data for car ID: 1988318
2026-03-27 16:48:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6c5425d-2c14-5aad-b707-338de5f33e58 with identifier: 1988318
2026-03-27 16:48:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6c5425d-2c14-5aad-b707-338de5f33e58 with scrape type 1
2026-03-27 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b6c5425d-2c14-5aad-b707-338de5f33e58
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F09bee22039cc4f37aa7758f457cd3988%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/1.jpg not downloaded yet
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F09bee22039cc4f37aa7758f457cd3988%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/2.jpg not downloaded yet
2026-03-27 16:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa1e50>
2026-03-27 16:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac7db117-adfc-54ab-a229-32fbd613dbb4/ac7db117-adfc-54ab-a229-32fbd613dbb4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F0f77623e9d0644acbfd3296ad78339e0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/1.jpg saved to cache
2026-03-27 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac7db117-adfc-54ab-a229-32fbd613dbb4
2026-03-27 16:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ec6950>
2026-03-27 16:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80a2c8-0370-55b7-8933-9f33e36813e3/9a80a2c8-0370-55b7-8933-9f33e36813e3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F127a42bb1bce4d31ac92c5fe99cb8d83%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/8.jpg saved to cache
2026-03-27 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a80a2c8-0370-55b7-8933-9f33e36813e3
2026-03-27 16:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904ca1d0>
2026-03-27 16:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80a2c8-0370-55b7-8933-9f33e36813e3/9a80a2c8-0370-55b7-8933-9f33e36813e3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F127a42bb1bce4d31ac92c5fe99cb8d83%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/7.jpg saved to cache
2026-03-27 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a80a2c8-0370-55b7-8933-9f33e36813e3
2026-03-27 16:48:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a80a2c8-0370-55b7-8933-9f33e36813e3, skipping ID generation
2026-03-27 16:48:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a80a2c8-0370-55b7-8933-9f33e36813e3 with scrape type 1
2026-03-27 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a80a2c8-0370-55b7-8933-9f33e36813e3 sending to next pipeline
2026-03-27 16:48:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9a80a2c8-0370-55b7-8933-9f33e36813e3, identifier: 1988315
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F09bee22039cc4f37aa7758f457cd3988%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/3.jpg not downloaded yet
2026-03-27 16:48:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9a80a2c8-0370-55b7-8933-9f33e36813e3 with identifier: 1988315
2026-03-27 16:48:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9a80a2c8-0370-55b7-8933-9f33e36813e3 with identifier: 1988315
2026-03-27 16:48:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9a80a2c8-0370-55b7-8933-9f33e36813e3 with identifier: 1988315 to the API
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-03-27 16:48:20 [crawlers.pipelines.post_to_api] ERROR: ayvens.fr, item_id 9a80a2c8-0370-55b7-8933-9f33e36813e3: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"Color","ErrorMessage":"color value can only be expressed in letters","ErrorCode":0}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 27 Mar 2026 16:48:19 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2026-03-27 16:48:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 25,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '9a80a2c8-0370-55b7-8933-9f33e36813e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 58887,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80a2c8-0370-55b7-8933-9f33e36813e3/9a80a2c8-0370-55b7-8933-9f33e36813e3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380895,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80a2c8-0370-55b7-8933-9f33e36813e3/9a80a2c8-0370-55b7-8933-9f33e36813e3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380895,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80a2c8-0370-55b7-8933-9f33e36813e3/9a80a2c8-0370-55b7-8933-9f33e36813e3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318435,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80a2c8-0370-55b7-8933-9f33e36813e3/9a80a2c8-0370-55b7-8933-9f33e36813e3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358453,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80a2c8-0370-55b7-8933-9f33e36813e3/9a80a2c8-0370-55b7-8933-9f33e36813e3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354113,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80a2c8-0370-55b7-8933-9f33e36813e3/9a80a2c8-0370-55b7-8933-9f33e36813e3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287740,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80a2c8-0370-55b7-8933-9f33e36813e3/9a80a2c8-0370-55b7-8933-9f33e36813e3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377649,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80a2c8-0370-55b7-8933-9f33e36813e3/9a80a2c8-0370-55b7-8933-9f33e36813e3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430454,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/127a42bb1bce4d31ac92c5fe99cb8d83/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-07',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 SW 308 SW PHEV 180ch Active Pack e-EAT8',
'transmission': 'automatic',
'trim': '308 SW PHEV 180ch Active Pack e-EAT8',
'vin': None,
'year': 2022}
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988315%27 HTTP/1.1" 200 None
2026-03-27 16:48:20 [ayvens.fr] INFO: Saving data for 1988315: {'created_time': 1774630100.160005, 'last_price_update_time': 1774630100.160017, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988315') HTTP/1.1" 204 0
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ec6f90>
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac7db117-adfc-54ab-a229-32fbd613dbb4/ac7db117-adfc-54ab-a229-32fbd613dbb4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F0f77623e9d0644acbfd3296ad78339e0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/6.jpg saved to cache
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac7db117-adfc-54ab-a229-32fbd613dbb4
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abf350>
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac7db117-adfc-54ab-a229-32fbd613dbb4/ac7db117-adfc-54ab-a229-32fbd613dbb4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F0f77623e9d0644acbfd3296ad78339e0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/4.jpg saved to cache
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac7db117-adfc-54ab-a229-32fbd613dbb4
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7f090>
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac7db117-adfc-54ab-a229-32fbd613dbb4/ac7db117-adfc-54ab-a229-32fbd613dbb4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F0f77623e9d0644acbfd3296ad78339e0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/2.jpg saved to cache
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac7db117-adfc-54ab-a229-32fbd613dbb4
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590597a10>
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac7db117-adfc-54ab-a229-32fbd613dbb4/ac7db117-adfc-54ab-a229-32fbd613dbb4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F0f77623e9d0644acbfd3296ad78339e0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/5.jpg saved to cache
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac7db117-adfc-54ab-a229-32fbd613dbb4
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa01d0>
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac7db117-adfc-54ab-a229-32fbd613dbb4/ac7db117-adfc-54ab-a229-32fbd613dbb4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F0f77623e9d0644acbfd3296ad78339e0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/3.jpg saved to cache
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac7db117-adfc-54ab-a229-32fbd613dbb4
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F09bee22039cc4f37aa7758f457cd3988%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/4.jpg not downloaded yet
2026-03-27 16:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F09bee22039cc4f37aa7758f457cd3988%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/5.jpg not downloaded yet
2026-03-27 16:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F09bee22039cc4f37aa7758f457cd3988%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/6.jpg not downloaded yet
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F09bee22039cc4f37aa7758f457cd3988%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/7.jpg not downloaded yet
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F09bee22039cc4f37aa7758f457cd3988%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/8.jpg not downloaded yet
2026-03-27 16:48:20 [ayvens.fr] INFO: Found listing with ID: 1988319
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988319%27 HTTP/1.1" 200 None
2026-03-27 16:48:20 [ayvens.fr] INFO: Scrape type for 1988319: 1
2026-03-27 16:48:20 [ayvens.fr] INFO: Extracting data for car ID: 1988319
2026-03-27 16:48:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0dc83a3-11c6-54d4-ab85-fd836af58dd0 with identifier: 1988319
2026-03-27 16:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0dc83a3-11c6-54d4-ab85-fd836af58dd0 with scrape type 1
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b0dc83a3-11c6-54d4-ab85-fd836af58dd0
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F5fee6d68d082487d9fe0a99a52e99a22%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/1.jpg not downloaded yet
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F5fee6d68d082487d9fe0a99a52e99a22%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/2.jpg not downloaded yet
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b3a10>
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac7db117-adfc-54ab-a229-32fbd613dbb4/ac7db117-adfc-54ab-a229-32fbd613dbb4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F0f77623e9d0644acbfd3296ad78339e0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/8.jpg saved to cache
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac7db117-adfc-54ab-a229-32fbd613dbb4
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59103d810>
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac7db117-adfc-54ab-a229-32fbd613dbb4/ac7db117-adfc-54ab-a229-32fbd613dbb4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F0f77623e9d0644acbfd3296ad78339e0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/7.jpg saved to cache
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac7db117-adfc-54ab-a229-32fbd613dbb4
2026-03-27 16:48:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac7db117-adfc-54ab-a229-32fbd613dbb4, skipping ID generation
2026-03-27 16:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac7db117-adfc-54ab-a229-32fbd613dbb4 with scrape type 1
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac7db117-adfc-54ab-a229-32fbd613dbb4 sending to next pipeline
2026-03-27 16:48:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ac7db117-adfc-54ab-a229-32fbd613dbb4, identifier: 1988316
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F5fee6d68d082487d9fe0a99a52e99a22%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/3.jpg not downloaded yet
2026-03-27 16:48:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ac7db117-adfc-54ab-a229-32fbd613dbb4 with identifier: 1988316
2026-03-27 16:48:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ac7db117-adfc-54ab-a229-32fbd613dbb4 with identifier: 1988316
2026-03-27 16:48:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ac7db117-adfc-54ab-a229-32fbd613dbb4 with identifier: 1988316 to the API
2026-03-27 16:48:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 143,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'ac7db117-adfc-54ab-a229-32fbd613dbb4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'JAGUAR',
'model': 'E-PACE',
'odometer': 63875,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac7db117-adfc-54ab-a229-32fbd613dbb4/ac7db117-adfc-54ab-a229-32fbd613dbb4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345089,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac7db117-adfc-54ab-a229-32fbd613dbb4/ac7db117-adfc-54ab-a229-32fbd613dbb4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345089,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac7db117-adfc-54ab-a229-32fbd613dbb4/ac7db117-adfc-54ab-a229-32fbd613dbb4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364569,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac7db117-adfc-54ab-a229-32fbd613dbb4/ac7db117-adfc-54ab-a229-32fbd613dbb4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332926,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac7db117-adfc-54ab-a229-32fbd613dbb4/ac7db117-adfc-54ab-a229-32fbd613dbb4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276594,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac7db117-adfc-54ab-a229-32fbd613dbb4/ac7db117-adfc-54ab-a229-32fbd613dbb4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323035,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac7db117-adfc-54ab-a229-32fbd613dbb4/ac7db117-adfc-54ab-a229-32fbd613dbb4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317899,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac7db117-adfc-54ab-a229-32fbd613dbb4/ac7db117-adfc-54ab-a229-32fbd613dbb4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255125,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/0f77623e9d0644acbfd3296ad78339e0/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-13',
'seats_number': 5,
'seller_name': None,
'title': 'JAGUAR E-PACE E-Pace 2.0D 150ch',
'transmission': 'manual',
'trim': 'E-Pace 2.0D 150ch',
'vin': None,
'year': 2020}
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988316%27 HTTP/1.1" 200 None
2026-03-27 16:48:21 [ayvens.fr] INFO: Saving data for 1988316: {'created_time': 1774630101.425755, 'last_price_update_time': 1774630101.425768, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988316') HTTP/1.1" 204 0
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F5fee6d68d082487d9fe0a99a52e99a22%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/4.jpg not downloaded yet
2026-03-27 16:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ec7290>
2026-03-27 16:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747150fc-7732-5d7b-b58e-54b20bc6c821/747150fc-7732-5d7b-b58e-54b20bc6c821_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6eac414c63984e78acdfa3ffa85dd058%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/1.jpg saved to cache
2026-03-27 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 747150fc-7732-5d7b-b58e-54b20bc6c821
2026-03-27 16:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d6f890>
2026-03-27 16:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747150fc-7732-5d7b-b58e-54b20bc6c821/747150fc-7732-5d7b-b58e-54b20bc6c821_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6eac414c63984e78acdfa3ffa85dd058%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/2.jpg saved to cache
2026-03-27 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 747150fc-7732-5d7b-b58e-54b20bc6c821
2026-03-27 16:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d970d0>
2026-03-27 16:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747150fc-7732-5d7b-b58e-54b20bc6c821/747150fc-7732-5d7b-b58e-54b20bc6c821_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6eac414c63984e78acdfa3ffa85dd058%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/6.jpg saved to cache
2026-03-27 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 747150fc-7732-5d7b-b58e-54b20bc6c821
2026-03-27 16:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591112510>
2026-03-27 16:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747150fc-7732-5d7b-b58e-54b20bc6c821/747150fc-7732-5d7b-b58e-54b20bc6c821_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6eac414c63984e78acdfa3ffa85dd058%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/5.jpg saved to cache
2026-03-27 16:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 747150fc-7732-5d7b-b58e-54b20bc6c821
2026-03-27 16:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4e250>
2026-03-27 16:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747150fc-7732-5d7b-b58e-54b20bc6c821/747150fc-7732-5d7b-b58e-54b20bc6c821_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6eac414c63984e78acdfa3ffa85dd058%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/3.jpg saved to cache
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 747150fc-7732-5d7b-b58e-54b20bc6c821
2026-03-27 16:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591433090>
2026-03-27 16:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747150fc-7732-5d7b-b58e-54b20bc6c821/747150fc-7732-5d7b-b58e-54b20bc6c821_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6eac414c63984e78acdfa3ffa85dd058%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/4.jpg saved to cache
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 747150fc-7732-5d7b-b58e-54b20bc6c821
2026-03-27 16:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F5fee6d68d082487d9fe0a99a52e99a22%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/5.jpg not downloaded yet
2026-03-27 16:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F5fee6d68d082487d9fe0a99a52e99a22%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/6.jpg not downloaded yet
2026-03-27 16:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F5fee6d68d082487d9fe0a99a52e99a22%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/7.jpg not downloaded yet
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F5fee6d68d082487d9fe0a99a52e99a22%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/8.jpg not downloaded yet
2026-03-27 16:48:22 [ayvens.fr] INFO: Found listing with ID: 1988320
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988320%27 HTTP/1.1" 200 None
2026-03-27 16:48:22 [ayvens.fr] INFO: Scrape type for 1988320: 1
2026-03-27 16:48:22 [ayvens.fr] INFO: Extracting data for car ID: 1988320
2026-03-27 16:48:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52ca57b8-881e-532c-9a70-db95307c0ce9 with identifier: 1988320
2026-03-27 16:48:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52ca57b8-881e-532c-9a70-db95307c0ce9 with scrape type 1
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 52ca57b8-881e-532c-9a70-db95307c0ce9
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F379cb3c4595f4cae9165d9328b71990c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/1.jpg not downloaded yet
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F379cb3c4595f4cae9165d9328b71990c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/2.jpg not downloaded yet
2026-03-27 16:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0d390>
2026-03-27 16:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747150fc-7732-5d7b-b58e-54b20bc6c821/747150fc-7732-5d7b-b58e-54b20bc6c821_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6eac414c63984e78acdfa3ffa85dd058%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/8.jpg saved to cache
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 747150fc-7732-5d7b-b58e-54b20bc6c821
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F379cb3c4595f4cae9165d9328b71990c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/3.jpg not downloaded yet
2026-03-27 16:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911cbd50>
2026-03-27 16:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747150fc-7732-5d7b-b58e-54b20bc6c821/747150fc-7732-5d7b-b58e-54b20bc6c821_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6eac414c63984e78acdfa3ffa85dd058%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/7.jpg saved to cache
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 747150fc-7732-5d7b-b58e-54b20bc6c821
2026-03-27 16:48:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 747150fc-7732-5d7b-b58e-54b20bc6c821, skipping ID generation
2026-03-27 16:48:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747150fc-7732-5d7b-b58e-54b20bc6c821 with scrape type 1
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 747150fc-7732-5d7b-b58e-54b20bc6c821 sending to next pipeline
2026-03-27 16:48:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 747150fc-7732-5d7b-b58e-54b20bc6c821, identifier: 1988317
2026-03-27 16:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59057e990>
2026-03-27 16:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c5425d-2c14-5aad-b707-338de5f33e58/b6c5425d-2c14-5aad-b707-338de5f33e58_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F09bee22039cc4f37aa7758f457cd3988%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/6.jpg saved to cache
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6c5425d-2c14-5aad-b707-338de5f33e58
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F379cb3c4595f4cae9165d9328b71990c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/4.jpg not downloaded yet
2026-03-27 16:48:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 747150fc-7732-5d7b-b58e-54b20bc6c821 with identifier: 1988317
2026-03-27 16:48:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:48:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:48:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 747150fc-7732-5d7b-b58e-54b20bc6c821 with identifier: 1988317
2026-03-27 16:48:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 747150fc-7732-5d7b-b58e-54b20bc6c821 with identifier: 1988317 to the API
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': 'NOIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/diesel',
'id': '747150fc-7732-5d7b-b58e-54b20bc6c821',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'TUCSON',
'odometer': 99942,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747150fc-7732-5d7b-b58e-54b20bc6c821/747150fc-7732-5d7b-b58e-54b20bc6c821_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747150fc-7732-5d7b-b58e-54b20bc6c821/747150fc-7732-5d7b-b58e-54b20bc6c821_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747150fc-7732-5d7b-b58e-54b20bc6c821/747150fc-7732-5d7b-b58e-54b20bc6c821_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392466,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747150fc-7732-5d7b-b58e-54b20bc6c821/747150fc-7732-5d7b-b58e-54b20bc6c821_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349194,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747150fc-7732-5d7b-b58e-54b20bc6c821/747150fc-7732-5d7b-b58e-54b20bc6c821_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321558,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747150fc-7732-5d7b-b58e-54b20bc6c821/747150fc-7732-5d7b-b58e-54b20bc6c821_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340819,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747150fc-7732-5d7b-b58e-54b20bc6c821/747150fc-7732-5d7b-b58e-54b20bc6c821_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354014,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747150fc-7732-5d7b-b58e-54b20bc6c821/747150fc-7732-5d7b-b58e-54b20bc6c821_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258913,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6eac414c63984e78acdfa3ffa85dd058/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI TUCSON Tucson 1.6 CRDI 136ch Hybrid 48V Business DCT7',
'transmission': 'automatic',
'trim': 'Tucson 1.6 CRDI 136ch Hybrid 48V Business DCT7',
'vin': None,
'year': 2022}
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988317%27 HTTP/1.1" 200 None
2026-03-27 16:48:22 [ayvens.fr] INFO: Saving data for 1988317: {'created_time': 1774630102.904302, 'last_price_update_time': 1774630102.904314, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988317') HTTP/1.1" 204 0
2026-03-27 16:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F379cb3c4595f4cae9165d9328b71990c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/5.jpg not downloaded yet
2026-03-27 16:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905ab6d0>
2026-03-27 16:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c5425d-2c14-5aad-b707-338de5f33e58/b6c5425d-2c14-5aad-b707-338de5f33e58_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F09bee22039cc4f37aa7758f457cd3988%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/1.jpg saved to cache
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6c5425d-2c14-5aad-b707-338de5f33e58
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f12ed0>
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c5425d-2c14-5aad-b707-338de5f33e58/b6c5425d-2c14-5aad-b707-338de5f33e58_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F09bee22039cc4f37aa7758f457cd3988%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/2.jpg saved to cache
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6c5425d-2c14-5aad-b707-338de5f33e58
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ad6c10>
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c5425d-2c14-5aad-b707-338de5f33e58/b6c5425d-2c14-5aad-b707-338de5f33e58_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F09bee22039cc4f37aa7758f457cd3988%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/4.jpg saved to cache
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6c5425d-2c14-5aad-b707-338de5f33e58
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f13210>
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c5425d-2c14-5aad-b707-338de5f33e58/b6c5425d-2c14-5aad-b707-338de5f33e58_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F09bee22039cc4f37aa7758f457cd3988%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/5.jpg saved to cache
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6c5425d-2c14-5aad-b707-338de5f33e58
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591112010>
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c5425d-2c14-5aad-b707-338de5f33e58/b6c5425d-2c14-5aad-b707-338de5f33e58_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F09bee22039cc4f37aa7758f457cd3988%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/3.jpg saved to cache
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6c5425d-2c14-5aad-b707-338de5f33e58
2026-03-27 16:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F379cb3c4595f4cae9165d9328b71990c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/6.jpg not downloaded yet
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F379cb3c4595f4cae9165d9328b71990c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/7.jpg not downloaded yet
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e00d0>
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dc83a3-11c6-54d4-ab85-fd836af58dd0/b0dc83a3-11c6-54d4-ab85-fd836af58dd0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F5fee6d68d082487d9fe0a99a52e99a22%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/2.jpg saved to cache
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0dc83a3-11c6-54d4-ab85-fd836af58dd0
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905183d0>
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dc83a3-11c6-54d4-ab85-fd836af58dd0/b0dc83a3-11c6-54d4-ab85-fd836af58dd0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F5fee6d68d082487d9fe0a99a52e99a22%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/1.jpg saved to cache
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0dc83a3-11c6-54d4-ab85-fd836af58dd0
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59063c4d0>
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dc83a3-11c6-54d4-ab85-fd836af58dd0/b0dc83a3-11c6-54d4-ab85-fd836af58dd0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F5fee6d68d082487d9fe0a99a52e99a22%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/6.jpg saved to cache
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b0dc83a3-11c6-54d4-ab85-fd836af58dd0
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d42c10>
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c5425d-2c14-5aad-b707-338de5f33e58/b6c5425d-2c14-5aad-b707-338de5f33e58_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F09bee22039cc4f37aa7758f457cd3988%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/8.jpg saved to cache
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b6c5425d-2c14-5aad-b707-338de5f33e58
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F379cb3c4595f4cae9165d9328b71990c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/8.jpg not downloaded yet
2026-03-27 16:48:23 [ayvens.fr] INFO: Found listing with ID: 1988321
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988321%27 HTTP/1.1" 200 None
2026-03-27 16:48:23 [ayvens.fr] INFO: Scrape type for 1988321: 1
2026-03-27 16:48:23 [ayvens.fr] INFO: Extracting data for car ID: 1988321
2026-03-27 16:48:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dde4272e-43df-5cdb-837c-1a347a871921 with identifier: 1988321
2026-03-27 16:48:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dde4272e-43df-5cdb-837c-1a347a871921 with scrape type 1
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item dde4272e-43df-5cdb-837c-1a347a871921
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F6b78bd178c1b4a30887434725109514d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/1.jpg not downloaded yet
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b5b150>
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dc83a3-11c6-54d4-ab85-fd836af58dd0/b0dc83a3-11c6-54d4-ab85-fd836af58dd0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F5fee6d68d082487d9fe0a99a52e99a22%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/4.jpg saved to cache
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0dc83a3-11c6-54d4-ab85-fd836af58dd0
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d75750>
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c5425d-2c14-5aad-b707-338de5f33e58/b6c5425d-2c14-5aad-b707-338de5f33e58_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F09bee22039cc4f37aa7758f457cd3988%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/7.jpg saved to cache
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6c5425d-2c14-5aad-b707-338de5f33e58
2026-03-27 16:48:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6c5425d-2c14-5aad-b707-338de5f33e58, skipping ID generation
2026-03-27 16:48:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6c5425d-2c14-5aad-b707-338de5f33e58 with scrape type 1
2026-03-27 16:48:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6c5425d-2c14-5aad-b707-338de5f33e58 sending to next pipeline
2026-03-27 16:48:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b6c5425d-2c14-5aad-b707-338de5f33e58, identifier: 1988318
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd8450>
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dc83a3-11c6-54d4-ab85-fd836af58dd0/b0dc83a3-11c6-54d4-ab85-fd836af58dd0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F5fee6d68d082487d9fe0a99a52e99a22%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/5.jpg saved to cache
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0dc83a3-11c6-54d4-ab85-fd836af58dd0
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b59610>
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dc83a3-11c6-54d4-ab85-fd836af58dd0/b0dc83a3-11c6-54d4-ab85-fd836af58dd0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F5fee6d68d082487d9fe0a99a52e99a22%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/3.jpg saved to cache
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0dc83a3-11c6-54d4-ab85-fd836af58dd0
2026-03-27 16:48:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b6c5425d-2c14-5aad-b707-338de5f33e58 with identifier: 1988318
2026-03-27 16:48:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b6c5425d-2c14-5aad-b707-338de5f33e58 with identifier: 1988318
2026-03-27 16:48:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b6c5425d-2c14-5aad-b707-338de5f33e58 with identifier: 1988318 to the API
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 31,
'color': 'NOIR PERLA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'b6c5425d-2c14-5aad-b707-338de5f33e58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 132085,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6c5425d-2c14-5aad-b707-338de5f33e58/b6c5425d-2c14-5aad-b707-338de5f33e58_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 413262,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6c5425d-2c14-5aad-b707-338de5f33e58/b6c5425d-2c14-5aad-b707-338de5f33e58_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 413262,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6c5425d-2c14-5aad-b707-338de5f33e58/b6c5425d-2c14-5aad-b707-338de5f33e58_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481600,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6c5425d-2c14-5aad-b707-338de5f33e58/b6c5425d-2c14-5aad-b707-338de5f33e58_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403257,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6c5425d-2c14-5aad-b707-338de5f33e58/b6c5425d-2c14-5aad-b707-338de5f33e58_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439098,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6c5425d-2c14-5aad-b707-338de5f33e58/b6c5425d-2c14-5aad-b707-338de5f33e58_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325485,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6c5425d-2c14-5aad-b707-338de5f33e58/b6c5425d-2c14-5aad-b707-338de5f33e58_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342625,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6c5425d-2c14-5aad-b707-338de5f33e58/b6c5425d-2c14-5aad-b707-338de5f33e58_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330742,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/09bee22039cc4f37aa7758f457cd3988/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-07',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 Plug-in Hybrid 225ch Allure Pack e-EAT8',
'transmission': 'automatic',
'trim': '3008 Plug-in Hybrid 225ch Allure Pack e-EAT8',
'vin': None,
'year': 2022}
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988318%27 HTTP/1.1" 200 None
2026-03-27 16:48:24 [ayvens.fr] INFO: Saving data for 1988318: {'created_time': 1774630104.455684, 'last_price_update_time': 1774630104.455695, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988318') HTTP/1.1" 204 0
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F6b78bd178c1b4a30887434725109514d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/2.jpg not downloaded yet
2026-03-27 16:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F6b78bd178c1b4a30887434725109514d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/3.jpg not downloaded yet
2026-03-27 16:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F6b78bd178c1b4a30887434725109514d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/4.jpg not downloaded yet
2026-03-27 16:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F6b78bd178c1b4a30887434725109514d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/5.jpg not downloaded yet
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F6b78bd178c1b4a30887434725109514d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/6.jpg not downloaded yet
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F6b78bd178c1b4a30887434725109514d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/7.jpg not downloaded yet
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F6b78bd178c1b4a30887434725109514d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/8.jpg not downloaded yet
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b05e50>
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ca57b8-881e-532c-9a70-db95307c0ce9/52ca57b8-881e-532c-9a70-db95307c0ce9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F379cb3c4595f4cae9165d9328b71990c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/5.jpg saved to cache
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 52ca57b8-881e-532c-9a70-db95307c0ce9
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b52a10>
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ca57b8-881e-532c-9a70-db95307c0ce9/52ca57b8-881e-532c-9a70-db95307c0ce9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F379cb3c4595f4cae9165d9328b71990c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/1.jpg saved to cache
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52ca57b8-881e-532c-9a70-db95307c0ce9
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e09fd0>
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dc83a3-11c6-54d4-ab85-fd836af58dd0/b0dc83a3-11c6-54d4-ab85-fd836af58dd0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F5fee6d68d082487d9fe0a99a52e99a22%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/7.jpg saved to cache
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0dc83a3-11c6-54d4-ab85-fd836af58dd0
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b53690>
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ca57b8-881e-532c-9a70-db95307c0ce9/52ca57b8-881e-532c-9a70-db95307c0ce9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F379cb3c4595f4cae9165d9328b71990c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/4.jpg saved to cache
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 52ca57b8-881e-532c-9a70-db95307c0ce9
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f12b90>
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ca57b8-881e-532c-9a70-db95307c0ce9/52ca57b8-881e-532c-9a70-db95307c0ce9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F379cb3c4595f4cae9165d9328b71990c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/3.jpg saved to cache
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 52ca57b8-881e-532c-9a70-db95307c0ce9
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068ea50>
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ca57b8-881e-532c-9a70-db95307c0ce9/52ca57b8-881e-532c-9a70-db95307c0ce9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F379cb3c4595f4cae9165d9328b71990c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/2.jpg saved to cache
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 52ca57b8-881e-532c-9a70-db95307c0ce9
2026-03-27 16:48:24 [ayvens.fr] INFO: Found listing with ID: 1988322
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988322%27 HTTP/1.1" 200 None
2026-03-27 16:48:24 [ayvens.fr] INFO: Scrape type for 1988322: 1
2026-03-27 16:48:24 [ayvens.fr] INFO: Extracting data for car ID: 1988322
2026-03-27 16:48:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54de2d27-b1c5-57eb-a1a6-35983f8a5800 with identifier: 1988322
2026-03-27 16:48:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54de2d27-b1c5-57eb-a1a6-35983f8a5800 with scrape type 1
2026-03-27 16:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 54de2d27-b1c5-57eb-a1a6-35983f8a5800
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F6e6412d16c364fdb9ba712259a7a6922%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/1.jpg not downloaded yet
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592c39090>
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dc83a3-11c6-54d4-ab85-fd836af58dd0/b0dc83a3-11c6-54d4-ab85-fd836af58dd0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F5fee6d68d082487d9fe0a99a52e99a22%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/8.jpg saved to cache
2026-03-27 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0dc83a3-11c6-54d4-ab85-fd836af58dd0
2026-03-27 16:48:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0dc83a3-11c6-54d4-ab85-fd836af58dd0, skipping ID generation
2026-03-27 16:48:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0dc83a3-11c6-54d4-ab85-fd836af58dd0 with scrape type 1
2026-03-27 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0dc83a3-11c6-54d4-ab85-fd836af58dd0 sending to next pipeline
2026-03-27 16:48:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b0dc83a3-11c6-54d4-ab85-fd836af58dd0, identifier: 1988319
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F6e6412d16c364fdb9ba712259a7a6922%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/2.jpg not downloaded yet
2026-03-27 16:48:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b0dc83a3-11c6-54d4-ab85-fd836af58dd0 with identifier: 1988319
2026-03-27 16:48:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b0dc83a3-11c6-54d4-ab85-fd836af58dd0 with identifier: 1988319
2026-03-27 16:48:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b0dc83a3-11c6-54d4-ab85-fd836af58dd0 with identifier: 1988319 to the API
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'GRIS TITANIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'b0dc83a3-11c6-54d4-ab85-fd836af58dd0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 137124,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dc83a3-11c6-54d4-ab85-fd836af58dd0/b0dc83a3-11c6-54d4-ab85-fd836af58dd0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327805,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dc83a3-11c6-54d4-ab85-fd836af58dd0/b0dc83a3-11c6-54d4-ab85-fd836af58dd0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327805,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dc83a3-11c6-54d4-ab85-fd836af58dd0/b0dc83a3-11c6-54d4-ab85-fd836af58dd0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299657,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dc83a3-11c6-54d4-ab85-fd836af58dd0/b0dc83a3-11c6-54d4-ab85-fd836af58dd0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341007,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dc83a3-11c6-54d4-ab85-fd836af58dd0/b0dc83a3-11c6-54d4-ab85-fd836af58dd0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362079,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dc83a3-11c6-54d4-ab85-fd836af58dd0/b0dc83a3-11c6-54d4-ab85-fd836af58dd0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352058,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dc83a3-11c6-54d4-ab85-fd836af58dd0/b0dc83a3-11c6-54d4-ab85-fd836af58dd0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350206,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dc83a3-11c6-54d4-ab85-fd836af58dd0/b0dc83a3-11c6-54d4-ab85-fd836af58dd0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415779,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/5fee6d68d082487d9fe0a99a52e99a22/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-15',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE Megane 1.5 Blue dCi 115ch Business Intens',
'transmission': 'manual',
'trim': 'Megane 1.5 Blue dCi 115ch Business Intens',
'vin': None,
'year': 2021}
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988319%27 HTTP/1.1" 200 None
2026-03-27 16:48:25 [ayvens.fr] INFO: Saving data for 1988319: {'created_time': 1774630105.511666, 'last_price_update_time': 1774630105.511677, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988319') HTTP/1.1" 204 0
2026-03-27 16:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F6e6412d16c364fdb9ba712259a7a6922%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/3.jpg not downloaded yet
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa37d0>
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ca57b8-881e-532c-9a70-db95307c0ce9/52ca57b8-881e-532c-9a70-db95307c0ce9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F379cb3c4595f4cae9165d9328b71990c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/6.jpg saved to cache
2026-03-27 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 52ca57b8-881e-532c-9a70-db95307c0ce9
2026-03-27 16:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F6e6412d16c364fdb9ba712259a7a6922%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/4.jpg not downloaded yet
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F6e6412d16c364fdb9ba712259a7a6922%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/5.jpg not downloaded yet
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F6e6412d16c364fdb9ba712259a7a6922%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/6.jpg not downloaded yet
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591446bd0>
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde4272e-43df-5cdb-837c-1a347a871921/dde4272e-43df-5cdb-837c-1a347a871921_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F6b78bd178c1b4a30887434725109514d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/1.jpg saved to cache
2026-03-27 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dde4272e-43df-5cdb-837c-1a347a871921
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4d6d0>
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ca57b8-881e-532c-9a70-db95307c0ce9/52ca57b8-881e-532c-9a70-db95307c0ce9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F379cb3c4595f4cae9165d9328b71990c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/8.jpg saved to cache
2026-03-27 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 52ca57b8-881e-532c-9a70-db95307c0ce9
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a2690>
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde4272e-43df-5cdb-837c-1a347a871921/dde4272e-43df-5cdb-837c-1a347a871921_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F6b78bd178c1b4a30887434725109514d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/2.jpg saved to cache
2026-03-27 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dde4272e-43df-5cdb-837c-1a347a871921
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F6e6412d16c364fdb9ba712259a7a6922%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/7.jpg not downloaded yet
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F6e6412d16c364fdb9ba712259a7a6922%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/8.jpg not downloaded yet
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59064fad0>
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde4272e-43df-5cdb-837c-1a347a871921/dde4272e-43df-5cdb-837c-1a347a871921_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F6b78bd178c1b4a30887434725109514d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/3.jpg saved to cache
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dde4272e-43df-5cdb-837c-1a347a871921
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590590d10>
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde4272e-43df-5cdb-837c-1a347a871921/dde4272e-43df-5cdb-837c-1a347a871921_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F6b78bd178c1b4a30887434725109514d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/4.jpg saved to cache
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dde4272e-43df-5cdb-837c-1a347a871921
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b49490>
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde4272e-43df-5cdb-837c-1a347a871921/dde4272e-43df-5cdb-837c-1a347a871921_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F6b78bd178c1b4a30887434725109514d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/6.jpg saved to cache
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dde4272e-43df-5cdb-837c-1a347a871921
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c0cd0>
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ca57b8-881e-532c-9a70-db95307c0ce9/52ca57b8-881e-532c-9a70-db95307c0ce9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F379cb3c4595f4cae9165d9328b71990c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/7.jpg saved to cache
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 52ca57b8-881e-532c-9a70-db95307c0ce9
2026-03-27 16:48:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 52ca57b8-881e-532c-9a70-db95307c0ce9, skipping ID generation
2026-03-27 16:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52ca57b8-881e-532c-9a70-db95307c0ce9 with scrape type 1
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52ca57b8-881e-532c-9a70-db95307c0ce9 sending to next pipeline
2026-03-27 16:48:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 52ca57b8-881e-532c-9a70-db95307c0ce9, identifier: 1988320
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59063d690>
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde4272e-43df-5cdb-837c-1a347a871921/dde4272e-43df-5cdb-837c-1a347a871921_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F6b78bd178c1b4a30887434725109514d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/5.jpg saved to cache
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dde4272e-43df-5cdb-837c-1a347a871921
2026-03-27 16:48:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 52ca57b8-881e-532c-9a70-db95307c0ce9 with identifier: 1988320
2026-03-27 16:48:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:48:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 52ca57b8-881e-532c-9a70-db95307c0ce9 with identifier: 1988320
2026-03-27 16:48:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 52ca57b8-881e-532c-9a70-db95307c0ce9 with identifier: 1988320 to the API
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 102,
'color': 'GRIS ALUMINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '52ca57b8-881e-532c-9a70-db95307c0ce9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'COROLLA',
'odometer': 83911,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ca57b8-881e-532c-9a70-db95307c0ce9/52ca57b8-881e-532c-9a70-db95307c0ce9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353820,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ca57b8-881e-532c-9a70-db95307c0ce9/52ca57b8-881e-532c-9a70-db95307c0ce9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353820,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ca57b8-881e-532c-9a70-db95307c0ce9/52ca57b8-881e-532c-9a70-db95307c0ce9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372835,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ca57b8-881e-532c-9a70-db95307c0ce9/52ca57b8-881e-532c-9a70-db95307c0ce9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343359,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ca57b8-881e-532c-9a70-db95307c0ce9/52ca57b8-881e-532c-9a70-db95307c0ce9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308555,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ca57b8-881e-532c-9a70-db95307c0ce9/52ca57b8-881e-532c-9a70-db95307c0ce9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327467,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ca57b8-881e-532c-9a70-db95307c0ce9/52ca57b8-881e-532c-9a70-db95307c0ce9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290279,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ca57b8-881e-532c-9a70-db95307c0ce9/52ca57b8-881e-532c-9a70-db95307c0ce9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370474,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/379cb3c4595f4cae9165d9328b71990c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-24',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA COROLLA Corolla 122h Dynamic Business + Programme "Beyond '
'Zero Academy"',
'transmission': 'automatic',
'trim': 'Corolla 122h Dynamic Business + Programme "Beyond Zero Academy"',
'vin': None,
'year': 2022}
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988320%27 HTTP/1.1" 200 None
2026-03-27 16:48:26 [ayvens.fr] INFO: Saving data for 1988320: {'created_time': 1774630106.705845, 'last_price_update_time': 1774630106.705856, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988320') HTTP/1.1" 204 0
2026-03-27 16:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:26 [ayvens.fr] INFO: Found listing with ID: 1988323
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988323%27 HTTP/1.1" 200 None
2026-03-27 16:48:26 [ayvens.fr] INFO: Scrape type for 1988323: 1
2026-03-27 16:48:26 [ayvens.fr] INFO: Extracting data for car ID: 1988323
2026-03-27 16:48:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55566650-e864-5800-bee9-6f253cdd14ff with identifier: 1988323
2026-03-27 16:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55566650-e864-5800-bee9-6f253cdd14ff with scrape type 1
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 55566650-e864-5800-bee9-6f253cdd14ff
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Faa6fe1e899104cdc9e7c66481c46de52%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/1.jpg not downloaded yet
2026-03-27 16:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Faa6fe1e899104cdc9e7c66481c46de52%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/2.jpg not downloaded yet
2026-03-27 16:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Faa6fe1e899104cdc9e7c66481c46de52%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/3.jpg not downloaded yet
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Faa6fe1e899104cdc9e7c66481c46de52%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/4.jpg not downloaded yet
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Faa6fe1e899104cdc9e7c66481c46de52%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/5.jpg not downloaded yet
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Faa6fe1e899104cdc9e7c66481c46de52%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/6.jpg not downloaded yet
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ddbd50>
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde4272e-43df-5cdb-837c-1a347a871921/dde4272e-43df-5cdb-837c-1a347a871921_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F6b78bd178c1b4a30887434725109514d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/8.jpg saved to cache
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dde4272e-43df-5cdb-837c-1a347a871921
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Faa6fe1e899104cdc9e7c66481c46de52%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/7.jpg not downloaded yet
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4cc50>
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde4272e-43df-5cdb-837c-1a347a871921/dde4272e-43df-5cdb-837c-1a347a871921_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F6b78bd178c1b4a30887434725109514d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/7.jpg saved to cache
2026-03-27 16:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dde4272e-43df-5cdb-837c-1a347a871921
2026-03-27 16:48:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dde4272e-43df-5cdb-837c-1a347a871921, skipping ID generation
2026-03-27 16:48:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dde4272e-43df-5cdb-837c-1a347a871921 with scrape type 1
2026-03-27 16:48:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dde4272e-43df-5cdb-837c-1a347a871921 sending to next pipeline
2026-03-27 16:48:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: dde4272e-43df-5cdb-837c-1a347a871921, identifier: 1988321
2026-03-27 16:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4d410>
2026-03-27 16:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54de2d27-b1c5-57eb-a1a6-35983f8a5800/54de2d27-b1c5-57eb-a1a6-35983f8a5800_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F6e6412d16c364fdb9ba712259a7a6922%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/1.jpg saved to cache
2026-03-27 16:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54de2d27-b1c5-57eb-a1a6-35983f8a5800
2026-03-27 16:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590511f90>
2026-03-27 16:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54de2d27-b1c5-57eb-a1a6-35983f8a5800/54de2d27-b1c5-57eb-a1a6-35983f8a5800_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F6e6412d16c364fdb9ba712259a7a6922%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/3.jpg saved to cache
2026-03-27 16:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54de2d27-b1c5-57eb-a1a6-35983f8a5800
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Faa6fe1e899104cdc9e7c66481c46de52%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/8.jpg not downloaded yet
2026-03-27 16:48:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: dde4272e-43df-5cdb-837c-1a347a871921 with identifier: 1988321
2026-03-27 16:48:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: dde4272e-43df-5cdb-837c-1a347a871921 with identifier: 1988321
2026-03-27 16:48:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: dde4272e-43df-5cdb-837c-1a347a871921 with identifier: 1988321 to the API
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'dde4272e-43df-5cdb-837c-1a347a871921',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'HONDA',
'model': 'ZR-V',
'odometer': 23293,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dde4272e-43df-5cdb-837c-1a347a871921/dde4272e-43df-5cdb-837c-1a347a871921_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311053,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dde4272e-43df-5cdb-837c-1a347a871921/dde4272e-43df-5cdb-837c-1a347a871921_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311053,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dde4272e-43df-5cdb-837c-1a347a871921/dde4272e-43df-5cdb-837c-1a347a871921_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333025,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dde4272e-43df-5cdb-837c-1a347a871921/dde4272e-43df-5cdb-837c-1a347a871921_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279425,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dde4272e-43df-5cdb-837c-1a347a871921/dde4272e-43df-5cdb-837c-1a347a871921_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336545,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dde4272e-43df-5cdb-837c-1a347a871921/dde4272e-43df-5cdb-837c-1a347a871921_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321380,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dde4272e-43df-5cdb-837c-1a347a871921/dde4272e-43df-5cdb-837c-1a347a871921_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280920,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dde4272e-43df-5cdb-837c-1a347a871921/dde4272e-43df-5cdb-837c-1a347a871921_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319017,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/6b78bd178c1b4a30887434725109514d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-21',
'seats_number': 5,
'seller_name': None,
'title': 'HONDA ZR-V ZR-V 2.0 i-MMD 184ch e:HEV Advance MY24',
'transmission': 'automatic',
'trim': 'ZR-V 2.0 i-MMD 184ch e:HEV Advance MY24',
'vin': None,
'year': 2024}
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988321%27 HTTP/1.1" 200 None
2026-03-27 16:48:27 [ayvens.fr] INFO: Saving data for 1988321: {'created_time': 1774630107.692389, 'last_price_update_time': 1774630107.692406, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988321') HTTP/1.1" 204 0
2026-03-27 16:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:27 [ayvens.fr] INFO: Found listing with ID: 1988324
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988324%27 HTTP/1.1" 200 None
2026-03-27 16:48:27 [ayvens.fr] INFO: Scrape type for 1988324: 1
2026-03-27 16:48:27 [ayvens.fr] INFO: Extracting data for car ID: 1988324
2026-03-27 16:48:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccb1ae07-4cc4-536e-8478-910b727e1dc5 with identifier: 1988324
2026-03-27 16:48:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccb1ae07-4cc4-536e-8478-910b727e1dc5 with scrape type 1
2026-03-27 16:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ccb1ae07-4cc4-536e-8478-910b727e1dc5
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fe9f04517a7ea4bc0b437ad62934a302a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/1.jpg not downloaded yet
2026-03-27 16:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d58d50>
2026-03-27 16:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54de2d27-b1c5-57eb-a1a6-35983f8a5800/54de2d27-b1c5-57eb-a1a6-35983f8a5800_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F6e6412d16c364fdb9ba712259a7a6922%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/4.jpg saved to cache
2026-03-27 16:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54de2d27-b1c5-57eb-a1a6-35983f8a5800
2026-03-27 16:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59103dc10>
2026-03-27 16:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54de2d27-b1c5-57eb-a1a6-35983f8a5800/54de2d27-b1c5-57eb-a1a6-35983f8a5800_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F6e6412d16c364fdb9ba712259a7a6922%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/2.jpg saved to cache
2026-03-27 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54de2d27-b1c5-57eb-a1a6-35983f8a5800
2026-03-27 16:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d7b9d0>
2026-03-27 16:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54de2d27-b1c5-57eb-a1a6-35983f8a5800/54de2d27-b1c5-57eb-a1a6-35983f8a5800_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F6e6412d16c364fdb9ba712259a7a6922%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/5.jpg saved to cache
2026-03-27 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54de2d27-b1c5-57eb-a1a6-35983f8a5800
2026-03-27 16:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59103c690>
2026-03-27 16:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54de2d27-b1c5-57eb-a1a6-35983f8a5800/54de2d27-b1c5-57eb-a1a6-35983f8a5800_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F6e6412d16c364fdb9ba712259a7a6922%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/6.jpg saved to cache
2026-03-27 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54de2d27-b1c5-57eb-a1a6-35983f8a5800
2026-03-27 16:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fe9f04517a7ea4bc0b437ad62934a302a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/2.jpg not downloaded yet
2026-03-27 16:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fe9f04517a7ea4bc0b437ad62934a302a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/3.jpg not downloaded yet
2026-03-27 16:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592d55d10>
2026-03-27 16:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54de2d27-b1c5-57eb-a1a6-35983f8a5800/54de2d27-b1c5-57eb-a1a6-35983f8a5800_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F6e6412d16c364fdb9ba712259a7a6922%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/7.jpg saved to cache
2026-03-27 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54de2d27-b1c5-57eb-a1a6-35983f8a5800
2026-03-27 16:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fe9f04517a7ea4bc0b437ad62934a302a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/4.jpg not downloaded yet
2026-03-27 16:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fe9f04517a7ea4bc0b437ad62934a302a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/5.jpg not downloaded yet
2026-03-27 16:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d6f910>
2026-03-27 16:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54de2d27-b1c5-57eb-a1a6-35983f8a5800/54de2d27-b1c5-57eb-a1a6-35983f8a5800_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F6e6412d16c364fdb9ba712259a7a6922%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/8.jpg saved to cache
2026-03-27 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54de2d27-b1c5-57eb-a1a6-35983f8a5800
2026-03-27 16:48:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54de2d27-b1c5-57eb-a1a6-35983f8a5800, skipping ID generation
2026-03-27 16:48:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54de2d27-b1c5-57eb-a1a6-35983f8a5800 with scrape type 1
2026-03-27 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54de2d27-b1c5-57eb-a1a6-35983f8a5800 sending to next pipeline
2026-03-27 16:48:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 54de2d27-b1c5-57eb-a1a6-35983f8a5800, identifier: 1988322
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fe9f04517a7ea4bc0b437ad62934a302a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/6.jpg not downloaded yet
2026-03-27 16:48:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 54de2d27-b1c5-57eb-a1a6-35983f8a5800 with identifier: 1988322
2026-03-27 16:48:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 54de2d27-b1c5-57eb-a1a6-35983f8a5800 with identifier: 1988322
2026-03-27 16:48:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 54de2d27-b1c5-57eb-a1a6-35983f8a5800 with identifier: 1988322 to the API
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '54de2d27-b1c5-57eb-a1a6-35983f8a5800',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 103048,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54de2d27-b1c5-57eb-a1a6-35983f8a5800/54de2d27-b1c5-57eb-a1a6-35983f8a5800_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314149,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54de2d27-b1c5-57eb-a1a6-35983f8a5800/54de2d27-b1c5-57eb-a1a6-35983f8a5800_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314149,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54de2d27-b1c5-57eb-a1a6-35983f8a5800/54de2d27-b1c5-57eb-a1a6-35983f8a5800_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303189,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54de2d27-b1c5-57eb-a1a6-35983f8a5800/54de2d27-b1c5-57eb-a1a6-35983f8a5800_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302657,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54de2d27-b1c5-57eb-a1a6-35983f8a5800/54de2d27-b1c5-57eb-a1a6-35983f8a5800_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324488,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54de2d27-b1c5-57eb-a1a6-35983f8a5800/54de2d27-b1c5-57eb-a1a6-35983f8a5800_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322314,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54de2d27-b1c5-57eb-a1a6-35983f8a5800/54de2d27-b1c5-57eb-a1a6-35983f8a5800_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323281,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54de2d27-b1c5-57eb-a1a6-35983f8a5800/54de2d27-b1c5-57eb-a1a6-35983f8a5800_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338768,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/6e6412d16c364fdb9ba712259a7a6922/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-21',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 PureTech 110ch Feel S&S EAT6',
'transmission': 'automatic',
'trim': 'C3 PureTech 110ch Feel S&S EAT6',
'vin': None,
'year': 2019}
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988322%27 HTTP/1.1" 200 None
2026-03-27 16:48:28 [ayvens.fr] INFO: Saving data for 1988322: {'created_time': 1774630108.989736, 'last_price_update_time': 1774630108.989747, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988322') HTTP/1.1" 204 0
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59067d410>
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55566650-e864-5800-bee9-6f253cdd14ff/55566650-e864-5800-bee9-6f253cdd14ff_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Faa6fe1e899104cdc9e7c66481c46de52%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/3.jpg saved to cache
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55566650-e864-5800-bee9-6f253cdd14ff
2026-03-27 16:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fe9f04517a7ea4bc0b437ad62934a302a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/7.jpg not downloaded yet
2026-03-27 16:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee2e90>
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55566650-e864-5800-bee9-6f253cdd14ff/55566650-e864-5800-bee9-6f253cdd14ff_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Faa6fe1e899104cdc9e7c66481c46de52%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/4.jpg saved to cache
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55566650-e864-5800-bee9-6f253cdd14ff
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590affb90>
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55566650-e864-5800-bee9-6f253cdd14ff/55566650-e864-5800-bee9-6f253cdd14ff_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Faa6fe1e899104cdc9e7c66481c46de52%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/5.jpg saved to cache
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55566650-e864-5800-bee9-6f253cdd14ff
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a2b10>
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55566650-e864-5800-bee9-6f253cdd14ff/55566650-e864-5800-bee9-6f253cdd14ff_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Faa6fe1e899104cdc9e7c66481c46de52%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/1.jpg saved to cache
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55566650-e864-5800-bee9-6f253cdd14ff
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b6bd90>
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55566650-e864-5800-bee9-6f253cdd14ff/55566650-e864-5800-bee9-6f253cdd14ff_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Faa6fe1e899104cdc9e7c66481c46de52%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/2.jpg saved to cache
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55566650-e864-5800-bee9-6f253cdd14ff
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59307f810>
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55566650-e864-5800-bee9-6f253cdd14ff/55566650-e864-5800-bee9-6f253cdd14ff_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Faa6fe1e899104cdc9e7c66481c46de52%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/6.jpg saved to cache
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55566650-e864-5800-bee9-6f253cdd14ff
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fe9f04517a7ea4bc0b437ad62934a302a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/8.jpg not downloaded yet
2026-03-27 16:48:29 [ayvens.fr] INFO: Found listing with ID: 1988325
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988325%27 HTTP/1.1" 200 None
2026-03-27 16:48:29 [ayvens.fr] INFO: Scrape type for 1988325: 1
2026-03-27 16:48:29 [ayvens.fr] INFO: Extracting data for car ID: 1988325
2026-03-27 16:48:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f318d02-14ef-5c4d-ac69-c99cf71eaa71 with identifier: 1988325
2026-03-27 16:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f318d02-14ef-5c4d-ac69-c99cf71eaa71 with scrape type 1
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 9f318d02-14ef-5c4d-ac69-c99cf71eaa71
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fee1c409ff7f344698bcab3d110e80d73%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/1.jpg not downloaded yet
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ac7650>
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55566650-e864-5800-bee9-6f253cdd14ff/55566650-e864-5800-bee9-6f253cdd14ff_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Faa6fe1e899104cdc9e7c66481c46de52%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/7.jpg saved to cache
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55566650-e864-5800-bee9-6f253cdd14ff
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068f110>
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55566650-e864-5800-bee9-6f253cdd14ff/55566650-e864-5800-bee9-6f253cdd14ff_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Faa6fe1e899104cdc9e7c66481c46de52%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/8.jpg saved to cache
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55566650-e864-5800-bee9-6f253cdd14ff
2026-03-27 16:48:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55566650-e864-5800-bee9-6f253cdd14ff, skipping ID generation
2026-03-27 16:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55566650-e864-5800-bee9-6f253cdd14ff with scrape type 1
2026-03-27 16:48:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55566650-e864-5800-bee9-6f253cdd14ff sending to next pipeline
2026-03-27 16:48:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 55566650-e864-5800-bee9-6f253cdd14ff, identifier: 1988323
2026-03-27 16:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 55566650-e864-5800-bee9-6f253cdd14ff with identifier: 1988323
2026-03-27 16:48:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 55566650-e864-5800-bee9-6f253cdd14ff with identifier: 1988323
2026-03-27 16:48:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 55566650-e864-5800-bee9-6f253cdd14ff with identifier: 1988323 to the API
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '55566650-e864-5800-bee9-6f253cdd14ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 101852,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55566650-e864-5800-bee9-6f253cdd14ff/55566650-e864-5800-bee9-6f253cdd14ff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 604540,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55566650-e864-5800-bee9-6f253cdd14ff/55566650-e864-5800-bee9-6f253cdd14ff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 604540,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55566650-e864-5800-bee9-6f253cdd14ff/55566650-e864-5800-bee9-6f253cdd14ff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485470,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55566650-e864-5800-bee9-6f253cdd14ff/55566650-e864-5800-bee9-6f253cdd14ff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55566650-e864-5800-bee9-6f253cdd14ff/55566650-e864-5800-bee9-6f253cdd14ff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441277,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55566650-e864-5800-bee9-6f253cdd14ff/55566650-e864-5800-bee9-6f253cdd14ff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376804,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55566650-e864-5800-bee9-6f253cdd14ff/55566650-e864-5800-bee9-6f253cdd14ff_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 259523,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55566650-e864-5800-bee9-6f253cdd14ff/55566650-e864-5800-bee9-6f253cdd14ff_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281022,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/aa6fe1e899104cdc9e7c66481c46de52/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-02',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 SW 308 SW 1.2 PureTech 130ch S&S Allure Business',
'transmission': 'manual',
'trim': '308 SW 1.2 PureTech 130ch S&S Allure Business',
'vin': None,
'year': 2020}
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988323%27 HTTP/1.1" 200 None
2026-03-27 16:48:30 [ayvens.fr] INFO: Saving data for 1988323: {'created_time': 1774630110.349731, 'last_price_update_time': 1774630110.349746, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988323') HTTP/1.1" 204 0
2026-03-27 16:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fee1c409ff7f344698bcab3d110e80d73%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/2.jpg not downloaded yet
2026-03-27 16:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fee1c409ff7f344698bcab3d110e80d73%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/3.jpg not downloaded yet
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591051cd0>
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccb1ae07-4cc4-536e-8478-910b727e1dc5/ccb1ae07-4cc4-536e-8478-910b727e1dc5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fe9f04517a7ea4bc0b437ad62934a302a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/1.jpg saved to cache
2026-03-27 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ccb1ae07-4cc4-536e-8478-910b727e1dc5
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051e050>
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccb1ae07-4cc4-536e-8478-910b727e1dc5/ccb1ae07-4cc4-536e-8478-910b727e1dc5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fe9f04517a7ea4bc0b437ad62934a302a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/2.jpg saved to cache
2026-03-27 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ccb1ae07-4cc4-536e-8478-910b727e1dc5
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065d410>
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccb1ae07-4cc4-536e-8478-910b727e1dc5/ccb1ae07-4cc4-536e-8478-910b727e1dc5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fe9f04517a7ea4bc0b437ad62934a302a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/3.jpg saved to cache
2026-03-27 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ccb1ae07-4cc4-536e-8478-910b727e1dc5
2026-03-27 16:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fee1c409ff7f344698bcab3d110e80d73%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/4.jpg not downloaded yet
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fee1c409ff7f344698bcab3d110e80d73%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/5.jpg not downloaded yet
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59064d350>
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccb1ae07-4cc4-536e-8478-910b727e1dc5/ccb1ae07-4cc4-536e-8478-910b727e1dc5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fe9f04517a7ea4bc0b437ad62934a302a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/4.jpg saved to cache
2026-03-27 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ccb1ae07-4cc4-536e-8478-910b727e1dc5
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b743d0>
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccb1ae07-4cc4-536e-8478-910b727e1dc5/ccb1ae07-4cc4-536e-8478-910b727e1dc5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fe9f04517a7ea4bc0b437ad62934a302a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/5.jpg saved to cache
2026-03-27 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ccb1ae07-4cc4-536e-8478-910b727e1dc5
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fee1c409ff7f344698bcab3d110e80d73%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/6.jpg not downloaded yet
2026-03-27 16:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fee1c409ff7f344698bcab3d110e80d73%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/7.jpg not downloaded yet
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068edd0>
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccb1ae07-4cc4-536e-8478-910b727e1dc5/ccb1ae07-4cc4-536e-8478-910b727e1dc5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fe9f04517a7ea4bc0b437ad62934a302a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/7.jpg saved to cache
2026-03-27 16:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ccb1ae07-4cc4-536e-8478-910b727e1dc5
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c3c90>
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccb1ae07-4cc4-536e-8478-910b727e1dc5/ccb1ae07-4cc4-536e-8478-910b727e1dc5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fe9f04517a7ea4bc0b437ad62934a302a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/6.jpg saved to cache
2026-03-27 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ccb1ae07-4cc4-536e-8478-910b727e1dc5
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fee1c409ff7f344698bcab3d110e80d73%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/8.jpg not downloaded yet
2026-03-27 16:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:31 [ayvens.fr] INFO: Found listing with ID: 1988326
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988326%27 HTTP/1.1" 200 None
2026-03-27 16:48:31 [ayvens.fr] INFO: Scrape type for 1988326: 1
2026-03-27 16:48:31 [ayvens.fr] INFO: Extracting data for car ID: 1988326
2026-03-27 16:48:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54d408db-f25d-5e27-b70f-a017b4d7d251 with identifier: 1988326
2026-03-27 16:48:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54d408db-f25d-5e27-b70f-a017b4d7d251 with scrape type 1
2026-03-27 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 54d408db-f25d-5e27-b70f-a017b4d7d251
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F969362ab298347f7916ad9c5af677a41%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/1.jpg not downloaded yet
2026-03-27 16:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591052590>
2026-03-27 16:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f318d02-14ef-5c4d-ac69-c99cf71eaa71/9f318d02-14ef-5c4d-ac69-c99cf71eaa71_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fee1c409ff7f344698bcab3d110e80d73%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/1.jpg saved to cache
2026-03-27 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f318d02-14ef-5c4d-ac69-c99cf71eaa71
2026-03-27 16:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d5b190>
2026-03-27 16:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccb1ae07-4cc4-536e-8478-910b727e1dc5/ccb1ae07-4cc4-536e-8478-910b727e1dc5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fe9f04517a7ea4bc0b437ad62934a302a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/8.jpg saved to cache
2026-03-27 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ccb1ae07-4cc4-536e-8478-910b727e1dc5
2026-03-27 16:48:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ccb1ae07-4cc4-536e-8478-910b727e1dc5, skipping ID generation
2026-03-27 16:48:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccb1ae07-4cc4-536e-8478-910b727e1dc5 with scrape type 1
2026-03-27 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ccb1ae07-4cc4-536e-8478-910b727e1dc5 sending to next pipeline
2026-03-27 16:48:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ccb1ae07-4cc4-536e-8478-910b727e1dc5, identifier: 1988324
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F969362ab298347f7916ad9c5af677a41%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/2.jpg not downloaded yet
2026-03-27 16:48:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ccb1ae07-4cc4-536e-8478-910b727e1dc5 with identifier: 1988324
2026-03-27 16:48:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ccb1ae07-4cc4-536e-8478-910b727e1dc5 with identifier: 1988324
2026-03-27 16:48:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ccb1ae07-4cc4-536e-8478-910b727e1dc5 with identifier: 1988324 to the API
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 87,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'ccb1ae07-4cc4-536e-8478-910b727e1dc5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS HYBRID',
'odometer': 106705,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccb1ae07-4cc4-536e-8478-910b727e1dc5/ccb1ae07-4cc4-536e-8478-910b727e1dc5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccb1ae07-4cc4-536e-8478-910b727e1dc5/ccb1ae07-4cc4-536e-8478-910b727e1dc5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccb1ae07-4cc4-536e-8478-910b727e1dc5/ccb1ae07-4cc4-536e-8478-910b727e1dc5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434942,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccb1ae07-4cc4-536e-8478-910b727e1dc5/ccb1ae07-4cc4-536e-8478-910b727e1dc5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329992,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccb1ae07-4cc4-536e-8478-910b727e1dc5/ccb1ae07-4cc4-536e-8478-910b727e1dc5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314855,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccb1ae07-4cc4-536e-8478-910b727e1dc5/ccb1ae07-4cc4-536e-8478-910b727e1dc5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305533,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccb1ae07-4cc4-536e-8478-910b727e1dc5/ccb1ae07-4cc4-536e-8478-910b727e1dc5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305895,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccb1ae07-4cc4-536e-8478-910b727e1dc5/ccb1ae07-4cc4-536e-8478-910b727e1dc5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329277,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/e9f04517a7ea4bc0b437ad62934a302a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-10',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA YARIS HYBRID Yaris 116h Dynamic 5p',
'transmission': 'automatic',
'trim': 'Yaris 116h Dynamic 5p',
'vin': None,
'year': 2022}
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988324%27 HTTP/1.1" 200 None
2026-03-27 16:48:31 [ayvens.fr] INFO: Saving data for 1988324: {'created_time': 1774630111.779084, 'last_price_update_time': 1774630111.779096, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988324') HTTP/1.1" 204 0
2026-03-27 16:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F969362ab298347f7916ad9c5af677a41%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/3.jpg not downloaded yet
2026-03-27 16:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591444e50>
2026-03-27 16:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f318d02-14ef-5c4d-ac69-c99cf71eaa71/9f318d02-14ef-5c4d-ac69-c99cf71eaa71_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fee1c409ff7f344698bcab3d110e80d73%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/2.jpg saved to cache
2026-03-27 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f318d02-14ef-5c4d-ac69-c99cf71eaa71
2026-03-27 16:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065ef90>
2026-03-27 16:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f318d02-14ef-5c4d-ac69-c99cf71eaa71/9f318d02-14ef-5c4d-ac69-c99cf71eaa71_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fee1c409ff7f344698bcab3d110e80d73%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/3.jpg saved to cache
2026-03-27 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f318d02-14ef-5c4d-ac69-c99cf71eaa71
2026-03-27 16:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F969362ab298347f7916ad9c5af677a41%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/4.jpg not downloaded yet
2026-03-27 16:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F969362ab298347f7916ad9c5af677a41%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/5.jpg not downloaded yet
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efee50>
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f318d02-14ef-5c4d-ac69-c99cf71eaa71/9f318d02-14ef-5c4d-ac69-c99cf71eaa71_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fee1c409ff7f344698bcab3d110e80d73%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/5.jpg saved to cache
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f318d02-14ef-5c4d-ac69-c99cf71eaa71
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591209ed0>
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f318d02-14ef-5c4d-ac69-c99cf71eaa71/9f318d02-14ef-5c4d-ac69-c99cf71eaa71_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fee1c409ff7f344698bcab3d110e80d73%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/4.jpg saved to cache
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f318d02-14ef-5c4d-ac69-c99cf71eaa71
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F969362ab298347f7916ad9c5af677a41%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/6.jpg not downloaded yet
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F969362ab298347f7916ad9c5af677a41%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/7.jpg not downloaded yet
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2f290>
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f318d02-14ef-5c4d-ac69-c99cf71eaa71/9f318d02-14ef-5c4d-ac69-c99cf71eaa71_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fee1c409ff7f344698bcab3d110e80d73%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/6.jpg saved to cache
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f318d02-14ef-5c4d-ac69-c99cf71eaa71
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee0410>
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f318d02-14ef-5c4d-ac69-c99cf71eaa71/9f318d02-14ef-5c4d-ac69-c99cf71eaa71_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fee1c409ff7f344698bcab3d110e80d73%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/7.jpg saved to cache
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f318d02-14ef-5c4d-ac69-c99cf71eaa71
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a1110>
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f318d02-14ef-5c4d-ac69-c99cf71eaa71/9f318d02-14ef-5c4d-ac69-c99cf71eaa71_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fee1c409ff7f344698bcab3d110e80d73%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/8.jpg saved to cache
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f318d02-14ef-5c4d-ac69-c99cf71eaa71
2026-03-27 16:48:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f318d02-14ef-5c4d-ac69-c99cf71eaa71, skipping ID generation
2026-03-27 16:48:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f318d02-14ef-5c4d-ac69-c99cf71eaa71 with scrape type 1
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f318d02-14ef-5c4d-ac69-c99cf71eaa71 sending to next pipeline
2026-03-27 16:48:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9f318d02-14ef-5c4d-ac69-c99cf71eaa71, identifier: 1988325
2026-03-27 16:48:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9f318d02-14ef-5c4d-ac69-c99cf71eaa71 with identifier: 1988325
2026-03-27 16:48:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:48:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9f318d02-14ef-5c4d-ac69-c99cf71eaa71 with identifier: 1988325
2026-03-27 16:48:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9f318d02-14ef-5c4d-ac69-c99cf71eaa71 with identifier: 1988325 to the API
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'GRIS COSMIQUE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '9f318d02-14ef-5c4d-ac69-c99cf71eaa71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'NIRO EV',
'odometer': 12190,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f318d02-14ef-5c4d-ac69-c99cf71eaa71/9f318d02-14ef-5c4d-ac69-c99cf71eaa71_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316342,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f318d02-14ef-5c4d-ac69-c99cf71eaa71/9f318d02-14ef-5c4d-ac69-c99cf71eaa71_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316342,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f318d02-14ef-5c4d-ac69-c99cf71eaa71/9f318d02-14ef-5c4d-ac69-c99cf71eaa71_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348236,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f318d02-14ef-5c4d-ac69-c99cf71eaa71/9f318d02-14ef-5c4d-ac69-c99cf71eaa71_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336192,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f318d02-14ef-5c4d-ac69-c99cf71eaa71/9f318d02-14ef-5c4d-ac69-c99cf71eaa71_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307962,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f318d02-14ef-5c4d-ac69-c99cf71eaa71/9f318d02-14ef-5c4d-ac69-c99cf71eaa71_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319028,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f318d02-14ef-5c4d-ac69-c99cf71eaa71/9f318d02-14ef-5c4d-ac69-c99cf71eaa71_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 270483,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f318d02-14ef-5c4d-ac69-c99cf71eaa71/9f318d02-14ef-5c4d-ac69-c99cf71eaa71_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290181,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ee1c409ff7f344698bcab3d110e80d73/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-21',
'seats_number': 5,
'seller_name': None,
'title': 'KIA NIRO EV Niro EV 204ch Premium',
'transmission': 'automatic',
'trim': 'Niro EV 204ch Premium',
'vin': None,
'year': 2023}
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988325%27 HTTP/1.1" 200 None
2026-03-27 16:48:32 [ayvens.fr] INFO: Saving data for 1988325: {'created_time': 1774630112.821982, 'last_price_update_time': 1774630112.821997, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988325') HTTP/1.1" 204 0
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F969362ab298347f7916ad9c5af677a41%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/8.jpg not downloaded yet
2026-03-27 16:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:32 [ayvens.fr] INFO: Found listing with ID: 1988327
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988327%27 HTTP/1.1" 200 None
2026-03-27 16:48:32 [ayvens.fr] INFO: Scrape type for 1988327: 1
2026-03-27 16:48:32 [ayvens.fr] INFO: Extracting data for car ID: 1988327
2026-03-27 16:48:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23af1359-e187-5e65-96e9-8a8e02977d74 with identifier: 1988327
2026-03-27 16:48:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23af1359-e187-5e65-96e9-8a8e02977d74 with scrape type 1
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 23af1359-e187-5e65-96e9-8a8e02977d74
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc3daaa0b6c704f70b14b606d9239ef06%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/1.jpg not downloaded yet
2026-03-27 16:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc3daaa0b6c704f70b14b606d9239ef06%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/2.jpg not downloaded yet
2026-03-27 16:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc3daaa0b6c704f70b14b606d9239ef06%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/3.jpg not downloaded yet
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc3daaa0b6c704f70b14b606d9239ef06%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/4.jpg not downloaded yet
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc3daaa0b6c704f70b14b606d9239ef06%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/5.jpg not downloaded yet
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591482190>
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d408db-f25d-5e27-b70f-a017b4d7d251/54d408db-f25d-5e27-b70f-a017b4d7d251_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F969362ab298347f7916ad9c5af677a41%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/1.jpg saved to cache
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54d408db-f25d-5e27-b70f-a017b4d7d251
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590eff9d0>
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d408db-f25d-5e27-b70f-a017b4d7d251/54d408db-f25d-5e27-b70f-a017b4d7d251_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F969362ab298347f7916ad9c5af677a41%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/2.jpg saved to cache
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54d408db-f25d-5e27-b70f-a017b4d7d251
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc3daaa0b6c704f70b14b606d9239ef06%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/6.jpg not downloaded yet
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc3daaa0b6c704f70b14b606d9239ef06%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/7.jpg not downloaded yet
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc3daaa0b6c704f70b14b606d9239ef06%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/8.jpg not downloaded yet
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59063f5d0>
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d408db-f25d-5e27-b70f-a017b4d7d251/54d408db-f25d-5e27-b70f-a017b4d7d251_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F969362ab298347f7916ad9c5af677a41%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/3.jpg saved to cache
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54d408db-f25d-5e27-b70f-a017b4d7d251
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de49d0>
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d408db-f25d-5e27-b70f-a017b4d7d251/54d408db-f25d-5e27-b70f-a017b4d7d251_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F969362ab298347f7916ad9c5af677a41%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/4.jpg saved to cache
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54d408db-f25d-5e27-b70f-a017b4d7d251
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df6350>
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d408db-f25d-5e27-b70f-a017b4d7d251/54d408db-f25d-5e27-b70f-a017b4d7d251_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F969362ab298347f7916ad9c5af677a41%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/5.jpg saved to cache
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54d408db-f25d-5e27-b70f-a017b4d7d251
2026-03-27 16:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:33 [ayvens.fr] INFO: Found listing with ID: 1988328
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988328%27 HTTP/1.1" 200 None
2026-03-27 16:48:33 [ayvens.fr] INFO: Scrape type for 1988328: 1
2026-03-27 16:48:33 [ayvens.fr] INFO: Extracting data for car ID: 1988328
2026-03-27 16:48:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26da590d-7a16-5b21-b902-fb151e3c17a3 with identifier: 1988328
2026-03-27 16:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26da590d-7a16-5b21-b902-fb151e3c17a3 with scrape type 1
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 26da590d-7a16-5b21-b902-fb151e3c17a3
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F8a15540d38564a2a820ceece8804b294%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/1.jpg not downloaded yet
2026-03-27 16:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F8a15540d38564a2a820ceece8804b294%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/2.jpg not downloaded yet
2026-03-27 16:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F8a15540d38564a2a820ceece8804b294%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/3.jpg not downloaded yet
2026-03-27 16:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F8a15540d38564a2a820ceece8804b294%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/4.jpg not downloaded yet
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F8a15540d38564a2a820ceece8804b294%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/5.jpg not downloaded yet
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F8a15540d38564a2a820ceece8804b294%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/6.jpg not downloaded yet
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590db8050>
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d408db-f25d-5e27-b70f-a017b4d7d251/54d408db-f25d-5e27-b70f-a017b4d7d251_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F969362ab298347f7916ad9c5af677a41%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/8.jpg saved to cache
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54d408db-f25d-5e27-b70f-a017b4d7d251
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F8a15540d38564a2a820ceece8804b294%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/7.jpg not downloaded yet
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d7b3d0>
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23af1359-e187-5e65-96e9-8a8e02977d74/23af1359-e187-5e65-96e9-8a8e02977d74_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc3daaa0b6c704f70b14b606d9239ef06%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/1.jpg saved to cache
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23af1359-e187-5e65-96e9-8a8e02977d74
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d80e10>
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d408db-f25d-5e27-b70f-a017b4d7d251/54d408db-f25d-5e27-b70f-a017b4d7d251_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F969362ab298347f7916ad9c5af677a41%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/7.jpg saved to cache
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54d408db-f25d-5e27-b70f-a017b4d7d251
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f32cd0>
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d408db-f25d-5e27-b70f-a017b4d7d251/54d408db-f25d-5e27-b70f-a017b4d7d251_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F969362ab298347f7916ad9c5af677a41%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/6.jpg saved to cache
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54d408db-f25d-5e27-b70f-a017b4d7d251
2026-03-27 16:48:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54d408db-f25d-5e27-b70f-a017b4d7d251, skipping ID generation
2026-03-27 16:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54d408db-f25d-5e27-b70f-a017b4d7d251 with scrape type 1
2026-03-27 16:48:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54d408db-f25d-5e27-b70f-a017b4d7d251 sending to next pipeline
2026-03-27 16:48:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 54d408db-f25d-5e27-b70f-a017b4d7d251, identifier: 1988326
2026-03-27 16:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592c3a010>
2026-03-27 16:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23af1359-e187-5e65-96e9-8a8e02977d74/23af1359-e187-5e65-96e9-8a8e02977d74_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc3daaa0b6c704f70b14b606d9239ef06%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/4.jpg saved to cache
2026-03-27 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 23af1359-e187-5e65-96e9-8a8e02977d74
2026-03-27 16:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F8a15540d38564a2a820ceece8804b294%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/8.jpg not downloaded yet
2026-03-27 16:48:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 54d408db-f25d-5e27-b70f-a017b4d7d251 with identifier: 1988326
2026-03-27 16:48:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:48:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 54d408db-f25d-5e27-b70f-a017b4d7d251 with identifier: 1988326
2026-03-27 16:48:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 54d408db-f25d-5e27-b70f-a017b4d7d251 with identifier: 1988326 to the API
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '54d408db-f25d-5e27-b70f-a017b4d7d251',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 77713,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d408db-f25d-5e27-b70f-a017b4d7d251/54d408db-f25d-5e27-b70f-a017b4d7d251_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382426,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d408db-f25d-5e27-b70f-a017b4d7d251/54d408db-f25d-5e27-b70f-a017b4d7d251_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382426,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d408db-f25d-5e27-b70f-a017b4d7d251/54d408db-f25d-5e27-b70f-a017b4d7d251_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362012,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d408db-f25d-5e27-b70f-a017b4d7d251/54d408db-f25d-5e27-b70f-a017b4d7d251_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307769,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d408db-f25d-5e27-b70f-a017b4d7d251/54d408db-f25d-5e27-b70f-a017b4d7d251_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342004,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d408db-f25d-5e27-b70f-a017b4d7d251/54d408db-f25d-5e27-b70f-a017b4d7d251_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371413,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d408db-f25d-5e27-b70f-a017b4d7d251/54d408db-f25d-5e27-b70f-a017b4d7d251_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304261,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d408db-f25d-5e27-b70f-a017b4d7d251/54d408db-f25d-5e27-b70f-a017b4d7d251_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339079,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/969362ab298347f7916ad9c5af677a41/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-01',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 1.2 PureTech 83ch S&S Feel Business',
'transmission': 'manual',
'trim': 'C3 1.2 PureTech 83ch S&S Feel Business',
'vin': None,
'year': 2022}
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988326%27 HTTP/1.1" 200 None
2026-03-27 16:48:34 [ayvens.fr] INFO: Saving data for 1988326: {'created_time': 1774630114.630974, 'last_price_update_time': 1774630114.630989, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988326') HTTP/1.1" 204 0
2026-03-27 16:48:34 [ayvens.fr] INFO: Found listing with ID: 1988329
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988329%27 HTTP/1.1" 200 None
2026-03-27 16:48:34 [ayvens.fr] INFO: Scrape type for 1988329: 1
2026-03-27 16:48:34 [ayvens.fr] INFO: Extracting data for car ID: 1988329
2026-03-27 16:48:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b40f7ad-b250-57df-8222-0b968ccfef16 with identifier: 1988329
2026-03-27 16:48:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b40f7ad-b250-57df-8222-0b968ccfef16 with scrape type 1
2026-03-27 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5b40f7ad-b250-57df-8222-0b968ccfef16
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F84f38f01cc4945cbaec1d68b3f69d4fb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/1.jpg not downloaded yet
2026-03-27 16:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590aebf10>
2026-03-27 16:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23af1359-e187-5e65-96e9-8a8e02977d74/23af1359-e187-5e65-96e9-8a8e02977d74_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc3daaa0b6c704f70b14b606d9239ef06%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/2.jpg saved to cache
2026-03-27 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 23af1359-e187-5e65-96e9-8a8e02977d74
2026-03-27 16:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4d690>
2026-03-27 16:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23af1359-e187-5e65-96e9-8a8e02977d74/23af1359-e187-5e65-96e9-8a8e02977d74_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc3daaa0b6c704f70b14b606d9239ef06%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/5.jpg saved to cache
2026-03-27 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 23af1359-e187-5e65-96e9-8a8e02977d74
2026-03-27 16:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590593d90>
2026-03-27 16:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23af1359-e187-5e65-96e9-8a8e02977d74/23af1359-e187-5e65-96e9-8a8e02977d74_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc3daaa0b6c704f70b14b606d9239ef06%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/3.jpg saved to cache
2026-03-27 16:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23af1359-e187-5e65-96e9-8a8e02977d74
2026-03-27 16:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F84f38f01cc4945cbaec1d68b3f69d4fb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/2.jpg not downloaded yet
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904fe790>
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23af1359-e187-5e65-96e9-8a8e02977d74/23af1359-e187-5e65-96e9-8a8e02977d74_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc3daaa0b6c704f70b14b606d9239ef06%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/6.jpg saved to cache
2026-03-27 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 23af1359-e187-5e65-96e9-8a8e02977d74
2026-03-27 16:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F84f38f01cc4945cbaec1d68b3f69d4fb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/3.jpg not downloaded yet
2026-03-27 16:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F84f38f01cc4945cbaec1d68b3f69d4fb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/4.jpg not downloaded yet
2026-03-27 16:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F84f38f01cc4945cbaec1d68b3f69d4fb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/5.jpg not downloaded yet
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F84f38f01cc4945cbaec1d68b3f69d4fb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/6.jpg not downloaded yet
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904fead0>
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23af1359-e187-5e65-96e9-8a8e02977d74/23af1359-e187-5e65-96e9-8a8e02977d74_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc3daaa0b6c704f70b14b606d9239ef06%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/7.jpg saved to cache
2026-03-27 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 23af1359-e187-5e65-96e9-8a8e02977d74
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590afc290>
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23af1359-e187-5e65-96e9-8a8e02977d74/23af1359-e187-5e65-96e9-8a8e02977d74_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fc3daaa0b6c704f70b14b606d9239ef06%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/8.jpg saved to cache
2026-03-27 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 23af1359-e187-5e65-96e9-8a8e02977d74
2026-03-27 16:48:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23af1359-e187-5e65-96e9-8a8e02977d74, skipping ID generation
2026-03-27 16:48:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23af1359-e187-5e65-96e9-8a8e02977d74 with scrape type 1
2026-03-27 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23af1359-e187-5e65-96e9-8a8e02977d74 sending to next pipeline
2026-03-27 16:48:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 23af1359-e187-5e65-96e9-8a8e02977d74, identifier: 1988327
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F84f38f01cc4945cbaec1d68b3f69d4fb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/7.jpg not downloaded yet
2026-03-27 16:48:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 23af1359-e187-5e65-96e9-8a8e02977d74 with identifier: 1988327
2026-03-27 16:48:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 23af1359-e187-5e65-96e9-8a8e02977d74 with identifier: 1988327
2026-03-27 16:48:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 23af1359-e187-5e65-96e9-8a8e02977d74 with identifier: 1988327 to the API
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 100,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '23af1359-e187-5e65-96e9-8a8e02977d74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'CLASSE B',
'odometer': 36878,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23af1359-e187-5e65-96e9-8a8e02977d74/23af1359-e187-5e65-96e9-8a8e02977d74_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453696,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23af1359-e187-5e65-96e9-8a8e02977d74/23af1359-e187-5e65-96e9-8a8e02977d74_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453696,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23af1359-e187-5e65-96e9-8a8e02977d74/23af1359-e187-5e65-96e9-8a8e02977d74_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403288,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23af1359-e187-5e65-96e9-8a8e02977d74/23af1359-e187-5e65-96e9-8a8e02977d74_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309878,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23af1359-e187-5e65-96e9-8a8e02977d74/23af1359-e187-5e65-96e9-8a8e02977d74_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351616,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23af1359-e187-5e65-96e9-8a8e02977d74/23af1359-e187-5e65-96e9-8a8e02977d74_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244855,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23af1359-e187-5e65-96e9-8a8e02977d74/23af1359-e187-5e65-96e9-8a8e02977d74_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271766,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23af1359-e187-5e65-96e9-8a8e02977d74/23af1359-e187-5e65-96e9-8a8e02977d74_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/c3daaa0b6c704f70b14b606d9239ef06/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ CLASSE B Classe B 180d 116ch Business Line 7G-DCT',
'transmission': 'automatic',
'trim': 'Classe B 180d 116ch Business Line 7G-DCT',
'vin': None,
'year': 2019}
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988327%27 HTTP/1.1" 200 None
2026-03-27 16:48:35 [ayvens.fr] INFO: Saving data for 1988327: {'created_time': 1774630115.697894, 'last_price_update_time': 1774630115.697905, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988327') HTTP/1.1" 204 0
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F84f38f01cc4945cbaec1d68b3f69d4fb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/8.jpg not downloaded yet
2026-03-27 16:48:35 [ayvens.fr] INFO: Found listing with ID: 1988330
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988330%27 HTTP/1.1" 200 None
2026-03-27 16:48:35 [ayvens.fr] INFO: Scrape type for 1988330: 1
2026-03-27 16:48:35 [ayvens.fr] INFO: Extracting data for car ID: 1988330
2026-03-27 16:48:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86a41bf2-c0b0-5299-b052-12edd2bc612a with identifier: 1988330
2026-03-27 16:48:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86a41bf2-c0b0-5299-b052-12edd2bc612a with scrape type 1
2026-03-27 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 86a41bf2-c0b0-5299-b052-12edd2bc612a
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F64c9aecc09c84459a6b6e56ed6e9f941%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/1.jpg not downloaded yet
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051d9d0>
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26da590d-7a16-5b21-b902-fb151e3c17a3/26da590d-7a16-5b21-b902-fb151e3c17a3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F8a15540d38564a2a820ceece8804b294%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/1.jpg saved to cache
2026-03-27 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26da590d-7a16-5b21-b902-fb151e3c17a3
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f33990>
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26da590d-7a16-5b21-b902-fb151e3c17a3/26da590d-7a16-5b21-b902-fb151e3c17a3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F8a15540d38564a2a820ceece8804b294%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/2.jpg saved to cache
2026-03-27 16:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26da590d-7a16-5b21-b902-fb151e3c17a3
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903ce9d0>
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26da590d-7a16-5b21-b902-fb151e3c17a3/26da590d-7a16-5b21-b902-fb151e3c17a3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F8a15540d38564a2a820ceece8804b294%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/4.jpg saved to cache
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26da590d-7a16-5b21-b902-fb151e3c17a3
2026-03-27 16:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abee90>
2026-03-27 16:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26da590d-7a16-5b21-b902-fb151e3c17a3/26da590d-7a16-5b21-b902-fb151e3c17a3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F8a15540d38564a2a820ceece8804b294%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/5.jpg saved to cache
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26da590d-7a16-5b21-b902-fb151e3c17a3
2026-03-27 16:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a2050>
2026-03-27 16:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26da590d-7a16-5b21-b902-fb151e3c17a3/26da590d-7a16-5b21-b902-fb151e3c17a3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F8a15540d38564a2a820ceece8804b294%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/3.jpg saved to cache
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26da590d-7a16-5b21-b902-fb151e3c17a3
2026-03-27 16:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f30750>
2026-03-27 16:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26da590d-7a16-5b21-b902-fb151e3c17a3/26da590d-7a16-5b21-b902-fb151e3c17a3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F8a15540d38564a2a820ceece8804b294%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/6.jpg saved to cache
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 26da590d-7a16-5b21-b902-fb151e3c17a3
2026-03-27 16:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F64c9aecc09c84459a6b6e56ed6e9f941%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/2.jpg not downloaded yet
2026-03-27 16:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F64c9aecc09c84459a6b6e56ed6e9f941%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/3.jpg not downloaded yet
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F64c9aecc09c84459a6b6e56ed6e9f941%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/4.jpg not downloaded yet
2026-03-27 16:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F64c9aecc09c84459a6b6e56ed6e9f941%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/5.jpg not downloaded yet
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F64c9aecc09c84459a6b6e56ed6e9f941%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/6.jpg not downloaded yet
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F64c9aecc09c84459a6b6e56ed6e9f941%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/7.jpg not downloaded yet
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F64c9aecc09c84459a6b6e56ed6e9f941%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/8.jpg not downloaded yet
2026-03-27 16:48:36 [ayvens.fr] INFO: Found listing with ID: 1988331
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988331%27 HTTP/1.1" 200 None
2026-03-27 16:48:36 [ayvens.fr] INFO: Scrape type for 1988331: 1
2026-03-27 16:48:36 [ayvens.fr] INFO: Extracting data for car ID: 1988331
2026-03-27 16:48:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb08a701-a0f5-5925-93af-6d52bfedb90b with identifier: 1988331
2026-03-27 16:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb08a701-a0f5-5925-93af-6d52bfedb90b with scrape type 1
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item eb08a701-a0f5-5925-93af-6d52bfedb90b
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd7e5edd257824b23818ab6c70255db79%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/1.jpg not downloaded yet
2026-03-27 16:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590511dd0>
2026-03-27 16:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26da590d-7a16-5b21-b902-fb151e3c17a3/26da590d-7a16-5b21-b902-fb151e3c17a3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F8a15540d38564a2a820ceece8804b294%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/7.jpg saved to cache
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 26da590d-7a16-5b21-b902-fb151e3c17a3
2026-03-27 16:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59102e550>
2026-03-27 16:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26da590d-7a16-5b21-b902-fb151e3c17a3/26da590d-7a16-5b21-b902-fb151e3c17a3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F8a15540d38564a2a820ceece8804b294%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/8.jpg saved to cache
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 26da590d-7a16-5b21-b902-fb151e3c17a3
2026-03-27 16:48:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26da590d-7a16-5b21-b902-fb151e3c17a3, skipping ID generation
2026-03-27 16:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26da590d-7a16-5b21-b902-fb151e3c17a3 with scrape type 1
2026-03-27 16:48:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26da590d-7a16-5b21-b902-fb151e3c17a3 sending to next pipeline
2026-03-27 16:48:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 26da590d-7a16-5b21-b902-fb151e3c17a3, identifier: 1988328
2026-03-27 16:48:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 26da590d-7a16-5b21-b902-fb151e3c17a3 with identifier: 1988328
2026-03-27 16:48:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 26da590d-7a16-5b21-b902-fb151e3c17a3 with identifier: 1988328
2026-03-27 16:48:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 26da590d-7a16-5b21-b902-fb151e3c17a3 with identifier: 1988328 to the API
2026-03-27 16:48:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 150,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '26da590d-7a16-5b21-b902-fb151e3c17a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 61355,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26da590d-7a16-5b21-b902-fb151e3c17a3/26da590d-7a16-5b21-b902-fb151e3c17a3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541205,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26da590d-7a16-5b21-b902-fb151e3c17a3/26da590d-7a16-5b21-b902-fb151e3c17a3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541205,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26da590d-7a16-5b21-b902-fb151e3c17a3/26da590d-7a16-5b21-b902-fb151e3c17a3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618888,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26da590d-7a16-5b21-b902-fb151e3c17a3/26da590d-7a16-5b21-b902-fb151e3c17a3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 503586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26da590d-7a16-5b21-b902-fb151e3c17a3/26da590d-7a16-5b21-b902-fb151e3c17a3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415486,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26da590d-7a16-5b21-b902-fb151e3c17a3/26da590d-7a16-5b21-b902-fb151e3c17a3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436243,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26da590d-7a16-5b21-b902-fb151e3c17a3/26da590d-7a16-5b21-b902-fb151e3c17a3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277722,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26da590d-7a16-5b21-b902-fb151e3c17a3/26da590d-7a16-5b21-b902-fb151e3c17a3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284643,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/8a15540d38564a2a820ceece8804b294/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-10',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch S&S Active Business EAT8',
'vin': None,
'year': 2020}
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988328%27 HTTP/1.1" 200 None
2026-03-27 16:48:37 [ayvens.fr] INFO: Saving data for 1988328: {'created_time': 1774630117.52429, 'last_price_update_time': 1774630117.524302, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988328') HTTP/1.1" 204 0
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd7e5edd257824b23818ab6c70255db79%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/2.jpg not downloaded yet
2026-03-27 16:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe2290>
2026-03-27 16:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b40f7ad-b250-57df-8222-0b968ccfef16/5b40f7ad-b250-57df-8222-0b968ccfef16_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F84f38f01cc4945cbaec1d68b3f69d4fb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/4.jpg saved to cache
2026-03-27 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b40f7ad-b250-57df-8222-0b968ccfef16
2026-03-27 16:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066de10>
2026-03-27 16:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b40f7ad-b250-57df-8222-0b968ccfef16/5b40f7ad-b250-57df-8222-0b968ccfef16_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F84f38f01cc4945cbaec1d68b3f69d4fb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/5.jpg saved to cache
2026-03-27 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b40f7ad-b250-57df-8222-0b968ccfef16
2026-03-27 16:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903def90>
2026-03-27 16:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b40f7ad-b250-57df-8222-0b968ccfef16/5b40f7ad-b250-57df-8222-0b968ccfef16_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F84f38f01cc4945cbaec1d68b3f69d4fb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/3.jpg saved to cache
2026-03-27 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b40f7ad-b250-57df-8222-0b968ccfef16
2026-03-27 16:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590647710>
2026-03-27 16:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b40f7ad-b250-57df-8222-0b968ccfef16/5b40f7ad-b250-57df-8222-0b968ccfef16_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F84f38f01cc4945cbaec1d68b3f69d4fb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/1.jpg saved to cache
2026-03-27 16:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b40f7ad-b250-57df-8222-0b968ccfef16
2026-03-27 16:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b671d0>
2026-03-27 16:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b40f7ad-b250-57df-8222-0b968ccfef16/5b40f7ad-b250-57df-8222-0b968ccfef16_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F84f38f01cc4945cbaec1d68b3f69d4fb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/2.jpg saved to cache
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b40f7ad-b250-57df-8222-0b968ccfef16
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7e210>
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b40f7ad-b250-57df-8222-0b968ccfef16/5b40f7ad-b250-57df-8222-0b968ccfef16_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F84f38f01cc4945cbaec1d68b3f69d4fb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/6.jpg saved to cache
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b40f7ad-b250-57df-8222-0b968ccfef16
2026-03-27 16:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd7e5edd257824b23818ab6c70255db79%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/3.jpg not downloaded yet
2026-03-27 16:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd7e5edd257824b23818ab6c70255db79%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/4.jpg not downloaded yet
2026-03-27 16:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd7e5edd257824b23818ab6c70255db79%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/5.jpg not downloaded yet
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd7e5edd257824b23818ab6c70255db79%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/6.jpg not downloaded yet
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd7e5edd257824b23818ab6c70255db79%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/7.jpg not downloaded yet
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd7e5edd257824b23818ab6c70255db79%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/8.jpg not downloaded yet
2026-03-27 16:48:38 [ayvens.fr] INFO: Found listing with ID: 1988332
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988332%27 HTTP/1.1" 200 None
2026-03-27 16:48:38 [ayvens.fr] INFO: Scrape type for 1988332: 1
2026-03-27 16:48:38 [ayvens.fr] INFO: Extracting data for car ID: 1988332
2026-03-27 16:48:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09980b2c-e1b5-584e-8bea-bae2e0032c93 with identifier: 1988332
2026-03-27 16:48:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09980b2c-e1b5-584e-8bea-bae2e0032c93 with scrape type 1
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 09980b2c-e1b5-584e-8bea-bae2e0032c93
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F805d86b3fd40412bacf03d33f1aaf540%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/1.jpg not downloaded yet
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F805d86b3fd40412bacf03d33f1aaf540%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/2.jpg not downloaded yet
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590675350>
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86a41bf2-c0b0-5299-b052-12edd2bc612a/86a41bf2-c0b0-5299-b052-12edd2bc612a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F64c9aecc09c84459a6b6e56ed6e9f941%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/1.jpg saved to cache
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86a41bf2-c0b0-5299-b052-12edd2bc612a
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591445410>
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b40f7ad-b250-57df-8222-0b968ccfef16/5b40f7ad-b250-57df-8222-0b968ccfef16_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F84f38f01cc4945cbaec1d68b3f69d4fb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/8.jpg saved to cache
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b40f7ad-b250-57df-8222-0b968ccfef16
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a9b90>
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b40f7ad-b250-57df-8222-0b968ccfef16/5b40f7ad-b250-57df-8222-0b968ccfef16_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F84f38f01cc4945cbaec1d68b3f69d4fb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/7.jpg saved to cache
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b40f7ad-b250-57df-8222-0b968ccfef16
2026-03-27 16:48:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b40f7ad-b250-57df-8222-0b968ccfef16, skipping ID generation
2026-03-27 16:48:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b40f7ad-b250-57df-8222-0b968ccfef16 with scrape type 1
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b40f7ad-b250-57df-8222-0b968ccfef16 sending to next pipeline
2026-03-27 16:48:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5b40f7ad-b250-57df-8222-0b968ccfef16, identifier: 1988329
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d80310>
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86a41bf2-c0b0-5299-b052-12edd2bc612a/86a41bf2-c0b0-5299-b052-12edd2bc612a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F64c9aecc09c84459a6b6e56ed6e9f941%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/3.jpg saved to cache
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86a41bf2-c0b0-5299-b052-12edd2bc612a
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590647150>
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86a41bf2-c0b0-5299-b052-12edd2bc612a/86a41bf2-c0b0-5299-b052-12edd2bc612a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F64c9aecc09c84459a6b6e56ed6e9f941%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/4.jpg saved to cache
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86a41bf2-c0b0-5299-b052-12edd2bc612a
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d53390>
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86a41bf2-c0b0-5299-b052-12edd2bc612a/86a41bf2-c0b0-5299-b052-12edd2bc612a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F64c9aecc09c84459a6b6e56ed6e9f941%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/2.jpg saved to cache
2026-03-27 16:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86a41bf2-c0b0-5299-b052-12edd2bc612a
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590faa190>
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86a41bf2-c0b0-5299-b052-12edd2bc612a/86a41bf2-c0b0-5299-b052-12edd2bc612a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F64c9aecc09c84459a6b6e56ed6e9f941%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/6.jpg saved to cache
2026-03-27 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86a41bf2-c0b0-5299-b052-12edd2bc612a
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F805d86b3fd40412bacf03d33f1aaf540%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/3.jpg not downloaded yet
2026-03-27 16:48:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5b40f7ad-b250-57df-8222-0b968ccfef16 with identifier: 1988329
2026-03-27 16:48:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:48:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5b40f7ad-b250-57df-8222-0b968ccfef16 with identifier: 1988329
2026-03-27 16:48:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5b40f7ad-b250-57df-8222-0b968ccfef16 with identifier: 1988329 to the API
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': 'METALLIC COPPER M',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '5b40f7ad-b250-57df-8222-0b968ccfef16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 117430,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b40f7ad-b250-57df-8222-0b968ccfef16/5b40f7ad-b250-57df-8222-0b968ccfef16_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 463231,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b40f7ad-b250-57df-8222-0b968ccfef16/5b40f7ad-b250-57df-8222-0b968ccfef16_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 463231,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b40f7ad-b250-57df-8222-0b968ccfef16/5b40f7ad-b250-57df-8222-0b968ccfef16_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457223,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b40f7ad-b250-57df-8222-0b968ccfef16/5b40f7ad-b250-57df-8222-0b968ccfef16_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392297,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b40f7ad-b250-57df-8222-0b968ccfef16/5b40f7ad-b250-57df-8222-0b968ccfef16_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360074,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b40f7ad-b250-57df-8222-0b968ccfef16/5b40f7ad-b250-57df-8222-0b968ccfef16_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404510,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b40f7ad-b250-57df-8222-0b968ccfef16/5b40f7ad-b250-57df-8222-0b968ccfef16_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333359,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b40f7ad-b250-57df-8222-0b968ccfef16/5b40f7ad-b250-57df-8222-0b968ccfef16_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239103,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/84f38f01cc4945cbaec1d68b3f69d4fb/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-07',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.5 BlueHDi 130ch S&S GT',
'transmission': 'manual',
'trim': '5008 1.5 BlueHDi 130ch S&S GT',
'vin': None,
'year': 2021}
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988329%27 HTTP/1.1" 200 None
2026-03-27 16:48:39 [ayvens.fr] INFO: Saving data for 1988329: {'created_time': 1774630119.464819, 'last_price_update_time': 1774630119.46483, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988329') HTTP/1.1" 204 0
2026-03-27 16:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d41510>
2026-03-27 16:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86a41bf2-c0b0-5299-b052-12edd2bc612a/86a41bf2-c0b0-5299-b052-12edd2bc612a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F64c9aecc09c84459a6b6e56ed6e9f941%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/5.jpg saved to cache
2026-03-27 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86a41bf2-c0b0-5299-b052-12edd2bc612a
2026-03-27 16:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F805d86b3fd40412bacf03d33f1aaf540%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/4.jpg not downloaded yet
2026-03-27 16:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F805d86b3fd40412bacf03d33f1aaf540%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/5.jpg not downloaded yet
2026-03-27 16:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F805d86b3fd40412bacf03d33f1aaf540%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/6.jpg not downloaded yet
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F805d86b3fd40412bacf03d33f1aaf540%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/7.jpg not downloaded yet
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F805d86b3fd40412bacf03d33f1aaf540%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/8.jpg not downloaded yet
2026-03-27 16:48:39 [ayvens.fr] INFO: Found listing with ID: 1988333
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988333%27 HTTP/1.1" 200 None
2026-03-27 16:48:39 [ayvens.fr] INFO: Scrape type for 1988333: 1
2026-03-27 16:48:39 [ayvens.fr] INFO: Extracting data for car ID: 1988333
2026-03-27 16:48:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b81f58d8-7617-57a9-9ed7-dd33055d4731 with identifier: 1988333
2026-03-27 16:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b81f58d8-7617-57a9-9ed7-dd33055d4731 with scrape type 1
2026-03-27 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b81f58d8-7617-57a9-9ed7-dd33055d4731
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F4281d31ca53b45bfb4d61497d8b47af2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/1.jpg not downloaded yet
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F4281d31ca53b45bfb4d61497d8b47af2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/2.jpg not downloaded yet
2026-03-27 16:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d40950>
2026-03-27 16:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86a41bf2-c0b0-5299-b052-12edd2bc612a/86a41bf2-c0b0-5299-b052-12edd2bc612a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F64c9aecc09c84459a6b6e56ed6e9f941%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/8.jpg saved to cache
2026-03-27 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86a41bf2-c0b0-5299-b052-12edd2bc612a
2026-03-27 16:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b48ad0>
2026-03-27 16:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb08a701-a0f5-5925-93af-6d52bfedb90b/eb08a701-a0f5-5925-93af-6d52bfedb90b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd7e5edd257824b23818ab6c70255db79%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/1.jpg saved to cache
2026-03-27 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb08a701-a0f5-5925-93af-6d52bfedb90b
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F4281d31ca53b45bfb4d61497d8b47af2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/3.jpg not downloaded yet
2026-03-27 16:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b40d50>
2026-03-27 16:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb08a701-a0f5-5925-93af-6d52bfedb90b/eb08a701-a0f5-5925-93af-6d52bfedb90b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd7e5edd257824b23818ab6c70255db79%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/3.jpg saved to cache
2026-03-27 16:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb08a701-a0f5-5925-93af-6d52bfedb90b
2026-03-27 16:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590af1210>
2026-03-27 16:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb08a701-a0f5-5925-93af-6d52bfedb90b/eb08a701-a0f5-5925-93af-6d52bfedb90b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd7e5edd257824b23818ab6c70255db79%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/2.jpg saved to cache
2026-03-27 16:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb08a701-a0f5-5925-93af-6d52bfedb90b
2026-03-27 16:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e092d0>
2026-03-27 16:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86a41bf2-c0b0-5299-b052-12edd2bc612a/86a41bf2-c0b0-5299-b052-12edd2bc612a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F64c9aecc09c84459a6b6e56ed6e9f941%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/7.jpg saved to cache
2026-03-27 16:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86a41bf2-c0b0-5299-b052-12edd2bc612a
2026-03-27 16:48:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86a41bf2-c0b0-5299-b052-12edd2bc612a, skipping ID generation
2026-03-27 16:48:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86a41bf2-c0b0-5299-b052-12edd2bc612a with scrape type 1
2026-03-27 16:48:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86a41bf2-c0b0-5299-b052-12edd2bc612a sending to next pipeline
2026-03-27 16:48:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 86a41bf2-c0b0-5299-b052-12edd2bc612a, identifier: 1988330
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F4281d31ca53b45bfb4d61497d8b47af2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/4.jpg not downloaded yet
2026-03-27 16:48:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 86a41bf2-c0b0-5299-b052-12edd2bc612a with identifier: 1988330
2026-03-27 16:48:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 86a41bf2-c0b0-5299-b052-12edd2bc612a with identifier: 1988330
2026-03-27 16:48:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 86a41bf2-c0b0-5299-b052-12edd2bc612a with identifier: 1988330 to the API
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '86a41bf2-c0b0-5299-b052-12edd2bc612a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 69632,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86a41bf2-c0b0-5299-b052-12edd2bc612a/86a41bf2-c0b0-5299-b052-12edd2bc612a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304023,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86a41bf2-c0b0-5299-b052-12edd2bc612a/86a41bf2-c0b0-5299-b052-12edd2bc612a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304023,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86a41bf2-c0b0-5299-b052-12edd2bc612a/86a41bf2-c0b0-5299-b052-12edd2bc612a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292746,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86a41bf2-c0b0-5299-b052-12edd2bc612a/86a41bf2-c0b0-5299-b052-12edd2bc612a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86a41bf2-c0b0-5299-b052-12edd2bc612a/86a41bf2-c0b0-5299-b052-12edd2bc612a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342541,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86a41bf2-c0b0-5299-b052-12edd2bc612a/86a41bf2-c0b0-5299-b052-12edd2bc612a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320545,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86a41bf2-c0b0-5299-b052-12edd2bc612a/86a41bf2-c0b0-5299-b052-12edd2bc612a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304278,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86a41bf2-c0b0-5299-b052-12edd2bc612a/86a41bf2-c0b0-5299-b052-12edd2bc612a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337334,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/64c9aecc09c84459a6b6e56ed6e9f941/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-15',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 PureTech 110ch Feel S&S EAT6',
'transmission': 'automatic',
'trim': 'C3 PureTech 110ch Feel S&S EAT6',
'vin': None,
'year': 2019}
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988330%27 HTTP/1.1" 200 None
2026-03-27 16:48:40 [ayvens.fr] INFO: Saving data for 1988330: {'created_time': 1774630120.695886, 'last_price_update_time': 1774630120.695898, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988330') HTTP/1.1" 204 0
2026-03-27 16:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F4281d31ca53b45bfb4d61497d8b47af2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/5.jpg not downloaded yet
2026-03-27 16:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590af3810>
2026-03-27 16:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb08a701-a0f5-5925-93af-6d52bfedb90b/eb08a701-a0f5-5925-93af-6d52bfedb90b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd7e5edd257824b23818ab6c70255db79%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/4.jpg saved to cache
2026-03-27 16:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb08a701-a0f5-5925-93af-6d52bfedb90b
2026-03-27 16:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59063e4d0>
2026-03-27 16:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb08a701-a0f5-5925-93af-6d52bfedb90b/eb08a701-a0f5-5925-93af-6d52bfedb90b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd7e5edd257824b23818ab6c70255db79%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/5.jpg saved to cache
2026-03-27 16:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb08a701-a0f5-5925-93af-6d52bfedb90b
2026-03-27 16:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f139d0>
2026-03-27 16:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb08a701-a0f5-5925-93af-6d52bfedb90b/eb08a701-a0f5-5925-93af-6d52bfedb90b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd7e5edd257824b23818ab6c70255db79%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/6.jpg saved to cache
2026-03-27 16:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb08a701-a0f5-5925-93af-6d52bfedb90b
2026-03-27 16:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59063d850>
2026-03-27 16:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb08a701-a0f5-5925-93af-6d52bfedb90b/eb08a701-a0f5-5925-93af-6d52bfedb90b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd7e5edd257824b23818ab6c70255db79%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/8.jpg saved to cache
2026-03-27 16:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb08a701-a0f5-5925-93af-6d52bfedb90b
2026-03-27 16:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F4281d31ca53b45bfb4d61497d8b47af2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/6.jpg not downloaded yet
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F4281d31ca53b45bfb4d61497d8b47af2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/7.jpg not downloaded yet
2026-03-27 16:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b50bd0>
2026-03-27 16:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb08a701-a0f5-5925-93af-6d52bfedb90b/eb08a701-a0f5-5925-93af-6d52bfedb90b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd7e5edd257824b23818ab6c70255db79%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/7.jpg saved to cache
2026-03-27 16:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb08a701-a0f5-5925-93af-6d52bfedb90b
2026-03-27 16:48:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb08a701-a0f5-5925-93af-6d52bfedb90b, skipping ID generation
2026-03-27 16:48:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb08a701-a0f5-5925-93af-6d52bfedb90b with scrape type 1
2026-03-27 16:48:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb08a701-a0f5-5925-93af-6d52bfedb90b sending to next pipeline
2026-03-27 16:48:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: eb08a701-a0f5-5925-93af-6d52bfedb90b, identifier: 1988331
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F4281d31ca53b45bfb4d61497d8b47af2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/8.jpg not downloaded yet
2026-03-27 16:48:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: eb08a701-a0f5-5925-93af-6d52bfedb90b with identifier: 1988331
2026-03-27 16:48:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: eb08a701-a0f5-5925-93af-6d52bfedb90b with identifier: 1988331
2026-03-27 16:48:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: eb08a701-a0f5-5925-93af-6d52bfedb90b with identifier: 1988331 to the API
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'eb08a701-a0f5-5925-93af-6d52bfedb90b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C4',
'odometer': 57588,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb08a701-a0f5-5925-93af-6d52bfedb90b/eb08a701-a0f5-5925-93af-6d52bfedb90b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318853,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb08a701-a0f5-5925-93af-6d52bfedb90b/eb08a701-a0f5-5925-93af-6d52bfedb90b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318853,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb08a701-a0f5-5925-93af-6d52bfedb90b/eb08a701-a0f5-5925-93af-6d52bfedb90b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332631,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb08a701-a0f5-5925-93af-6d52bfedb90b/eb08a701-a0f5-5925-93af-6d52bfedb90b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358860,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb08a701-a0f5-5925-93af-6d52bfedb90b/eb08a701-a0f5-5925-93af-6d52bfedb90b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345045,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb08a701-a0f5-5925-93af-6d52bfedb90b/eb08a701-a0f5-5925-93af-6d52bfedb90b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334352,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb08a701-a0f5-5925-93af-6d52bfedb90b/eb08a701-a0f5-5925-93af-6d52bfedb90b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335838,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb08a701-a0f5-5925-93af-6d52bfedb90b/eb08a701-a0f5-5925-93af-6d52bfedb90b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305849,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d7e5edd257824b23818ab6c70255db79/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-03',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C4 C4 BlueHDi 130ch S&S Feel EAT8',
'transmission': 'automatic',
'trim': 'C4 BlueHDi 130ch S&S Feel EAT8',
'vin': None,
'year': 2021}
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988331%27 HTTP/1.1" 200 None
2026-03-27 16:48:41 [ayvens.fr] INFO: Saving data for 1988331: {'created_time': 1774630121.851448, 'last_price_update_time': 1774630121.851458, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988331') HTTP/1.1" 204 0
2026-03-27 16:48:41 [ayvens.fr] INFO: Found listing with ID: 1988334
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988334%27 HTTP/1.1" 200 None
2026-03-27 16:48:41 [ayvens.fr] INFO: Scrape type for 1988334: 1
2026-03-27 16:48:41 [ayvens.fr] INFO: Extracting data for car ID: 1988334
2026-03-27 16:48:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2d963b4-67d8-590a-83e6-7876f251aa4e with identifier: 1988334
2026-03-27 16:48:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2d963b4-67d8-590a-83e6-7876f251aa4e with scrape type 1
2026-03-27 16:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e2d963b4-67d8-590a-83e6-7876f251aa4e
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fdaad9eeaa4c04780942bdd9949296353%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/1.jpg not downloaded yet
2026-03-27 16:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ed8fd0>
2026-03-27 16:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09980b2c-e1b5-584e-8bea-bae2e0032c93/09980b2c-e1b5-584e-8bea-bae2e0032c93_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F805d86b3fd40412bacf03d33f1aaf540%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/2.jpg saved to cache
2026-03-27 16:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09980b2c-e1b5-584e-8bea-bae2e0032c93
2026-03-27 16:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc4ad0>
2026-03-27 16:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09980b2c-e1b5-584e-8bea-bae2e0032c93/09980b2c-e1b5-584e-8bea-bae2e0032c93_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F805d86b3fd40412bacf03d33f1aaf540%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/5.jpg saved to cache
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09980b2c-e1b5-584e-8bea-bae2e0032c93
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911baa90>
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09980b2c-e1b5-584e-8bea-bae2e0032c93/09980b2c-e1b5-584e-8bea-bae2e0032c93_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F805d86b3fd40412bacf03d33f1aaf540%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/4.jpg saved to cache
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09980b2c-e1b5-584e-8bea-bae2e0032c93
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911b86d0>
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09980b2c-e1b5-584e-8bea-bae2e0032c93/09980b2c-e1b5-584e-8bea-bae2e0032c93_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F805d86b3fd40412bacf03d33f1aaf540%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/3.jpg saved to cache
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09980b2c-e1b5-584e-8bea-bae2e0032c93
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e3910>
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09980b2c-e1b5-584e-8bea-bae2e0032c93/09980b2c-e1b5-584e-8bea-bae2e0032c93_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F805d86b3fd40412bacf03d33f1aaf540%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/6.jpg saved to cache
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09980b2c-e1b5-584e-8bea-bae2e0032c93
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910d8d50>
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09980b2c-e1b5-584e-8bea-bae2e0032c93/09980b2c-e1b5-584e-8bea-bae2e0032c93_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F805d86b3fd40412bacf03d33f1aaf540%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/1.jpg saved to cache
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09980b2c-e1b5-584e-8bea-bae2e0032c93
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911bac90>
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09980b2c-e1b5-584e-8bea-bae2e0032c93/09980b2c-e1b5-584e-8bea-bae2e0032c93_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F805d86b3fd40412bacf03d33f1aaf540%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/7.jpg saved to cache
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09980b2c-e1b5-584e-8bea-bae2e0032c93
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fdaad9eeaa4c04780942bdd9949296353%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/2.jpg not downloaded yet
2026-03-27 16:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fdaad9eeaa4c04780942bdd9949296353%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/3.jpg not downloaded yet
2026-03-27 16:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fdaad9eeaa4c04780942bdd9949296353%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/4.jpg not downloaded yet
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fdaad9eeaa4c04780942bdd9949296353%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/5.jpg not downloaded yet
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fdaad9eeaa4c04780942bdd9949296353%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/6.jpg not downloaded yet
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fdaad9eeaa4c04780942bdd9949296353%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/7.jpg not downloaded yet
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fdaad9eeaa4c04780942bdd9949296353%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/8.jpg not downloaded yet
2026-03-27 16:48:42 [ayvens.fr] INFO: Found listing with ID: 1988335
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988335%27 HTTP/1.1" 200 None
2026-03-27 16:48:42 [ayvens.fr] INFO: Scrape type for 1988335: 1
2026-03-27 16:48:42 [ayvens.fr] INFO: Extracting data for car ID: 1988335
2026-03-27 16:48:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7606c4c4-d88f-513e-b6a0-c0027d1bf000 with identifier: 1988335
2026-03-27 16:48:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7606c4c4-d88f-513e-b6a0-c0027d1bf000 with scrape type 1
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7606c4c4-d88f-513e-b6a0-c0027d1bf000
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7e1262b05fd74109beb810b9c3d741df%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/1.jpg not downloaded yet
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7e1262b05fd74109beb810b9c3d741df%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/2.jpg not downloaded yet
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b68110>
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09980b2c-e1b5-584e-8bea-bae2e0032c93/09980b2c-e1b5-584e-8bea-bae2e0032c93_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F805d86b3fd40412bacf03d33f1aaf540%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/8.jpg saved to cache
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09980b2c-e1b5-584e-8bea-bae2e0032c93
2026-03-27 16:48:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09980b2c-e1b5-584e-8bea-bae2e0032c93, skipping ID generation
2026-03-27 16:48:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09980b2c-e1b5-584e-8bea-bae2e0032c93 with scrape type 1
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09980b2c-e1b5-584e-8bea-bae2e0032c93 sending to next pipeline
2026-03-27 16:48:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 09980b2c-e1b5-584e-8bea-bae2e0032c93, identifier: 1988332
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc5050>
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b81f58d8-7617-57a9-9ed7-dd33055d4731/b81f58d8-7617-57a9-9ed7-dd33055d4731_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F4281d31ca53b45bfb4d61497d8b47af2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/1.jpg saved to cache
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b81f58d8-7617-57a9-9ed7-dd33055d4731
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910ee110>
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b81f58d8-7617-57a9-9ed7-dd33055d4731/b81f58d8-7617-57a9-9ed7-dd33055d4731_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F4281d31ca53b45bfb4d61497d8b47af2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/2.jpg saved to cache
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b81f58d8-7617-57a9-9ed7-dd33055d4731
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f61c90>
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b81f58d8-7617-57a9-9ed7-dd33055d4731/b81f58d8-7617-57a9-9ed7-dd33055d4731_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F4281d31ca53b45bfb4d61497d8b47af2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/5.jpg saved to cache
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b81f58d8-7617-57a9-9ed7-dd33055d4731
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d83d10>
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b81f58d8-7617-57a9-9ed7-dd33055d4731/b81f58d8-7617-57a9-9ed7-dd33055d4731_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F4281d31ca53b45bfb4d61497d8b47af2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/3.jpg saved to cache
2026-03-27 16:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b81f58d8-7617-57a9-9ed7-dd33055d4731
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590594190>
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b81f58d8-7617-57a9-9ed7-dd33055d4731/b81f58d8-7617-57a9-9ed7-dd33055d4731_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F4281d31ca53b45bfb4d61497d8b47af2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/4.jpg saved to cache
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b81f58d8-7617-57a9-9ed7-dd33055d4731
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d767d0>
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b81f58d8-7617-57a9-9ed7-dd33055d4731/b81f58d8-7617-57a9-9ed7-dd33055d4731_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F4281d31ca53b45bfb4d61497d8b47af2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/7.jpg saved to cache
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b81f58d8-7617-57a9-9ed7-dd33055d4731
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a1310>
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b81f58d8-7617-57a9-9ed7-dd33055d4731/b81f58d8-7617-57a9-9ed7-dd33055d4731_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F4281d31ca53b45bfb4d61497d8b47af2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/6.jpg saved to cache
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b81f58d8-7617-57a9-9ed7-dd33055d4731
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7e1262b05fd74109beb810b9c3d741df%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/3.jpg not downloaded yet
2026-03-27 16:48:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 09980b2c-e1b5-584e-8bea-bae2e0032c93 with identifier: 1988332
2026-03-27 16:48:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 09980b2c-e1b5-584e-8bea-bae2e0032c93 with identifier: 1988332
2026-03-27 16:48:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 09980b2c-e1b5-584e-8bea-bae2e0032c93 with identifier: 1988332 to the API
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '09980b2c-e1b5-584e-8bea-bae2e0032c93',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'TUCSON',
'odometer': 104317,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09980b2c-e1b5-584e-8bea-bae2e0032c93/09980b2c-e1b5-584e-8bea-bae2e0032c93_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327899,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09980b2c-e1b5-584e-8bea-bae2e0032c93/09980b2c-e1b5-584e-8bea-bae2e0032c93_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327899,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09980b2c-e1b5-584e-8bea-bae2e0032c93/09980b2c-e1b5-584e-8bea-bae2e0032c93_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355402,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09980b2c-e1b5-584e-8bea-bae2e0032c93/09980b2c-e1b5-584e-8bea-bae2e0032c93_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325610,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09980b2c-e1b5-584e-8bea-bae2e0032c93/09980b2c-e1b5-584e-8bea-bae2e0032c93_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300781,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09980b2c-e1b5-584e-8bea-bae2e0032c93/09980b2c-e1b5-584e-8bea-bae2e0032c93_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331177,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09980b2c-e1b5-584e-8bea-bae2e0032c93/09980b2c-e1b5-584e-8bea-bae2e0032c93_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334613,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09980b2c-e1b5-584e-8bea-bae2e0032c93/09980b2c-e1b5-584e-8bea-bae2e0032c93_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296389,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/805d86b3fd40412bacf03d33f1aaf540/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-13',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI TUCSON Tucson 1.6 T-GDi 230ch Hybrid Creative BVA6',
'transmission': 'automatic',
'trim': 'Tucson 1.6 T-GDi 230ch Hybrid Creative BVA6',
'vin': None,
'year': 2022}
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988332%27 HTTP/1.1" 200 None
2026-03-27 16:48:43 [ayvens.fr] INFO: Saving data for 1988332: {'created_time': 1774630123.566055, 'last_price_update_time': 1774630123.566066, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988332') HTTP/1.1" 204 0
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7e1262b05fd74109beb810b9c3d741df%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/4.jpg not downloaded yet
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7e1262b05fd74109beb810b9c3d741df%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/5.jpg not downloaded yet
2026-03-27 16:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7e1262b05fd74109beb810b9c3d741df%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/6.jpg not downloaded yet
2026-03-27 16:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7e1262b05fd74109beb810b9c3d741df%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/7.jpg not downloaded yet
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7e1262b05fd74109beb810b9c3d741df%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/8.jpg not downloaded yet
2026-03-27 16:48:43 [ayvens.fr] INFO: Found listing with ID: 1988336
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988336%27 HTTP/1.1" 200 None
2026-03-27 16:48:43 [ayvens.fr] INFO: Scrape type for 1988336: 1
2026-03-27 16:48:43 [ayvens.fr] INFO: Extracting data for car ID: 1988336
2026-03-27 16:48:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0d200a7-dfb7-581d-ab61-89ef31a8ab93 with identifier: 1988336
2026-03-27 16:48:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0d200a7-dfb7-581d-ab61-89ef31a8ab93 with scrape type 1
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e0d200a7-dfb7-581d-ab61-89ef31a8ab93
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa9fd5144ebf14418934fbafd613ecfa6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/1.jpg not downloaded yet
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa9fd5144ebf14418934fbafd613ecfa6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/2.jpg not downloaded yet
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa9fd5144ebf14418934fbafd613ecfa6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/3.jpg not downloaded yet
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa9fd5144ebf14418934fbafd613ecfa6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/4.jpg not downloaded yet
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b072d0>
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d963b4-67d8-590a-83e6-7876f251aa4e/e2d963b4-67d8-590a-83e6-7876f251aa4e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fdaad9eeaa4c04780942bdd9949296353%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/3.jpg saved to cache
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2d963b4-67d8-590a-83e6-7876f251aa4e
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590edbbd0>
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d963b4-67d8-590a-83e6-7876f251aa4e/e2d963b4-67d8-590a-83e6-7876f251aa4e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fdaad9eeaa4c04780942bdd9949296353%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/6.jpg saved to cache
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2d963b4-67d8-590a-83e6-7876f251aa4e
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066c410>
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d963b4-67d8-590a-83e6-7876f251aa4e/e2d963b4-67d8-590a-83e6-7876f251aa4e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fdaad9eeaa4c04780942bdd9949296353%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/7.jpg saved to cache
2026-03-27 16:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2d963b4-67d8-590a-83e6-7876f251aa4e
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a3d90>
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d963b4-67d8-590a-83e6-7876f251aa4e/e2d963b4-67d8-590a-83e6-7876f251aa4e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fdaad9eeaa4c04780942bdd9949296353%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/1.jpg saved to cache
2026-03-27 16:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2d963b4-67d8-590a-83e6-7876f251aa4e
2026-03-27 16:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd2190>
2026-03-27 16:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d963b4-67d8-590a-83e6-7876f251aa4e/e2d963b4-67d8-590a-83e6-7876f251aa4e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fdaad9eeaa4c04780942bdd9949296353%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/4.jpg saved to cache
2026-03-27 16:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2d963b4-67d8-590a-83e6-7876f251aa4e
2026-03-27 16:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d79090>
2026-03-27 16:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d963b4-67d8-590a-83e6-7876f251aa4e/e2d963b4-67d8-590a-83e6-7876f251aa4e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fdaad9eeaa4c04780942bdd9949296353%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/5.jpg saved to cache
2026-03-27 16:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2d963b4-67d8-590a-83e6-7876f251aa4e
2026-03-27 16:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa9fd5144ebf14418934fbafd613ecfa6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/5.jpg not downloaded yet
2026-03-27 16:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d8cbd0>
2026-03-27 16:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d963b4-67d8-590a-83e6-7876f251aa4e/e2d963b4-67d8-590a-83e6-7876f251aa4e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fdaad9eeaa4c04780942bdd9949296353%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/2.jpg saved to cache
2026-03-27 16:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2d963b4-67d8-590a-83e6-7876f251aa4e
2026-03-27 16:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f80ad0>
2026-03-27 16:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b81f58d8-7617-57a9-9ed7-dd33055d4731/b81f58d8-7617-57a9-9ed7-dd33055d4731_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F4281d31ca53b45bfb4d61497d8b47af2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/8.jpg saved to cache
2026-03-27 16:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b81f58d8-7617-57a9-9ed7-dd33055d4731
2026-03-27 16:48:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b81f58d8-7617-57a9-9ed7-dd33055d4731, skipping ID generation
2026-03-27 16:48:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b81f58d8-7617-57a9-9ed7-dd33055d4731 with scrape type 1
2026-03-27 16:48:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b81f58d8-7617-57a9-9ed7-dd33055d4731 sending to next pipeline
2026-03-27 16:48:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b81f58d8-7617-57a9-9ed7-dd33055d4731, identifier: 1988333
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa9fd5144ebf14418934fbafd613ecfa6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/6.jpg not downloaded yet
2026-03-27 16:48:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b81f58d8-7617-57a9-9ed7-dd33055d4731 with identifier: 1988333
2026-03-27 16:48:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:48:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b81f58d8-7617-57a9-9ed7-dd33055d4731 with identifier: 1988333
2026-03-27 16:48:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b81f58d8-7617-57a9-9ed7-dd33055d4731 with identifier: 1988333 to the API
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'GRIS REFLET D',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'b81f58d8-7617-57a9-9ed7-dd33055d4731',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 109791,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b81f58d8-7617-57a9-9ed7-dd33055d4731/b81f58d8-7617-57a9-9ed7-dd33055d4731_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304742,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b81f58d8-7617-57a9-9ed7-dd33055d4731/b81f58d8-7617-57a9-9ed7-dd33055d4731_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304742,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b81f58d8-7617-57a9-9ed7-dd33055d4731/b81f58d8-7617-57a9-9ed7-dd33055d4731_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325199,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b81f58d8-7617-57a9-9ed7-dd33055d4731/b81f58d8-7617-57a9-9ed7-dd33055d4731_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297646,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b81f58d8-7617-57a9-9ed7-dd33055d4731/b81f58d8-7617-57a9-9ed7-dd33055d4731_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326020,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b81f58d8-7617-57a9-9ed7-dd33055d4731/b81f58d8-7617-57a9-9ed7-dd33055d4731_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306399,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b81f58d8-7617-57a9-9ed7-dd33055d4731/b81f58d8-7617-57a9-9ed7-dd33055d4731_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243659,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b81f58d8-7617-57a9-9ed7-dd33055d4731/b81f58d8-7617-57a9-9ed7-dd33055d4731_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411138,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/4281d31ca53b45bfb4d61497d8b47af2/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-11',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN GOLF Golf 2.0 TDI SCR 115ch Life Business DSG7',
'transmission': 'automatic',
'trim': 'Golf 2.0 TDI SCR 115ch Life Business DSG7',
'vin': None,
'year': 2022}
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988333%27 HTTP/1.1" 200 None
2026-03-27 16:48:44 [ayvens.fr] INFO: Saving data for 1988333: {'created_time': 1774630124.874156, 'last_price_update_time': 1774630124.874167, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988333') HTTP/1.1" 204 0
2026-03-27 16:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa9fd5144ebf14418934fbafd613ecfa6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/7.jpg not downloaded yet
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df4e10>
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7606c4c4-d88f-513e-b6a0-c0027d1bf000/7606c4c4-d88f-513e-b6a0-c0027d1bf000_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7e1262b05fd74109beb810b9c3d741df%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/2.jpg saved to cache
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7606c4c4-d88f-513e-b6a0-c0027d1bf000
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590528810>
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7606c4c4-d88f-513e-b6a0-c0027d1bf000/7606c4c4-d88f-513e-b6a0-c0027d1bf000_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7e1262b05fd74109beb810b9c3d741df%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/1.jpg saved to cache
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7606c4c4-d88f-513e-b6a0-c0027d1bf000
2026-03-27 16:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa9fd5144ebf14418934fbafd613ecfa6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/8.jpg not downloaded yet
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa9fd5144ebf14418934fbafd613ecfa6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/9.jpg not downloaded yet
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590528d90>
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7606c4c4-d88f-513e-b6a0-c0027d1bf000/7606c4c4-d88f-513e-b6a0-c0027d1bf000_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7e1262b05fd74109beb810b9c3d741df%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/4.jpg saved to cache
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7606c4c4-d88f-513e-b6a0-c0027d1bf000
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591052450>
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7606c4c4-d88f-513e-b6a0-c0027d1bf000/7606c4c4-d88f-513e-b6a0-c0027d1bf000_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7e1262b05fd74109beb810b9c3d741df%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/5.jpg saved to cache
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7606c4c4-d88f-513e-b6a0-c0027d1bf000
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905aacd0>
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7606c4c4-d88f-513e-b6a0-c0027d1bf000/7606c4c4-d88f-513e-b6a0-c0027d1bf000_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7e1262b05fd74109beb810b9c3d741df%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/7.jpg saved to cache
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7606c4c4-d88f-513e-b6a0-c0027d1bf000
2026-03-27 16:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa9fd5144ebf14418934fbafd613ecfa6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/10.jpg not downloaded yet
2026-03-27 16:48:45 [ayvens.fr] INFO: Found listing with ID: 1988337
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988337%27 HTTP/1.1" 200 None
2026-03-27 16:48:45 [ayvens.fr] INFO: Scrape type for 1988337: 1
2026-03-27 16:48:45 [ayvens.fr] INFO: Extracting data for car ID: 1988337
2026-03-27 16:48:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ec4f5d4-bb11-5174-98d0-177289f208c1 with identifier: 1988337
2026-03-27 16:48:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ec4f5d4-bb11-5174-98d0-177289f208c1 with scrape type 1
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5ec4f5d4-bb11-5174-98d0-177289f208c1
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fbfb9e7ce9f6e4792899bb0b7182dcffa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/1.jpg not downloaded yet
2026-03-27 16:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fbfb9e7ce9f6e4792899bb0b7182dcffa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/2.jpg not downloaded yet
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910511d0>
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d963b4-67d8-590a-83e6-7876f251aa4e/e2d963b4-67d8-590a-83e6-7876f251aa4e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fdaad9eeaa4c04780942bdd9949296353%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/8.jpg saved to cache
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2d963b4-67d8-590a-83e6-7876f251aa4e
2026-03-27 16:48:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2d963b4-67d8-590a-83e6-7876f251aa4e, skipping ID generation
2026-03-27 16:48:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2d963b4-67d8-590a-83e6-7876f251aa4e with scrape type 1
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2d963b4-67d8-590a-83e6-7876f251aa4e sending to next pipeline
2026-03-27 16:48:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e2d963b4-67d8-590a-83e6-7876f251aa4e, identifier: 1988334
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590511a90>
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7606c4c4-d88f-513e-b6a0-c0027d1bf000/7606c4c4-d88f-513e-b6a0-c0027d1bf000_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7e1262b05fd74109beb810b9c3d741df%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/6.jpg saved to cache
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7606c4c4-d88f-513e-b6a0-c0027d1bf000
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591052090>
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7606c4c4-d88f-513e-b6a0-c0027d1bf000/7606c4c4-d88f-513e-b6a0-c0027d1bf000_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7e1262b05fd74109beb810b9c3d741df%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/3.jpg saved to cache
2026-03-27 16:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7606c4c4-d88f-513e-b6a0-c0027d1bf000
2026-03-27 16:48:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e2d963b4-67d8-590a-83e6-7876f251aa4e with identifier: 1988334
2026-03-27 16:48:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e2d963b4-67d8-590a-83e6-7876f251aa4e with identifier: 1988334
2026-03-27 16:48:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e2d963b4-67d8-590a-83e6-7876f251aa4e with identifier: 1988334 to the API
2026-03-27 16:48:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 87,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'e2d963b4-67d8-590a-83e6-7876f251aa4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS HYBRID',
'odometer': 91549,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d963b4-67d8-590a-83e6-7876f251aa4e/e2d963b4-67d8-590a-83e6-7876f251aa4e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d963b4-67d8-590a-83e6-7876f251aa4e/e2d963b4-67d8-590a-83e6-7876f251aa4e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d963b4-67d8-590a-83e6-7876f251aa4e/e2d963b4-67d8-590a-83e6-7876f251aa4e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393290,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d963b4-67d8-590a-83e6-7876f251aa4e/e2d963b4-67d8-590a-83e6-7876f251aa4e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348334,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d963b4-67d8-590a-83e6-7876f251aa4e/e2d963b4-67d8-590a-83e6-7876f251aa4e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346043,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d963b4-67d8-590a-83e6-7876f251aa4e/e2d963b4-67d8-590a-83e6-7876f251aa4e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287939,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d963b4-67d8-590a-83e6-7876f251aa4e/e2d963b4-67d8-590a-83e6-7876f251aa4e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274036,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d963b4-67d8-590a-83e6-7876f251aa4e/e2d963b4-67d8-590a-83e6-7876f251aa4e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349278,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/daad9eeaa4c04780942bdd9949296353/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-07',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA YARIS HYBRID Yaris 116h Dynamic 5p',
'transmission': 'automatic',
'trim': 'Yaris 116h Dynamic 5p',
'vin': None,
'year': 2022}
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988334%27 HTTP/1.1" 200 None
2026-03-27 16:48:46 [ayvens.fr] INFO: Saving data for 1988334: {'created_time': 1774630126.2299, 'last_price_update_time': 1774630126.229912, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988334') HTTP/1.1" 204 0
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fbfb9e7ce9f6e4792899bb0b7182dcffa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/3.jpg not downloaded yet
2026-03-27 16:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fbfb9e7ce9f6e4792899bb0b7182dcffa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/4.jpg not downloaded yet
2026-03-27 16:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d76d10>
2026-03-27 16:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7606c4c4-d88f-513e-b6a0-c0027d1bf000/7606c4c4-d88f-513e-b6a0-c0027d1bf000_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7e1262b05fd74109beb810b9c3d741df%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/8.jpg saved to cache
2026-03-27 16:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7606c4c4-d88f-513e-b6a0-c0027d1bf000
2026-03-27 16:48:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7606c4c4-d88f-513e-b6a0-c0027d1bf000, skipping ID generation
2026-03-27 16:48:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7606c4c4-d88f-513e-b6a0-c0027d1bf000 with scrape type 1
2026-03-27 16:48:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7606c4c4-d88f-513e-b6a0-c0027d1bf000 sending to next pipeline
2026-03-27 16:48:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7606c4c4-d88f-513e-b6a0-c0027d1bf000, identifier: 1988335
2026-03-27 16:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d77a90>
2026-03-27 16:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d200a7-dfb7-581d-ab61-89ef31a8ab93/e0d200a7-dfb7-581d-ab61-89ef31a8ab93_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa9fd5144ebf14418934fbafd613ecfa6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/1.jpg saved to cache
2026-03-27 16:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0d200a7-dfb7-581d-ab61-89ef31a8ab93
2026-03-27 16:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fbfb9e7ce9f6e4792899bb0b7182dcffa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/5.jpg not downloaded yet
2026-03-27 16:48:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7606c4c4-d88f-513e-b6a0-c0027d1bf000 with identifier: 1988335
2026-03-27 16:48:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:48:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7606c4c4-d88f-513e-b6a0-c0027d1bf000 with identifier: 1988335
2026-03-27 16:48:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7606c4c4-d88f-513e-b6a0-c0027d1bf000 with identifier: 1988335 to the API
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 141,
'color': 'SKYSCRAPER GREY',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '7606c4c4-d88f-513e-b6a0-c0027d1bf000',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 2 ACTIVE TOURE',
'odometer': 7800,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7606c4c4-d88f-513e-b6a0-c0027d1bf000/7606c4c4-d88f-513e-b6a0-c0027d1bf000_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313806,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7606c4c4-d88f-513e-b6a0-c0027d1bf000/7606c4c4-d88f-513e-b6a0-c0027d1bf000_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313806,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7606c4c4-d88f-513e-b6a0-c0027d1bf000/7606c4c4-d88f-513e-b6a0-c0027d1bf000_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329621,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7606c4c4-d88f-513e-b6a0-c0027d1bf000/7606c4c4-d88f-513e-b6a0-c0027d1bf000_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317364,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7606c4c4-d88f-513e-b6a0-c0027d1bf000/7606c4c4-d88f-513e-b6a0-c0027d1bf000_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309726,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7606c4c4-d88f-513e-b6a0-c0027d1bf000/7606c4c4-d88f-513e-b6a0-c0027d1bf000_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327578,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7606c4c4-d88f-513e-b6a0-c0027d1bf000/7606c4c4-d88f-513e-b6a0-c0027d1bf000_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313981,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7606c4c4-d88f-513e-b6a0-c0027d1bf000/7606c4c4-d88f-513e-b6a0-c0027d1bf000_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394575,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7e1262b05fd74109beb810b9c3d741df/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-22',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 2 ACTIVE TOURE Serie 2 ActiveTourer 218i 136ch Business '
'Design DKG7',
'transmission': 'automatic',
'trim': 'Serie 2 ActiveTourer 218i 136ch Business Design DKG7',
'vin': None,
'year': 2024}
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988335%27 HTTP/1.1" 200 None
2026-03-27 16:48:46 [ayvens.fr] INFO: Saving data for 1988335: {'created_time': 1774630126.973218, 'last_price_update_time': 1774630126.973229, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988335') HTTP/1.1" 204 0
2026-03-27 16:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fbfb9e7ce9f6e4792899bb0b7182dcffa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/6.jpg not downloaded yet
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f80fd0>
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d200a7-dfb7-581d-ab61-89ef31a8ab93/e0d200a7-dfb7-581d-ab61-89ef31a8ab93_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa9fd5144ebf14418934fbafd613ecfa6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/3.jpg saved to cache
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e0d200a7-dfb7-581d-ab61-89ef31a8ab93
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7d810>
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d200a7-dfb7-581d-ab61-89ef31a8ab93/e0d200a7-dfb7-581d-ab61-89ef31a8ab93_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa9fd5144ebf14418934fbafd613ecfa6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/2.jpg saved to cache
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e0d200a7-dfb7-581d-ab61-89ef31a8ab93
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590590190>
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d200a7-dfb7-581d-ab61-89ef31a8ab93/e0d200a7-dfb7-581d-ab61-89ef31a8ab93_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa9fd5144ebf14418934fbafd613ecfa6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/4.jpg saved to cache
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e0d200a7-dfb7-581d-ab61-89ef31a8ab93
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fbfb9e7ce9f6e4792899bb0b7182dcffa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/7.jpg not downloaded yet
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7e850>
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d200a7-dfb7-581d-ab61-89ef31a8ab93/e0d200a7-dfb7-581d-ab61-89ef31a8ab93_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa9fd5144ebf14418934fbafd613ecfa6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/7.jpg saved to cache
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e0d200a7-dfb7-581d-ab61-89ef31a8ab93
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fc8f90>
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d200a7-dfb7-581d-ab61-89ef31a8ab93/e0d200a7-dfb7-581d-ab61-89ef31a8ab93_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa9fd5144ebf14418934fbafd613ecfa6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/5.jpg saved to cache
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e0d200a7-dfb7-581d-ab61-89ef31a8ab93
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df6ed0>
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d200a7-dfb7-581d-ab61-89ef31a8ab93/e0d200a7-dfb7-581d-ab61-89ef31a8ab93_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa9fd5144ebf14418934fbafd613ecfa6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/6.jpg saved to cache
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e0d200a7-dfb7-581d-ab61-89ef31a8ab93
2026-03-27 16:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fbfb9e7ce9f6e4792899bb0b7182dcffa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/8.jpg not downloaded yet
2026-03-27 16:48:47 [ayvens.fr] INFO: Found listing with ID: 1988338
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988338%27 HTTP/1.1" 200 None
2026-03-27 16:48:47 [ayvens.fr] INFO: Scrape type for 1988338: 1
2026-03-27 16:48:47 [ayvens.fr] INFO: Extracting data for car ID: 1988338
2026-03-27 16:48:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02ce5fbf-b08e-57ac-ba15-a2d948187947 with identifier: 1988338
2026-03-27 16:48:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02ce5fbf-b08e-57ac-ba15-a2d948187947 with scrape type 1
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 02ce5fbf-b08e-57ac-ba15-a2d948187947
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fc7f2d08510414cb9a642311c0cc40d08%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/1.jpg not downloaded yet
2026-03-27 16:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fc7f2d08510414cb9a642311c0cc40d08%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/2.jpg not downloaded yet
2026-03-27 16:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fc7f2d08510414cb9a642311c0cc40d08%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/3.jpg not downloaded yet
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fc7f2d08510414cb9a642311c0cc40d08%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/4.jpg not downloaded yet
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fc7f2d08510414cb9a642311c0cc40d08%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/5.jpg not downloaded yet
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fcb910>
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d200a7-dfb7-581d-ab61-89ef31a8ab93/e0d200a7-dfb7-581d-ab61-89ef31a8ab93_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa9fd5144ebf14418934fbafd613ecfa6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/8.jpg saved to cache
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e0d200a7-dfb7-581d-ab61-89ef31a8ab93
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0d150>
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d200a7-dfb7-581d-ab61-89ef31a8ab93/e0d200a7-dfb7-581d-ab61-89ef31a8ab93_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa9fd5144ebf14418934fbafd613ecfa6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/9.jpg saved to cache
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e0d200a7-dfb7-581d-ab61-89ef31a8ab93
2026-03-27 16:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fc7f2d08510414cb9a642311c0cc40d08%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/6.jpg not downloaded yet
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fc7f2d08510414cb9a642311c0cc40d08%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/7.jpg not downloaded yet
2026-03-27 16:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59067d9d0>
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ec4f5d4-bb11-5174-98d0-177289f208c1/5ec4f5d4-bb11-5174-98d0-177289f208c1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fbfb9e7ce9f6e4792899bb0b7182dcffa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/4.jpg saved to cache
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5ec4f5d4-bb11-5174-98d0-177289f208c1
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b34150>
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ec4f5d4-bb11-5174-98d0-177289f208c1/5ec4f5d4-bb11-5174-98d0-177289f208c1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fbfb9e7ce9f6e4792899bb0b7182dcffa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/3.jpg saved to cache
2026-03-27 16:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5ec4f5d4-bb11-5174-98d0-177289f208c1
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911cc910>
2026-03-27 16:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d200a7-dfb7-581d-ab61-89ef31a8ab93/e0d200a7-dfb7-581d-ab61-89ef31a8ab93_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa9fd5144ebf14418934fbafd613ecfa6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/10.jpg saved to cache
2026-03-27 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e0d200a7-dfb7-581d-ab61-89ef31a8ab93
2026-03-27 16:48:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0d200a7-dfb7-581d-ab61-89ef31a8ab93, skipping ID generation
2026-03-27 16:48:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0d200a7-dfb7-581d-ab61-89ef31a8ab93 with scrape type 1
2026-03-27 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0d200a7-dfb7-581d-ab61-89ef31a8ab93 sending to next pipeline
2026-03-27 16:48:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e0d200a7-dfb7-581d-ab61-89ef31a8ab93, identifier: 1988336
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068ec50>
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ec4f5d4-bb11-5174-98d0-177289f208c1/5ec4f5d4-bb11-5174-98d0-177289f208c1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fbfb9e7ce9f6e4792899bb0b7182dcffa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/1.jpg saved to cache
2026-03-27 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ec4f5d4-bb11-5174-98d0-177289f208c1
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fcb1d0>
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ec4f5d4-bb11-5174-98d0-177289f208c1/5ec4f5d4-bb11-5174-98d0-177289f208c1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fbfb9e7ce9f6e4792899bb0b7182dcffa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/2.jpg saved to cache
2026-03-27 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5ec4f5d4-bb11-5174-98d0-177289f208c1
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae93d0>
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ec4f5d4-bb11-5174-98d0-177289f208c1/5ec4f5d4-bb11-5174-98d0-177289f208c1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fbfb9e7ce9f6e4792899bb0b7182dcffa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/5.jpg saved to cache
2026-03-27 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5ec4f5d4-bb11-5174-98d0-177289f208c1
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fc7f2d08510414cb9a642311c0cc40d08%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/8.jpg not downloaded yet
2026-03-27 16:48:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e0d200a7-dfb7-581d-ab61-89ef31a8ab93 with identifier: 1988336
2026-03-27 16:48:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e0d200a7-dfb7-581d-ab61-89ef31a8ab93 with identifier: 1988336
2026-03-27 16:48:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e0d200a7-dfb7-581d-ab61-89ef31a8ab93 with identifier: 1988336 to the API
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': 13,
'color': 'BLEU CAVANSITE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'e0d200a7-dfb7-581d-ab61-89ef31a8ab93',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'CLASSE C',
'odometer': 55815,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d200a7-dfb7-581d-ab61-89ef31a8ab93/e0d200a7-dfb7-581d-ab61-89ef31a8ab93_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 621185,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d200a7-dfb7-581d-ab61-89ef31a8ab93/e0d200a7-dfb7-581d-ab61-89ef31a8ab93_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 621185,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d200a7-dfb7-581d-ab61-89ef31a8ab93/e0d200a7-dfb7-581d-ab61-89ef31a8ab93_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464082,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d200a7-dfb7-581d-ab61-89ef31a8ab93/e0d200a7-dfb7-581d-ab61-89ef31a8ab93_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608775,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d200a7-dfb7-581d-ab61-89ef31a8ab93/e0d200a7-dfb7-581d-ab61-89ef31a8ab93_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 688555,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d200a7-dfb7-581d-ab61-89ef31a8ab93/e0d200a7-dfb7-581d-ab61-89ef31a8ab93_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 742975,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d200a7-dfb7-581d-ab61-89ef31a8ab93/e0d200a7-dfb7-581d-ab61-89ef31a8ab93_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 705275,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d200a7-dfb7-581d-ab61-89ef31a8ab93/e0d200a7-dfb7-581d-ab61-89ef31a8ab93_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 695357,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d200a7-dfb7-581d-ab61-89ef31a8ab93/e0d200a7-dfb7-581d-ab61-89ef31a8ab93_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596354,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d200a7-dfb7-581d-ab61-89ef31a8ab93/e0d200a7-dfb7-581d-ab61-89ef31a8ab93_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 674386,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a9fd5144ebf14418934fbafd613ecfa6/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-11',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ CLASSE C Classe C 300 e 204+129ch Avantgarde Line',
'transmission': 'automatic',
'trim': 'Classe C 300 e 204+129ch Avantgarde Line',
'vin': None,
'year': 2022}
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988336%27 HTTP/1.1" 200 None
2026-03-27 16:48:48 [ayvens.fr] INFO: Saving data for 1988336: {'created_time': 1774630128.896564, 'last_price_update_time': 1774630128.896576, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988336') HTTP/1.1" 204 0
2026-03-27 16:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:48 [ayvens.fr] INFO: Found listing with ID: 1988339
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988339%27 HTTP/1.1" 200 None
2026-03-27 16:48:48 [ayvens.fr] INFO: Scrape type for 1988339: 1
2026-03-27 16:48:48 [ayvens.fr] INFO: Extracting data for car ID: 1988339
2026-03-27 16:48:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc with identifier: 1988339
2026-03-27 16:48:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc with scrape type 1
2026-03-27 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fdbcec4cdfc5c45f88e8fdd41eab90c2c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/1.jpg not downloaded yet
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d43a50>
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ec4f5d4-bb11-5174-98d0-177289f208c1/5ec4f5d4-bb11-5174-98d0-177289f208c1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fbfb9e7ce9f6e4792899bb0b7182dcffa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/7.jpg saved to cache
2026-03-27 16:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5ec4f5d4-bb11-5174-98d0-177289f208c1
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfe910>
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ec4f5d4-bb11-5174-98d0-177289f208c1/5ec4f5d4-bb11-5174-98d0-177289f208c1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fbfb9e7ce9f6e4792899bb0b7182dcffa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/8.jpg saved to cache
2026-03-27 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5ec4f5d4-bb11-5174-98d0-177289f208c1
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fdbcec4cdfc5c45f88e8fdd41eab90c2c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/2.jpg not downloaded yet
2026-03-27 16:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fdbcec4cdfc5c45f88e8fdd41eab90c2c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/3.jpg not downloaded yet
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59102f7d0>
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ec4f5d4-bb11-5174-98d0-177289f208c1/5ec4f5d4-bb11-5174-98d0-177289f208c1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fbfb9e7ce9f6e4792899bb0b7182dcffa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/6.jpg saved to cache
2026-03-27 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5ec4f5d4-bb11-5174-98d0-177289f208c1
2026-03-27 16:48:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ec4f5d4-bb11-5174-98d0-177289f208c1, skipping ID generation
2026-03-27 16:48:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ec4f5d4-bb11-5174-98d0-177289f208c1 with scrape type 1
2026-03-27 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ec4f5d4-bb11-5174-98d0-177289f208c1 sending to next pipeline
2026-03-27 16:48:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5ec4f5d4-bb11-5174-98d0-177289f208c1, identifier: 1988337
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2cb10>
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ce5fbf-b08e-57ac-ba15-a2d948187947/02ce5fbf-b08e-57ac-ba15-a2d948187947_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fc7f2d08510414cb9a642311c0cc40d08%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/1.jpg saved to cache
2026-03-27 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02ce5fbf-b08e-57ac-ba15-a2d948187947
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59308c510>
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ce5fbf-b08e-57ac-ba15-a2d948187947/02ce5fbf-b08e-57ac-ba15-a2d948187947_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fc7f2d08510414cb9a642311c0cc40d08%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/2.jpg saved to cache
2026-03-27 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02ce5fbf-b08e-57ac-ba15-a2d948187947
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae8290>
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ce5fbf-b08e-57ac-ba15-a2d948187947/02ce5fbf-b08e-57ac-ba15-a2d948187947_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fc7f2d08510414cb9a642311c0cc40d08%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/3.jpg saved to cache
2026-03-27 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02ce5fbf-b08e-57ac-ba15-a2d948187947
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fdbcec4cdfc5c45f88e8fdd41eab90c2c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/4.jpg not downloaded yet
2026-03-27 16:48:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5ec4f5d4-bb11-5174-98d0-177289f208c1 with identifier: 1988337
2026-03-27 16:48:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5ec4f5d4-bb11-5174-98d0-177289f208c1 with identifier: 1988337
2026-03-27 16:48:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5ec4f5d4-bb11-5174-98d0-177289f208c1 with identifier: 1988337 to the API
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'NOIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.5L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '5ec4f5d4-bb11-5174-98d0-177289f208c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'MODEL Y',
'odometer': 71002,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ec4f5d4-bb11-5174-98d0-177289f208c1/5ec4f5d4-bb11-5174-98d0-177289f208c1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557890,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ec4f5d4-bb11-5174-98d0-177289f208c1/5ec4f5d4-bb11-5174-98d0-177289f208c1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557890,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ec4f5d4-bb11-5174-98d0-177289f208c1/5ec4f5d4-bb11-5174-98d0-177289f208c1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492540,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ec4f5d4-bb11-5174-98d0-177289f208c1/5ec4f5d4-bb11-5174-98d0-177289f208c1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389672,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ec4f5d4-bb11-5174-98d0-177289f208c1/5ec4f5d4-bb11-5174-98d0-177289f208c1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357042,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ec4f5d4-bb11-5174-98d0-177289f208c1/5ec4f5d4-bb11-5174-98d0-177289f208c1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343550,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ec4f5d4-bb11-5174-98d0-177289f208c1/5ec4f5d4-bb11-5174-98d0-177289f208c1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 241095,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ec4f5d4-bb11-5174-98d0-177289f208c1/5ec4f5d4-bb11-5174-98d0-177289f208c1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 219804,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/bfb9e7ce9f6e4792899bb0b7182dcffa/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-21',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA MODEL Y Model Y Performance AWD',
'transmission': 'automatic',
'trim': 'Model Y Performance AWD',
'vin': None,
'year': 2022}
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988337%27 HTTP/1.1" 200 None
2026-03-27 16:48:49 [ayvens.fr] INFO: Saving data for 1988337: {'created_time': 1774630129.853069, 'last_price_update_time': 1774630129.853081, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988337') HTTP/1.1" 204 0
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fdbcec4cdfc5c45f88e8fdd41eab90c2c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/5.jpg not downloaded yet
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3eb10>
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ce5fbf-b08e-57ac-ba15-a2d948187947/02ce5fbf-b08e-57ac-ba15-a2d948187947_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fc7f2d08510414cb9a642311c0cc40d08%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/5.jpg saved to cache
2026-03-27 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02ce5fbf-b08e-57ac-ba15-a2d948187947
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abe1d0>
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ce5fbf-b08e-57ac-ba15-a2d948187947/02ce5fbf-b08e-57ac-ba15-a2d948187947_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fc7f2d08510414cb9a642311c0cc40d08%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/4.jpg saved to cache
2026-03-27 16:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02ce5fbf-b08e-57ac-ba15-a2d948187947
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ad7a50>
2026-03-27 16:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ce5fbf-b08e-57ac-ba15-a2d948187947/02ce5fbf-b08e-57ac-ba15-a2d948187947_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fc7f2d08510414cb9a642311c0cc40d08%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/6.jpg saved to cache
2026-03-27 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02ce5fbf-b08e-57ac-ba15-a2d948187947
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fdbcec4cdfc5c45f88e8fdd41eab90c2c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/6.jpg not downloaded yet
2026-03-27 16:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fdbcec4cdfc5c45f88e8fdd41eab90c2c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/7.jpg not downloaded yet
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fdbcec4cdfc5c45f88e8fdd41eab90c2c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/8.jpg not downloaded yet
2026-03-27 16:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:50 [ayvens.fr] INFO: Found listing with ID: 1988340
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988340%27 HTTP/1.1" 200 None
2026-03-27 16:48:50 [ayvens.fr] INFO: Scrape type for 1988340: 1
2026-03-27 16:48:50 [ayvens.fr] INFO: Extracting data for car ID: 1988340
2026-03-27 16:48:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfcbe4db-2a35-54a3-b613-72ce2b4383f5 with identifier: 1988340
2026-03-27 16:48:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfcbe4db-2a35-54a3-b613-72ce2b4383f5 with scrape type 1
2026-03-27 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item dfcbe4db-2a35-54a3-b613-72ce2b4383f5
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F279caf2223dc4513a88e22e1d38df567%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/1.jpg not downloaded yet
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F279caf2223dc4513a88e22e1d38df567%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/2.jpg not downloaded yet
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F279caf2223dc4513a88e22e1d38df567%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/3.jpg not downloaded yet
2026-03-27 16:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592c2c490>
2026-03-27 16:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ce5fbf-b08e-57ac-ba15-a2d948187947/02ce5fbf-b08e-57ac-ba15-a2d948187947_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fc7f2d08510414cb9a642311c0cc40d08%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/7.jpg saved to cache
2026-03-27 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 02ce5fbf-b08e-57ac-ba15-a2d948187947
2026-03-27 16:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066b790>
2026-03-27 16:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ce5fbf-b08e-57ac-ba15-a2d948187947/02ce5fbf-b08e-57ac-ba15-a2d948187947_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fc7f2d08510414cb9a642311c0cc40d08%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/8.jpg saved to cache
2026-03-27 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 02ce5fbf-b08e-57ac-ba15-a2d948187947
2026-03-27 16:48:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02ce5fbf-b08e-57ac-ba15-a2d948187947, skipping ID generation
2026-03-27 16:48:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02ce5fbf-b08e-57ac-ba15-a2d948187947 with scrape type 1
2026-03-27 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02ce5fbf-b08e-57ac-ba15-a2d948187947 sending to next pipeline
2026-03-27 16:48:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 02ce5fbf-b08e-57ac-ba15-a2d948187947, identifier: 1988338
2026-03-27 16:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590657b10>
2026-03-27 16:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc/6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fdbcec4cdfc5c45f88e8fdd41eab90c2c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/1.jpg saved to cache
2026-03-27 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F279caf2223dc4513a88e22e1d38df567%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/4.jpg not downloaded yet
2026-03-27 16:48:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 02ce5fbf-b08e-57ac-ba15-a2d948187947 with identifier: 1988338
2026-03-27 16:48:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 02ce5fbf-b08e-57ac-ba15-a2d948187947 with identifier: 1988338
2026-03-27 16:48:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 02ce5fbf-b08e-57ac-ba15-a2d948187947 with identifier: 1988338 to the API
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '02ce5fbf-b08e-57ac-ba15-a2d948187947',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 115010,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ce5fbf-b08e-57ac-ba15-a2d948187947/02ce5fbf-b08e-57ac-ba15-a2d948187947_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294974,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ce5fbf-b08e-57ac-ba15-a2d948187947/02ce5fbf-b08e-57ac-ba15-a2d948187947_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294974,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ce5fbf-b08e-57ac-ba15-a2d948187947/02ce5fbf-b08e-57ac-ba15-a2d948187947_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301730,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ce5fbf-b08e-57ac-ba15-a2d948187947/02ce5fbf-b08e-57ac-ba15-a2d948187947_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290445,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ce5fbf-b08e-57ac-ba15-a2d948187947/02ce5fbf-b08e-57ac-ba15-a2d948187947_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318282,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ce5fbf-b08e-57ac-ba15-a2d948187947/02ce5fbf-b08e-57ac-ba15-a2d948187947_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297616,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ce5fbf-b08e-57ac-ba15-a2d948187947/02ce5fbf-b08e-57ac-ba15-a2d948187947_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348117,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ce5fbf-b08e-57ac-ba15-a2d948187947/02ce5fbf-b08e-57ac-ba15-a2d948187947_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326302,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/c7f2d08510414cb9a642311c0cc40d08/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-03',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.0 TCe 90ch Business',
'transmission': 'manual',
'trim': 'Clio 1.0 TCe 90ch Business',
'vin': None,
'year': 2021}
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988338%27 HTTP/1.1" 200 None
2026-03-27 16:48:50 [ayvens.fr] INFO: Saving data for 1988338: {'created_time': 1774630130.942463, 'last_price_update_time': 1774630130.942475, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988338') HTTP/1.1" 204 0
2026-03-27 16:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F279caf2223dc4513a88e22e1d38df567%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/5.jpg not downloaded yet
2026-03-27 16:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905290d0>
2026-03-27 16:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc/6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fdbcec4cdfc5c45f88e8fdd41eab90c2c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/3.jpg saved to cache
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc
2026-03-27 16:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F279caf2223dc4513a88e22e1d38df567%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/6.jpg not downloaded yet
2026-03-27 16:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F279caf2223dc4513a88e22e1d38df567%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/7.jpg not downloaded yet
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59064e910>
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc/6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fdbcec4cdfc5c45f88e8fdd41eab90c2c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/7.jpg saved to cache
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c0650>
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc/6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fdbcec4cdfc5c45f88e8fdd41eab90c2c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/2.jpg saved to cache
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F279caf2223dc4513a88e22e1d38df567%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/8.jpg not downloaded yet
2026-03-27 16:48:51 [ayvens.fr] INFO: Found listing with ID: 1988341
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988341%27 HTTP/1.1" 200 None
2026-03-27 16:48:51 [ayvens.fr] INFO: Scrape type for 1988341: 1
2026-03-27 16:48:51 [ayvens.fr] INFO: Extracting data for car ID: 1988341
2026-03-27 16:48:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e with identifier: 1988341
2026-03-27 16:48:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e with scrape type 1
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F220cd2779efe44ca879f4fb5c2964e84%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/1.jpg not downloaded yet
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae8910>
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc/6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fdbcec4cdfc5c45f88e8fdd41eab90c2c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/6.jpg saved to cache
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0df50>
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc/6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fdbcec4cdfc5c45f88e8fdd41eab90c2c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/4.jpg saved to cache
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa2450>
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc/6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fdbcec4cdfc5c45f88e8fdd41eab90c2c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/5.jpg saved to cache
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d02d0>
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc/6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fdbcec4cdfc5c45f88e8fdd41eab90c2c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/8.jpg saved to cache
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc
2026-03-27 16:48:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc, skipping ID generation
2026-03-27 16:48:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc with scrape type 1
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc sending to next pipeline
2026-03-27 16:48:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc, identifier: 1988339
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051cf10>
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfcbe4db-2a35-54a3-b613-72ce2b4383f5/dfcbe4db-2a35-54a3-b613-72ce2b4383f5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F279caf2223dc4513a88e22e1d38df567%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/1.jpg saved to cache
2026-03-27 16:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dfcbe4db-2a35-54a3-b613-72ce2b4383f5
2026-03-27 16:48:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc with identifier: 1988339
2026-03-27 16:48:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc with identifier: 1988339
2026-03-27 16:48:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc with identifier: 1988339 to the API
2026-03-27 16:48:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 46883,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc/6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384496,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc/6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384496,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc/6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312825,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc/6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313592,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc/6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293682,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc/6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315402,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc/6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185684,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc/6f0d91e1-9c31-550b-8d2f-fdde6d8c6bcc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388863,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/dbcec4cdfc5c45f88e8fdd41eab90c2c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 100ch S&S Active Pack',
'transmission': 'manual',
'trim': '2008 1.2 PureTech 100ch S&S Active Pack',
'vin': None,
'year': 2023}
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988339%27 HTTP/1.1" 200 None
2026-03-27 16:48:52 [ayvens.fr] INFO: Saving data for 1988339: {'created_time': 1774630132.106323, 'last_price_update_time': 1774630132.106333, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988339') HTTP/1.1" 204 0
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F220cd2779efe44ca879f4fb5c2964e84%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/2.jpg not downloaded yet
2026-03-27 16:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F220cd2779efe44ca879f4fb5c2964e84%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/3.jpg not downloaded yet
2026-03-27 16:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F220cd2779efe44ca879f4fb5c2964e84%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/4.jpg not downloaded yet
2026-03-27 16:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F220cd2779efe44ca879f4fb5c2964e84%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/5.jpg not downloaded yet
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F220cd2779efe44ca879f4fb5c2964e84%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/6.jpg not downloaded yet
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F220cd2779efe44ca879f4fb5c2964e84%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/7.jpg not downloaded yet
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f31590>
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfcbe4db-2a35-54a3-b613-72ce2b4383f5/dfcbe4db-2a35-54a3-b613-72ce2b4383f5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F279caf2223dc4513a88e22e1d38df567%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/5.jpg saved to cache
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dfcbe4db-2a35-54a3-b613-72ce2b4383f5
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050c5d0>
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfcbe4db-2a35-54a3-b613-72ce2b4383f5/dfcbe4db-2a35-54a3-b613-72ce2b4383f5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F279caf2223dc4513a88e22e1d38df567%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/3.jpg saved to cache
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dfcbe4db-2a35-54a3-b613-72ce2b4383f5
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b77b90>
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfcbe4db-2a35-54a3-b613-72ce2b4383f5/dfcbe4db-2a35-54a3-b613-72ce2b4383f5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F279caf2223dc4513a88e22e1d38df567%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/2.jpg saved to cache
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dfcbe4db-2a35-54a3-b613-72ce2b4383f5
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a9f90>
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfcbe4db-2a35-54a3-b613-72ce2b4383f5/dfcbe4db-2a35-54a3-b613-72ce2b4383f5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F279caf2223dc4513a88e22e1d38df567%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/7.jpg saved to cache
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dfcbe4db-2a35-54a3-b613-72ce2b4383f5
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b6ac10>
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfcbe4db-2a35-54a3-b613-72ce2b4383f5/dfcbe4db-2a35-54a3-b613-72ce2b4383f5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F279caf2223dc4513a88e22e1d38df567%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/4.jpg saved to cache
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dfcbe4db-2a35-54a3-b613-72ce2b4383f5
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050da50>
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfcbe4db-2a35-54a3-b613-72ce2b4383f5/dfcbe4db-2a35-54a3-b613-72ce2b4383f5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F279caf2223dc4513a88e22e1d38df567%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/6.jpg saved to cache
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dfcbe4db-2a35-54a3-b613-72ce2b4383f5
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F220cd2779efe44ca879f4fb5c2964e84%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/8.jpg not downloaded yet
2026-03-27 16:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:52 [ayvens.fr] INFO: Found listing with ID: 1988342
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988342%27 HTTP/1.1" 200 None
2026-03-27 16:48:52 [ayvens.fr] INFO: Scrape type for 1988342: 1
2026-03-27 16:48:52 [ayvens.fr] INFO: Extracting data for car ID: 1988342
2026-03-27 16:48:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64b07020-583c-59d7-8360-f2f93da51ca7 with identifier: 1988342
2026-03-27 16:48:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64b07020-583c-59d7-8360-f2f93da51ca7 with scrape type 1
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 64b07020-583c-59d7-8360-f2f93da51ca7
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9f7f33abd42e435e8577f4293b9d91e1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/1.jpg not downloaded yet
2026-03-27 16:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9f7f33abd42e435e8577f4293b9d91e1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/2.jpg not downloaded yet
2026-03-27 16:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9f7f33abd42e435e8577f4293b9d91e1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/3.jpg not downloaded yet
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9f7f33abd42e435e8577f4293b9d91e1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/4.jpg not downloaded yet
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9f7f33abd42e435e8577f4293b9d91e1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/5.jpg not downloaded yet
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9f7f33abd42e435e8577f4293b9d91e1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/6.jpg not downloaded yet
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa1190>
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e/a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F220cd2779efe44ca879f4fb5c2964e84%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/3.jpg saved to cache
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e
2026-03-27 16:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9f7f33abd42e435e8577f4293b9d91e1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/7.jpg not downloaded yet
2026-03-27 16:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9f7f33abd42e435e8577f4293b9d91e1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/8.jpg not downloaded yet
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e099d0>
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e/a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F220cd2779efe44ca879f4fb5c2964e84%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/1.jpg saved to cache
2026-03-27 16:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591183210>
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e/a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F220cd2779efe44ca879f4fb5c2964e84%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/2.jpg saved to cache
2026-03-27 16:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e
2026-03-27 16:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904cbc50>
2026-03-27 16:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfcbe4db-2a35-54a3-b613-72ce2b4383f5/dfcbe4db-2a35-54a3-b613-72ce2b4383f5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F279caf2223dc4513a88e22e1d38df567%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/8.jpg saved to cache
2026-03-27 16:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dfcbe4db-2a35-54a3-b613-72ce2b4383f5
2026-03-27 16:48:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dfcbe4db-2a35-54a3-b613-72ce2b4383f5, skipping ID generation
2026-03-27 16:48:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfcbe4db-2a35-54a3-b613-72ce2b4383f5 with scrape type 1
2026-03-27 16:48:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dfcbe4db-2a35-54a3-b613-72ce2b4383f5 sending to next pipeline
2026-03-27 16:48:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: dfcbe4db-2a35-54a3-b613-72ce2b4383f5, identifier: 1988340
2026-03-27 16:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590677810>
2026-03-27 16:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e/a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F220cd2779efe44ca879f4fb5c2964e84%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/4.jpg saved to cache
2026-03-27 16:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e
2026-03-27 16:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df5850>
2026-03-27 16:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e/a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F220cd2779efe44ca879f4fb5c2964e84%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/5.jpg saved to cache
2026-03-27 16:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e
2026-03-27 16:48:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: dfcbe4db-2a35-54a3-b613-72ce2b4383f5 with identifier: 1988340
2026-03-27 16:48:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:48:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: dfcbe4db-2a35-54a3-b613-72ce2b4383f5 with identifier: 1988340
2026-03-27 16:48:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: dfcbe4db-2a35-54a3-b613-72ce2b4383f5 with identifier: 1988340 to the API
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 146,
'color': 'KASCHMIRSILBER A',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'dfcbe4db-2a35-54a3-b613-72ce2b4383f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 2 GRAN TOURER',
'odometer': 26691,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfcbe4db-2a35-54a3-b613-72ce2b4383f5/dfcbe4db-2a35-54a3-b613-72ce2b4383f5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374378,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfcbe4db-2a35-54a3-b613-72ce2b4383f5/dfcbe4db-2a35-54a3-b613-72ce2b4383f5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374378,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfcbe4db-2a35-54a3-b613-72ce2b4383f5/dfcbe4db-2a35-54a3-b613-72ce2b4383f5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404094,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfcbe4db-2a35-54a3-b613-72ce2b4383f5/dfcbe4db-2a35-54a3-b613-72ce2b4383f5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383915,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfcbe4db-2a35-54a3-b613-72ce2b4383f5/dfcbe4db-2a35-54a3-b613-72ce2b4383f5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385297,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfcbe4db-2a35-54a3-b613-72ce2b4383f5/dfcbe4db-2a35-54a3-b613-72ce2b4383f5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345531,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfcbe4db-2a35-54a3-b613-72ce2b4383f5/dfcbe4db-2a35-54a3-b613-72ce2b4383f5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305217,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfcbe4db-2a35-54a3-b613-72ce2b4383f5/dfcbe4db-2a35-54a3-b613-72ce2b4383f5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404559,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/279caf2223dc4513a88e22e1d38df567/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-19',
'seats_number': 7,
'seller_name': None,
'title': 'BMW SERIE 2 GRAN TOURER Serie 2 Gran Tourer 218iA 136ch Luxury DKG7',
'transmission': 'automatic',
'trim': 'Serie 2 Gran Tourer 218iA 136ch Luxury DKG7',
'vin': None,
'year': 2022}
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988340%27 HTTP/1.1" 200 None
2026-03-27 16:48:53 [ayvens.fr] INFO: Saving data for 1988340: {'created_time': 1774630133.843421, 'last_price_update_time': 1774630133.843434, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988340') HTTP/1.1" 204 0
2026-03-27 16:48:53 [ayvens.fr] INFO: Found listing with ID: 1988343
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988343%27 HTTP/1.1" 200 None
2026-03-27 16:48:53 [ayvens.fr] INFO: Scrape type for 1988343: 1
2026-03-27 16:48:53 [ayvens.fr] INFO: Extracting data for car ID: 1988343
2026-03-27 16:48:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0 with identifier: 1988343
2026-03-27 16:48:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0 with scrape type 1
2026-03-27 16:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Ff77a7233e17a41ccb9aaaa23429d36f9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/1.jpg not downloaded yet
2026-03-27 16:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d74450>
2026-03-27 16:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e/a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F220cd2779efe44ca879f4fb5c2964e84%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/6.jpg saved to cache
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e
2026-03-27 16:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590af3b50>
2026-03-27 16:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e/a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F220cd2779efe44ca879f4fb5c2964e84%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/8.jpg saved to cache
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e
2026-03-27 16:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590590f10>
2026-03-27 16:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e/a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F220cd2779efe44ca879f4fb5c2964e84%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/7.jpg saved to cache
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e
2026-03-27 16:48:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e, skipping ID generation
2026-03-27 16:48:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e with scrape type 1
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e sending to next pipeline
2026-03-27 16:48:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e, identifier: 1988341
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Ff77a7233e17a41ccb9aaaa23429d36f9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/2.jpg not downloaded yet
2026-03-27 16:48:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e with identifier: 1988341
2026-03-27 16:48:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e with identifier: 1988341
2026-03-27 16:48:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e with identifier: 1988341 to the API
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 111,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 103107,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e/a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348593,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e/a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348593,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e/a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 264031,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e/a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303552,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e/a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317599,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e/a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281822,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e/a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319131,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e/a40c9cae-5dd5-59c9-b6e9-d19811a0ba5e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442668,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/220cd2779efe44ca879f4fb5c2964e84/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-17',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 1.5 BlueHDi 100ch S&S Feel Business',
'transmission': 'manual',
'trim': 'C3 1.5 BlueHDi 100ch S&S Feel Business',
'vin': None,
'year': 2020}
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988341%27 HTTP/1.1" 200 None
2026-03-27 16:48:54 [ayvens.fr] INFO: Saving data for 1988341: {'created_time': 1774630134.65223, 'last_price_update_time': 1774630134.652241, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988341') HTTP/1.1" 204 0
2026-03-27 16:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Ff77a7233e17a41ccb9aaaa23429d36f9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/3.jpg not downloaded yet
2026-03-27 16:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Ff77a7233e17a41ccb9aaaa23429d36f9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/4.jpg not downloaded yet
2026-03-27 16:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Ff77a7233e17a41ccb9aaaa23429d36f9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/5.jpg not downloaded yet
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Ff77a7233e17a41ccb9aaaa23429d36f9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/6.jpg not downloaded yet
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Ff77a7233e17a41ccb9aaaa23429d36f9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/7.jpg not downloaded yet
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Ff77a7233e17a41ccb9aaaa23429d36f9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/8.jpg not downloaded yet
2026-03-27 16:48:54 [ayvens.fr] INFO: Found listing with ID: 1988344
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988344%27 HTTP/1.1" 200 None
2026-03-27 16:48:54 [ayvens.fr] INFO: Scrape type for 1988344: 1
2026-03-27 16:48:54 [ayvens.fr] INFO: Extracting data for car ID: 1988344
2026-03-27 16:48:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70837b3a-47b8-57c5-ba6c-cb06ff69a9df with identifier: 1988344
2026-03-27 16:48:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70837b3a-47b8-57c5-ba6c-cb06ff69a9df with scrape type 1
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 70837b3a-47b8-57c5-ba6c-cb06ff69a9df
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc93c4e20295c452b9c77f47b30906e35%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/1.jpg not downloaded yet
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc93c4e20295c452b9c77f47b30906e35%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/2.jpg not downloaded yet
2026-03-27 16:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b88610>
2026-03-27 16:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64b07020-583c-59d7-8360-f2f93da51ca7/64b07020-583c-59d7-8360-f2f93da51ca7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9f7f33abd42e435e8577f4293b9d91e1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/4.jpg saved to cache
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 64b07020-583c-59d7-8360-f2f93da51ca7
2026-03-27 16:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590af11d0>
2026-03-27 16:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64b07020-583c-59d7-8360-f2f93da51ca7/64b07020-583c-59d7-8360-f2f93da51ca7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9f7f33abd42e435e8577f4293b9d91e1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/5.jpg saved to cache
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64b07020-583c-59d7-8360-f2f93da51ca7
2026-03-27 16:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc93c4e20295c452b9c77f47b30906e35%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/3.jpg not downloaded yet
2026-03-27 16:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b5b8d0>
2026-03-27 16:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64b07020-583c-59d7-8360-f2f93da51ca7/64b07020-583c-59d7-8360-f2f93da51ca7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9f7f33abd42e435e8577f4293b9d91e1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/3.jpg saved to cache
2026-03-27 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64b07020-583c-59d7-8360-f2f93da51ca7
2026-03-27 16:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59063c410>
2026-03-27 16:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64b07020-583c-59d7-8360-f2f93da51ca7/64b07020-583c-59d7-8360-f2f93da51ca7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9f7f33abd42e435e8577f4293b9d91e1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/6.jpg saved to cache
2026-03-27 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 64b07020-583c-59d7-8360-f2f93da51ca7
2026-03-27 16:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590621310>
2026-03-27 16:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64b07020-583c-59d7-8360-f2f93da51ca7/64b07020-583c-59d7-8360-f2f93da51ca7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9f7f33abd42e435e8577f4293b9d91e1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/1.jpg saved to cache
2026-03-27 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64b07020-583c-59d7-8360-f2f93da51ca7
2026-03-27 16:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591116590>
2026-03-27 16:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64b07020-583c-59d7-8360-f2f93da51ca7/64b07020-583c-59d7-8360-f2f93da51ca7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9f7f33abd42e435e8577f4293b9d91e1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/2.jpg saved to cache
2026-03-27 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64b07020-583c-59d7-8360-f2f93da51ca7
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc93c4e20295c452b9c77f47b30906e35%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/4.jpg not downloaded yet
2026-03-27 16:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee1a50>
2026-03-27 16:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64b07020-583c-59d7-8360-f2f93da51ca7/64b07020-583c-59d7-8360-f2f93da51ca7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9f7f33abd42e435e8577f4293b9d91e1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/7.jpg saved to cache
2026-03-27 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 64b07020-583c-59d7-8360-f2f93da51ca7
2026-03-27 16:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c13d0>
2026-03-27 16:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64b07020-583c-59d7-8360-f2f93da51ca7/64b07020-583c-59d7-8360-f2f93da51ca7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9f7f33abd42e435e8577f4293b9d91e1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/8.jpg saved to cache
2026-03-27 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 64b07020-583c-59d7-8360-f2f93da51ca7
2026-03-27 16:48:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64b07020-583c-59d7-8360-f2f93da51ca7, skipping ID generation
2026-03-27 16:48:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64b07020-583c-59d7-8360-f2f93da51ca7 with scrape type 1
2026-03-27 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64b07020-583c-59d7-8360-f2f93da51ca7 sending to next pipeline
2026-03-27 16:48:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 64b07020-583c-59d7-8360-f2f93da51ca7, identifier: 1988342
2026-03-27 16:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc93c4e20295c452b9c77f47b30906e35%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/5.jpg not downloaded yet
2026-03-27 16:48:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 64b07020-583c-59d7-8360-f2f93da51ca7 with identifier: 1988342
2026-03-27 16:48:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 64b07020-583c-59d7-8360-f2f93da51ca7 with identifier: 1988342
2026-03-27 16:48:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 64b07020-583c-59d7-8360-f2f93da51ca7 with identifier: 1988342 to the API
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.5L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '64b07020-583c-59d7-8360-f2f93da51ca7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'MODEL 3',
'odometer': 110948,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64b07020-583c-59d7-8360-f2f93da51ca7/64b07020-583c-59d7-8360-f2f93da51ca7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64b07020-583c-59d7-8360-f2f93da51ca7/64b07020-583c-59d7-8360-f2f93da51ca7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64b07020-583c-59d7-8360-f2f93da51ca7/64b07020-583c-59d7-8360-f2f93da51ca7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361269,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64b07020-583c-59d7-8360-f2f93da51ca7/64b07020-583c-59d7-8360-f2f93da51ca7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320390,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64b07020-583c-59d7-8360-f2f93da51ca7/64b07020-583c-59d7-8360-f2f93da51ca7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307752,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64b07020-583c-59d7-8360-f2f93da51ca7/64b07020-583c-59d7-8360-f2f93da51ca7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344848,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64b07020-583c-59d7-8360-f2f93da51ca7/64b07020-583c-59d7-8360-f2f93da51ca7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375087,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64b07020-583c-59d7-8360-f2f93da51ca7/64b07020-583c-59d7-8360-f2f93da51ca7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 162160,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9f7f33abd42e435e8577f4293b9d91e1/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-14',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA MODEL 3 Model 3 Long-Range Dual Motor AWD',
'transmission': 'automatic',
'trim': 'Model 3 Long-Range Dual Motor AWD',
'vin': None,
'year': 2021}
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988342%27 HTTP/1.1" 200 None
2026-03-27 16:48:55 [ayvens.fr] INFO: Saving data for 1988342: {'created_time': 1774630135.992789, 'last_price_update_time': 1774630135.992802, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988342') HTTP/1.1" 204 0
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc93c4e20295c452b9c77f47b30906e35%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/6.jpg not downloaded yet
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d6f5d0>
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0/7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Ff77a7233e17a41ccb9aaaa23429d36f9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/3.jpg saved to cache
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9d250>
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0/7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Ff77a7233e17a41ccb9aaaa23429d36f9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/6.jpg saved to cache
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590669810>
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0/7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Ff77a7233e17a41ccb9aaaa23429d36f9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/7.jpg saved to cache
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a1e10>
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0/7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Ff77a7233e17a41ccb9aaaa23429d36f9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/4.jpg saved to cache
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d44a50>
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0/7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Ff77a7233e17a41ccb9aaaa23429d36f9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/2.jpg saved to cache
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ec55d0>
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0/7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Ff77a7233e17a41ccb9aaaa23429d36f9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/1.jpg saved to cache
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ac6fd0>
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0/7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Ff77a7233e17a41ccb9aaaa23429d36f9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/5.jpg saved to cache
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc93c4e20295c452b9c77f47b30906e35%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/7.jpg not downloaded yet
2026-03-27 16:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc93c4e20295c452b9c77f47b30906e35%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/8.jpg not downloaded yet
2026-03-27 16:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:56 [ayvens.fr] INFO: Found listing with ID: 1988345
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988345%27 HTTP/1.1" 200 None
2026-03-27 16:48:56 [ayvens.fr] INFO: Scrape type for 1988345: 1
2026-03-27 16:48:56 [ayvens.fr] INFO: Extracting data for car ID: 1988345
2026-03-27 16:48:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee366f73-663f-58bf-94ca-e38e348dba77 with identifier: 1988345
2026-03-27 16:48:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee366f73-663f-58bf-94ca-e38e348dba77 with scrape type 1
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ee366f73-663f-58bf-94ca-e38e348dba77
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a73ee471e8b4387abe5334b9f435f3a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/1.jpg not downloaded yet
2026-03-27 16:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a73ee471e8b4387abe5334b9f435f3a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/2.jpg not downloaded yet
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a73ee471e8b4387abe5334b9f435f3a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/3.jpg not downloaded yet
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a73ee471e8b4387abe5334b9f435f3a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/4.jpg not downloaded yet
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a73ee471e8b4387abe5334b9f435f3a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/5.jpg not downloaded yet
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590518790>
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0/7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Ff77a7233e17a41ccb9aaaa23429d36f9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/8.jpg saved to cache
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0
2026-03-27 16:48:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0, skipping ID generation
2026-03-27 16:48:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0 with scrape type 1
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0 sending to next pipeline
2026-03-27 16:48:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0, identifier: 1988343
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a73ee471e8b4387abe5334b9f435f3a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/6.jpg not downloaded yet
2026-03-27 16:48:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0 with identifier: 1988343
2026-03-27 16:48:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0 with identifier: 1988343
2026-03-27 16:48:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0 with identifier: 1988343 to the API
2026-03-27 16:48:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'KONA',
'odometer': 47404,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0/7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391378,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0/7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391378,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0/7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392421,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0/7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362132,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0/7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286752,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0/7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0/7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237754,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0/7b2c53cd-7ff3-5f4d-a141-93cd1b22aca0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/f77a7233e17a41ccb9aaaa23429d36f9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-25',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI KONA Kona Electric 64kWh - 204ch Intuitive',
'transmission': 'automatic',
'trim': 'Kona Electric 64kWh - 204ch Intuitive',
'vin': None,
'year': 2022}
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988343%27 HTTP/1.1" 200 None
2026-03-27 16:48:57 [ayvens.fr] INFO: Saving data for 1988343: {'created_time': 1774630137.144626, 'last_price_update_time': 1774630137.14464, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988343') HTTP/1.1" 204 0
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a73ee471e8b4387abe5334b9f435f3a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/7.jpg not downloaded yet
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051a810>
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70837b3a-47b8-57c5-ba6c-cb06ff69a9df/70837b3a-47b8-57c5-ba6c-cb06ff69a9df_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc93c4e20295c452b9c77f47b30906e35%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/1.jpg saved to cache
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70837b3a-47b8-57c5-ba6c-cb06ff69a9df
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d0d50>
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70837b3a-47b8-57c5-ba6c-cb06ff69a9df/70837b3a-47b8-57c5-ba6c-cb06ff69a9df_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc93c4e20295c452b9c77f47b30906e35%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/2.jpg saved to cache
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70837b3a-47b8-57c5-ba6c-cb06ff69a9df
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911ee310>
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70837b3a-47b8-57c5-ba6c-cb06ff69a9df/70837b3a-47b8-57c5-ba6c-cb06ff69a9df_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc93c4e20295c452b9c77f47b30906e35%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/3.jpg saved to cache
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70837b3a-47b8-57c5-ba6c-cb06ff69a9df
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c2790>
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70837b3a-47b8-57c5-ba6c-cb06ff69a9df/70837b3a-47b8-57c5-ba6c-cb06ff69a9df_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc93c4e20295c452b9c77f47b30906e35%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/4.jpg saved to cache
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70837b3a-47b8-57c5-ba6c-cb06ff69a9df
2026-03-27 16:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a73ee471e8b4387abe5334b9f435f3a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/8.jpg not downloaded yet
2026-03-27 16:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:57 [ayvens.fr] INFO: Found listing with ID: 1988346
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988346%27 HTTP/1.1" 200 None
2026-03-27 16:48:57 [ayvens.fr] INFO: Scrape type for 1988346: 1
2026-03-27 16:48:57 [ayvens.fr] INFO: Extracting data for car ID: 1988346
2026-03-27 16:48:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f5f0f13-eb2c-5a83-aeac-48014390dcf5 with identifier: 1988346
2026-03-27 16:48:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f5f0f13-eb2c-5a83-aeac-48014390dcf5 with scrape type 1
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6f5f0f13-eb2c-5a83-aeac-48014390dcf5
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F453e0a0bd0a04d659a0f2f00473fe226%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/1.jpg not downloaded yet
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F453e0a0bd0a04d659a0f2f00473fe226%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/2.jpg not downloaded yet
2026-03-27 16:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F453e0a0bd0a04d659a0f2f00473fe226%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/3.jpg not downloaded yet
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b6bbd0>
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70837b3a-47b8-57c5-ba6c-cb06ff69a9df/70837b3a-47b8-57c5-ba6c-cb06ff69a9df_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc93c4e20295c452b9c77f47b30906e35%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/5.jpg saved to cache
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70837b3a-47b8-57c5-ba6c-cb06ff69a9df
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0ecd0>
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70837b3a-47b8-57c5-ba6c-cb06ff69a9df/70837b3a-47b8-57c5-ba6c-cb06ff69a9df_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc93c4e20295c452b9c77f47b30906e35%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/8.jpg saved to cache
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70837b3a-47b8-57c5-ba6c-cb06ff69a9df
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903cfa50>
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee366f73-663f-58bf-94ca-e38e348dba77/ee366f73-663f-58bf-94ca-e38e348dba77_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a73ee471e8b4387abe5334b9f435f3a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/1.jpg saved to cache
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee366f73-663f-58bf-94ca-e38e348dba77
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910c5f10>
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70837b3a-47b8-57c5-ba6c-cb06ff69a9df/70837b3a-47b8-57c5-ba6c-cb06ff69a9df_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc93c4e20295c452b9c77f47b30906e35%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/7.jpg saved to cache
2026-03-27 16:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70837b3a-47b8-57c5-ba6c-cb06ff69a9df
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b69010>
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee366f73-663f-58bf-94ca-e38e348dba77/ee366f73-663f-58bf-94ca-e38e348dba77_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a73ee471e8b4387abe5334b9f435f3a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/2.jpg saved to cache
2026-03-27 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee366f73-663f-58bf-94ca-e38e348dba77
2026-03-27 16:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904d7c10>
2026-03-27 16:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70837b3a-47b8-57c5-ba6c-cb06ff69a9df/70837b3a-47b8-57c5-ba6c-cb06ff69a9df_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc93c4e20295c452b9c77f47b30906e35%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/6.jpg saved to cache
2026-03-27 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70837b3a-47b8-57c5-ba6c-cb06ff69a9df
2026-03-27 16:48:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70837b3a-47b8-57c5-ba6c-cb06ff69a9df, skipping ID generation
2026-03-27 16:48:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70837b3a-47b8-57c5-ba6c-cb06ff69a9df with scrape type 1
2026-03-27 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70837b3a-47b8-57c5-ba6c-cb06ff69a9df sending to next pipeline
2026-03-27 16:48:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 70837b3a-47b8-57c5-ba6c-cb06ff69a9df, identifier: 1988344
2026-03-27 16:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590515590>
2026-03-27 16:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee366f73-663f-58bf-94ca-e38e348dba77/ee366f73-663f-58bf-94ca-e38e348dba77_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a73ee471e8b4387abe5334b9f435f3a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/3.jpg saved to cache
2026-03-27 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee366f73-663f-58bf-94ca-e38e348dba77
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F453e0a0bd0a04d659a0f2f00473fe226%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/4.jpg not downloaded yet
2026-03-27 16:48:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 70837b3a-47b8-57c5-ba6c-cb06ff69a9df with identifier: 1988344
2026-03-27 16:48:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 70837b3a-47b8-57c5-ba6c-cb06ff69a9df with identifier: 1988344
2026-03-27 16:48:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 70837b3a-47b8-57c5-ba6c-cb06ff69a9df with identifier: 1988344 to the API
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 56,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '70837b3a-47b8-57c5-ba6c-cb06ff69a9df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC60',
'odometer': 106809,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70837b3a-47b8-57c5-ba6c-cb06ff69a9df/70837b3a-47b8-57c5-ba6c-cb06ff69a9df_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331480,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70837b3a-47b8-57c5-ba6c-cb06ff69a9df/70837b3a-47b8-57c5-ba6c-cb06ff69a9df_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331480,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70837b3a-47b8-57c5-ba6c-cb06ff69a9df/70837b3a-47b8-57c5-ba6c-cb06ff69a9df_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328787,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70837b3a-47b8-57c5-ba6c-cb06ff69a9df/70837b3a-47b8-57c5-ba6c-cb06ff69a9df_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335223,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70837b3a-47b8-57c5-ba6c-cb06ff69a9df/70837b3a-47b8-57c5-ba6c-cb06ff69a9df_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328504,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70837b3a-47b8-57c5-ba6c-cb06ff69a9df/70837b3a-47b8-57c5-ba6c-cb06ff69a9df_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339918,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70837b3a-47b8-57c5-ba6c-cb06ff69a9df/70837b3a-47b8-57c5-ba6c-cb06ff69a9df_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312022,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70837b3a-47b8-57c5-ba6c-cb06ff69a9df/70837b3a-47b8-57c5-ba6c-cb06ff69a9df_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252366,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c93c4e20295c452b9c77f47b30906e35/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-19',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC60 XC60 T6 AWD 253 + 87ch Inscription Luxe Geartronic',
'transmission': 'automatic',
'trim': 'XC60 T6 AWD 253 + 87ch Inscription Luxe Geartronic',
'vin': None,
'year': 2021}
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988344%27 HTTP/1.1" 200 None
2026-03-27 16:48:58 [ayvens.fr] INFO: Saving data for 1988344: {'created_time': 1774630138.627472, 'last_price_update_time': 1774630138.627483, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988344') HTTP/1.1" 204 0
2026-03-27 16:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F453e0a0bd0a04d659a0f2f00473fe226%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/5.jpg not downloaded yet
2026-03-27 16:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f80250>
2026-03-27 16:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee366f73-663f-58bf-94ca-e38e348dba77/ee366f73-663f-58bf-94ca-e38e348dba77_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a73ee471e8b4387abe5334b9f435f3a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/4.jpg saved to cache
2026-03-27 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee366f73-663f-58bf-94ca-e38e348dba77
2026-03-27 16:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F453e0a0bd0a04d659a0f2f00473fe226%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/6.jpg not downloaded yet
2026-03-27 16:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F453e0a0bd0a04d659a0f2f00473fe226%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/7.jpg not downloaded yet
2026-03-27 16:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F453e0a0bd0a04d659a0f2f00473fe226%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/8.jpg not downloaded yet
2026-03-27 16:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dff3d0>
2026-03-27 16:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee366f73-663f-58bf-94ca-e38e348dba77/ee366f73-663f-58bf-94ca-e38e348dba77_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a73ee471e8b4387abe5334b9f435f3a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/7.jpg saved to cache
2026-03-27 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee366f73-663f-58bf-94ca-e38e348dba77
2026-03-27 16:48:58 [ayvens.fr] INFO: Found listing with ID: 1988347
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988347%27 HTTP/1.1" 200 None
2026-03-27 16:48:58 [ayvens.fr] INFO: Scrape type for 1988347: 1
2026-03-27 16:48:58 [ayvens.fr] INFO: Extracting data for car ID: 1988347
2026-03-27 16:48:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d35b87bb-7f46-5b6f-aae7-37b3637acf9c with identifier: 1988347
2026-03-27 16:48:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d35b87bb-7f46-5b6f-aae7-37b3637acf9c with scrape type 1
2026-03-27 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d35b87bb-7f46-5b6f-aae7-37b3637acf9c
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F0ce28ca4da4d4af5a1988db49b2915de%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/1.jpg not downloaded yet
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F0ce28ca4da4d4af5a1988db49b2915de%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/2.jpg not downloaded yet
2026-03-27 16:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591002cd0>
2026-03-27 16:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee366f73-663f-58bf-94ca-e38e348dba77/ee366f73-663f-58bf-94ca-e38e348dba77_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a73ee471e8b4387abe5334b9f435f3a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/5.jpg saved to cache
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee366f73-663f-58bf-94ca-e38e348dba77
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59103f6d0>
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee366f73-663f-58bf-94ca-e38e348dba77/ee366f73-663f-58bf-94ca-e38e348dba77_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a73ee471e8b4387abe5334b9f435f3a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/6.jpg saved to cache
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee366f73-663f-58bf-94ca-e38e348dba77
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b3910>
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee366f73-663f-58bf-94ca-e38e348dba77/ee366f73-663f-58bf-94ca-e38e348dba77_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a73ee471e8b4387abe5334b9f435f3a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/8.jpg saved to cache
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee366f73-663f-58bf-94ca-e38e348dba77
2026-03-27 16:48:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee366f73-663f-58bf-94ca-e38e348dba77, skipping ID generation
2026-03-27 16:48:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee366f73-663f-58bf-94ca-e38e348dba77 with scrape type 1
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee366f73-663f-58bf-94ca-e38e348dba77 sending to next pipeline
2026-03-27 16:48:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ee366f73-663f-58bf-94ca-e38e348dba77, identifier: 1988345
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590513b50>
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f5f0f13-eb2c-5a83-aeac-48014390dcf5/6f5f0f13-eb2c-5a83-aeac-48014390dcf5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F453e0a0bd0a04d659a0f2f00473fe226%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/1.jpg saved to cache
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f5f0f13-eb2c-5a83-aeac-48014390dcf5
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F0ce28ca4da4d4af5a1988db49b2915de%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/3.jpg not downloaded yet
2026-03-27 16:48:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ee366f73-663f-58bf-94ca-e38e348dba77 with identifier: 1988345
2026-03-27 16:48:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:48:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ee366f73-663f-58bf-94ca-e38e348dba77 with identifier: 1988345
2026-03-27 16:48:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ee366f73-663f-58bf-94ca-e38e348dba77 with identifier: 1988345 to the API
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:48:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'BLEU ZENZIBAR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'ee366f73-663f-58bf-94ca-e38e348dba77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'ARKANA',
'odometer': 52041,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee366f73-663f-58bf-94ca-e38e348dba77/ee366f73-663f-58bf-94ca-e38e348dba77_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309561,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee366f73-663f-58bf-94ca-e38e348dba77/ee366f73-663f-58bf-94ca-e38e348dba77_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309561,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee366f73-663f-58bf-94ca-e38e348dba77/ee366f73-663f-58bf-94ca-e38e348dba77_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377382,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee366f73-663f-58bf-94ca-e38e348dba77/ee366f73-663f-58bf-94ca-e38e348dba77_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358911,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee366f73-663f-58bf-94ca-e38e348dba77/ee366f73-663f-58bf-94ca-e38e348dba77_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400386,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee366f73-663f-58bf-94ca-e38e348dba77/ee366f73-663f-58bf-94ca-e38e348dba77_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374150,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee366f73-663f-58bf-94ca-e38e348dba77/ee366f73-663f-58bf-94ca-e38e348dba77_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257137,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee366f73-663f-58bf-94ca-e38e348dba77/ee366f73-663f-58bf-94ca-e38e348dba77_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293469,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/7a73ee471e8b4387abe5334b9f435f3a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-05',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT ARKANA Arkana 1.6 E-Tech 145ch Intens',
'transmission': 'automatic',
'trim': 'Arkana 1.6 E-Tech 145ch Intens',
'vin': None,
'year': 2021}
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988345%27 HTTP/1.1" 200 None
2026-03-27 16:48:59 [ayvens.fr] INFO: Saving data for 1988345: {'created_time': 1774630139.707863, 'last_price_update_time': 1774630139.70788, 'auction_closing_time': 1774969200.0}
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988345') HTTP/1.1" 204 0
2026-03-27 16:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F0ce28ca4da4d4af5a1988db49b2915de%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/4.jpg not downloaded yet
2026-03-27 16:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F0ce28ca4da4d4af5a1988db49b2915de%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/5.jpg not downloaded yet
2026-03-27 16:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F0ce28ca4da4d4af5a1988db49b2915de%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/6.jpg not downloaded yet
2026-03-27 16:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F0ce28ca4da4d4af5a1988db49b2915de%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/7.jpg not downloaded yet
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F0ce28ca4da4d4af5a1988db49b2915de%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/8.jpg not downloaded yet
2026-03-27 16:48:59 [ayvens.fr] INFO: Found listing with ID: 1988348
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988348%27 HTTP/1.1" 200 None
2026-03-27 16:48:59 [ayvens.fr] INFO: Scrape type for 1988348: 1
2026-03-27 16:48:59 [ayvens.fr] INFO: Extracting data for car ID: 1988348
2026-03-27 16:48:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0eb054b-55ab-51e6-8b66-940479db589e with identifier: 1988348
2026-03-27 16:48:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0eb054b-55ab-51e6-8b66-940479db589e with scrape type 1
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d0eb054b-55ab-51e6-8b66-940479db589e
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc1a1a80770534a1488ffbdd31081106b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/1.jpg not downloaded yet
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc1a1a80770534a1488ffbdd31081106b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/2.jpg not downloaded yet
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050ccd0>
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f5f0f13-eb2c-5a83-aeac-48014390dcf5/6f5f0f13-eb2c-5a83-aeac-48014390dcf5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F453e0a0bd0a04d659a0f2f00473fe226%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/2.jpg saved to cache
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f5f0f13-eb2c-5a83-aeac-48014390dcf5
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6ed10>
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f5f0f13-eb2c-5a83-aeac-48014390dcf5/6f5f0f13-eb2c-5a83-aeac-48014390dcf5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F453e0a0bd0a04d659a0f2f00473fe226%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/3.jpg saved to cache
2026-03-27 16:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f5f0f13-eb2c-5a83-aeac-48014390dcf5
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911b8c10>
2026-03-27 16:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f5f0f13-eb2c-5a83-aeac-48014390dcf5/6f5f0f13-eb2c-5a83-aeac-48014390dcf5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F453e0a0bd0a04d659a0f2f00473fe226%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/6.jpg saved to cache
2026-03-27 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f5f0f13-eb2c-5a83-aeac-48014390dcf5
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6e810>
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f5f0f13-eb2c-5a83-aeac-48014390dcf5/6f5f0f13-eb2c-5a83-aeac-48014390dcf5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F453e0a0bd0a04d659a0f2f00473fe226%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/4.jpg saved to cache
2026-03-27 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f5f0f13-eb2c-5a83-aeac-48014390dcf5
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590615d50>
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f5f0f13-eb2c-5a83-aeac-48014390dcf5/6f5f0f13-eb2c-5a83-aeac-48014390dcf5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F453e0a0bd0a04d659a0f2f00473fe226%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/5.jpg saved to cache
2026-03-27 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f5f0f13-eb2c-5a83-aeac-48014390dcf5
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc1a1a80770534a1488ffbdd31081106b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/3.jpg not downloaded yet
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d2f90>
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f5f0f13-eb2c-5a83-aeac-48014390dcf5/6f5f0f13-eb2c-5a83-aeac-48014390dcf5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F453e0a0bd0a04d659a0f2f00473fe226%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/7.jpg saved to cache
2026-03-27 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f5f0f13-eb2c-5a83-aeac-48014390dcf5
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911bbc90>
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f5f0f13-eb2c-5a83-aeac-48014390dcf5/6f5f0f13-eb2c-5a83-aeac-48014390dcf5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F453e0a0bd0a04d659a0f2f00473fe226%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/8.jpg saved to cache
2026-03-27 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f5f0f13-eb2c-5a83-aeac-48014390dcf5
2026-03-27 16:49:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f5f0f13-eb2c-5a83-aeac-48014390dcf5, skipping ID generation
2026-03-27 16:49:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f5f0f13-eb2c-5a83-aeac-48014390dcf5 with scrape type 1
2026-03-27 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f5f0f13-eb2c-5a83-aeac-48014390dcf5 sending to next pipeline
2026-03-27 16:49:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6f5f0f13-eb2c-5a83-aeac-48014390dcf5, identifier: 1988346
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc1a1a80770534a1488ffbdd31081106b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/4.jpg not downloaded yet
2026-03-27 16:49:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6f5f0f13-eb2c-5a83-aeac-48014390dcf5 with identifier: 1988346
2026-03-27 16:49:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6f5f0f13-eb2c-5a83-aeac-48014390dcf5 with identifier: 1988346
2026-03-27 16:49:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6f5f0f13-eb2c-5a83-aeac-48014390dcf5 with identifier: 1988346 to the API
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'NOIR INTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '6f5f0f13-eb2c-5a83-aeac-48014390dcf5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 119343,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f5f0f13-eb2c-5a83-aeac-48014390dcf5/6f5f0f13-eb2c-5a83-aeac-48014390dcf5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492155,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f5f0f13-eb2c-5a83-aeac-48014390dcf5/6f5f0f13-eb2c-5a83-aeac-48014390dcf5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492155,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f5f0f13-eb2c-5a83-aeac-48014390dcf5/6f5f0f13-eb2c-5a83-aeac-48014390dcf5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412931,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f5f0f13-eb2c-5a83-aeac-48014390dcf5/6f5f0f13-eb2c-5a83-aeac-48014390dcf5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340810,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f5f0f13-eb2c-5a83-aeac-48014390dcf5/6f5f0f13-eb2c-5a83-aeac-48014390dcf5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351799,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f5f0f13-eb2c-5a83-aeac-48014390dcf5/6f5f0f13-eb2c-5a83-aeac-48014390dcf5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350815,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f5f0f13-eb2c-5a83-aeac-48014390dcf5/6f5f0f13-eb2c-5a83-aeac-48014390dcf5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325420,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f5f0f13-eb2c-5a83-aeac-48014390dcf5/6f5f0f13-eb2c-5a83-aeac-48014390dcf5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342015,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/453e0a0bd0a04d659a0f2f00473fe226/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-25',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN GOLF Golf 1.0 TSI OPF 110ch Life Plus',
'transmission': 'manual',
'trim': 'Golf 1.0 TSI OPF 110ch Life Plus',
'vin': None,
'year': 2023}
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988346%27 HTTP/1.1" 200 None
2026-03-27 16:49:00 [ayvens.fr] INFO: Saving data for 1988346: {'created_time': 1774630140.913979, 'last_price_update_time': 1774630140.91399, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988346') HTTP/1.1" 204 0
2026-03-27 16:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc1a1a80770534a1488ffbdd31081106b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/5.jpg not downloaded yet
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f83010>
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d35b87bb-7f46-5b6f-aae7-37b3637acf9c/d35b87bb-7f46-5b6f-aae7-37b3637acf9c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F0ce28ca4da4d4af5a1988db49b2915de%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/1.jpg saved to cache
2026-03-27 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d35b87bb-7f46-5b6f-aae7-37b3637acf9c
2026-03-27 16:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc1a1a80770534a1488ffbdd31081106b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/6.jpg not downloaded yet
2026-03-27 16:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066e410>
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d35b87bb-7f46-5b6f-aae7-37b3637acf9c/d35b87bb-7f46-5b6f-aae7-37b3637acf9c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F0ce28ca4da4d4af5a1988db49b2915de%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/2.jpg saved to cache
2026-03-27 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d35b87bb-7f46-5b6f-aae7-37b3637acf9c
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911bbc90>
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d35b87bb-7f46-5b6f-aae7-37b3637acf9c/d35b87bb-7f46-5b6f-aae7-37b3637acf9c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F0ce28ca4da4d4af5a1988db49b2915de%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/5.jpg saved to cache
2026-03-27 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d35b87bb-7f46-5b6f-aae7-37b3637acf9c
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911c9010>
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d35b87bb-7f46-5b6f-aae7-37b3637acf9c/d35b87bb-7f46-5b6f-aae7-37b3637acf9c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F0ce28ca4da4d4af5a1988db49b2915de%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/4.jpg saved to cache
2026-03-27 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d35b87bb-7f46-5b6f-aae7-37b3637acf9c
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc1a1a80770534a1488ffbdd31081106b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/7.jpg not downloaded yet
2026-03-27 16:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc1a1a80770534a1488ffbdd31081106b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/8.jpg not downloaded yet
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0d910>
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d35b87bb-7f46-5b6f-aae7-37b3637acf9c/d35b87bb-7f46-5b6f-aae7-37b3637acf9c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F0ce28ca4da4d4af5a1988db49b2915de%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/3.jpg saved to cache
2026-03-27 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d35b87bb-7f46-5b6f-aae7-37b3637acf9c
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d43210>
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d35b87bb-7f46-5b6f-aae7-37b3637acf9c/d35b87bb-7f46-5b6f-aae7-37b3637acf9c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F0ce28ca4da4d4af5a1988db49b2915de%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/7.jpg saved to cache
2026-03-27 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d35b87bb-7f46-5b6f-aae7-37b3637acf9c
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59287aed0>
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d35b87bb-7f46-5b6f-aae7-37b3637acf9c/d35b87bb-7f46-5b6f-aae7-37b3637acf9c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F0ce28ca4da4d4af5a1988db49b2915de%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/6.jpg saved to cache
2026-03-27 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d35b87bb-7f46-5b6f-aae7-37b3637acf9c
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591003750>
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d35b87bb-7f46-5b6f-aae7-37b3637acf9c/d35b87bb-7f46-5b6f-aae7-37b3637acf9c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F0ce28ca4da4d4af5a1988db49b2915de%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/8.jpg saved to cache
2026-03-27 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d35b87bb-7f46-5b6f-aae7-37b3637acf9c
2026-03-27 16:49:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d35b87bb-7f46-5b6f-aae7-37b3637acf9c, skipping ID generation
2026-03-27 16:49:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d35b87bb-7f46-5b6f-aae7-37b3637acf9c with scrape type 1
2026-03-27 16:49:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d35b87bb-7f46-5b6f-aae7-37b3637acf9c sending to next pipeline
2026-03-27 16:49:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d35b87bb-7f46-5b6f-aae7-37b3637acf9c, identifier: 1988347
2026-03-27 16:49:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d35b87bb-7f46-5b6f-aae7-37b3637acf9c with identifier: 1988347
2026-03-27 16:49:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:49:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d35b87bb-7f46-5b6f-aae7-37b3637acf9c with identifier: 1988347
2026-03-27 16:49:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d35b87bb-7f46-5b6f-aae7-37b3637acf9c with identifier: 1988347 to the API
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'NOIR MAGIC NACR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'd35b87bb-7f46-5b6f-aae7-37b3637acf9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'SKODA',
'model': 'KAMIQ',
'odometer': 86406,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d35b87bb-7f46-5b6f-aae7-37b3637acf9c/d35b87bb-7f46-5b6f-aae7-37b3637acf9c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346597,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d35b87bb-7f46-5b6f-aae7-37b3637acf9c/d35b87bb-7f46-5b6f-aae7-37b3637acf9c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346597,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d35b87bb-7f46-5b6f-aae7-37b3637acf9c/d35b87bb-7f46-5b6f-aae7-37b3637acf9c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350754,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d35b87bb-7f46-5b6f-aae7-37b3637acf9c/d35b87bb-7f46-5b6f-aae7-37b3637acf9c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357747,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d35b87bb-7f46-5b6f-aae7-37b3637acf9c/d35b87bb-7f46-5b6f-aae7-37b3637acf9c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292222,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d35b87bb-7f46-5b6f-aae7-37b3637acf9c/d35b87bb-7f46-5b6f-aae7-37b3637acf9c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317868,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d35b87bb-7f46-5b6f-aae7-37b3637acf9c/d35b87bb-7f46-5b6f-aae7-37b3637acf9c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265488,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d35b87bb-7f46-5b6f-aae7-37b3637acf9c/d35b87bb-7f46-5b6f-aae7-37b3637acf9c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417426,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/0ce28ca4da4d4af5a1988db49b2915de/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-08',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA KAMIQ Kamiq 1.0 TSI Evo 110ch Business',
'transmission': 'manual',
'trim': 'Kamiq 1.0 TSI Evo 110ch Business',
'vin': None,
'year': 2024}
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988347%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [ayvens.fr] INFO: Saving data for 1988347: {'created_time': 1774630142.069068, 'last_price_update_time': 1774630142.069083, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988347') HTTP/1.1" 204 0
2026-03-27 16:49:02 [ayvens.fr] INFO: Found listing with ID: 1988349
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988349%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [ayvens.fr] INFO: Scrape type for 1988349: 1
2026-03-27 16:49:02 [ayvens.fr] INFO: Extracting data for car ID: 1988349
2026-03-27 16:49:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7db2fda1-a4a9-5365-9623-6a40658b62cf with identifier: 1988349
2026-03-27 16:49:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7db2fda1-a4a9-5365-9623-6a40658b62cf with scrape type 1
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7db2fda1-a4a9-5365-9623-6a40658b62cf
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F9ad4f55fbbb045f3926b6c64fbb0bbfa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/1.jpg not downloaded yet
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903cc6d0>
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0eb054b-55ab-51e6-8b66-940479db589e/d0eb054b-55ab-51e6-8b66-940479db589e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc1a1a80770534a1488ffbdd31081106b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/1.jpg saved to cache
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0eb054b-55ab-51e6-8b66-940479db589e
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F9ad4f55fbbb045f3926b6c64fbb0bbfa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/2.jpg not downloaded yet
2026-03-27 16:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F9ad4f55fbbb045f3926b6c64fbb0bbfa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/3.jpg not downloaded yet
2026-03-27 16:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F9ad4f55fbbb045f3926b6c64fbb0bbfa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/4.jpg not downloaded yet
2026-03-27 16:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F9ad4f55fbbb045f3926b6c64fbb0bbfa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/5.jpg not downloaded yet
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F9ad4f55fbbb045f3926b6c64fbb0bbfa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/6.jpg not downloaded yet
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F9ad4f55fbbb045f3926b6c64fbb0bbfa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/7.jpg not downloaded yet
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F9ad4f55fbbb045f3926b6c64fbb0bbfa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/8.jpg not downloaded yet
2026-03-27 16:49:02 [ayvens.fr] INFO: Found listing with ID: 1988350
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988350%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [ayvens.fr] INFO: Scrape type for 1988350: 1
2026-03-27 16:49:02 [ayvens.fr] INFO: Extracting data for car ID: 1988350
2026-03-27 16:49:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 449fac81-5d1b-5182-b8d6-e0df08fc1d20 with identifier: 1988350
2026-03-27 16:49:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 449fac81-5d1b-5182-b8d6-e0df08fc1d20 with scrape type 1
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 449fac81-5d1b-5182-b8d6-e0df08fc1d20
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F19d1b80aca854601b1db89aeb1ba358e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/1.jpg not downloaded yet
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F19d1b80aca854601b1db89aeb1ba358e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/2.jpg not downloaded yet
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910eeb90>
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0eb054b-55ab-51e6-8b66-940479db589e/d0eb054b-55ab-51e6-8b66-940479db589e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc1a1a80770534a1488ffbdd31081106b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/4.jpg saved to cache
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0eb054b-55ab-51e6-8b66-940479db589e
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F19d1b80aca854601b1db89aeb1ba358e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/3.jpg not downloaded yet
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59102fe10>
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0eb054b-55ab-51e6-8b66-940479db589e/d0eb054b-55ab-51e6-8b66-940479db589e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc1a1a80770534a1488ffbdd31081106b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/3.jpg saved to cache
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0eb054b-55ab-51e6-8b66-940479db589e
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d1110>
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0eb054b-55ab-51e6-8b66-940479db589e/d0eb054b-55ab-51e6-8b66-940479db589e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc1a1a80770534a1488ffbdd31081106b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/2.jpg saved to cache
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0eb054b-55ab-51e6-8b66-940479db589e
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d58250>
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0eb054b-55ab-51e6-8b66-940479db589e/d0eb054b-55ab-51e6-8b66-940479db589e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc1a1a80770534a1488ffbdd31081106b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/5.jpg saved to cache
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0eb054b-55ab-51e6-8b66-940479db589e
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c8510>
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0eb054b-55ab-51e6-8b66-940479db589e/d0eb054b-55ab-51e6-8b66-940479db589e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc1a1a80770534a1488ffbdd31081106b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/6.jpg saved to cache
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0eb054b-55ab-51e6-8b66-940479db589e
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b59050>
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0eb054b-55ab-51e6-8b66-940479db589e/d0eb054b-55ab-51e6-8b66-940479db589e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc1a1a80770534a1488ffbdd31081106b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/7.jpg saved to cache
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d0eb054b-55ab-51e6-8b66-940479db589e
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F19d1b80aca854601b1db89aeb1ba358e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/4.jpg not downloaded yet
2026-03-27 16:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F19d1b80aca854601b1db89aeb1ba358e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/5.jpg not downloaded yet
2026-03-27 16:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F19d1b80aca854601b1db89aeb1ba358e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/6.jpg not downloaded yet
2026-03-27 16:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F19d1b80aca854601b1db89aeb1ba358e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/7.jpg not downloaded yet
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F19d1b80aca854601b1db89aeb1ba358e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/8.jpg not downloaded yet
2026-03-27 16:49:02 [ayvens.fr] INFO: Found listing with ID: 1988351
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988351%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [ayvens.fr] INFO: Scrape type for 1988351: 1
2026-03-27 16:49:02 [ayvens.fr] INFO: Extracting data for car ID: 1988351
2026-03-27 16:49:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fa3f143-8e20-5e93-9987-538dbd078661 with identifier: 1988351
2026-03-27 16:49:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fa3f143-8e20-5e93-9987-538dbd078661 with scrape type 1
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 8fa3f143-8e20-5e93-9987-538dbd078661
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb8e57b0b41294319923930eb649f1807%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/1.jpg not downloaded yet
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb8e57b0b41294319923930eb649f1807%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/2.jpg not downloaded yet
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb8e57b0b41294319923930eb649f1807%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/3.jpg not downloaded yet
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c06d0>
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0eb054b-55ab-51e6-8b66-940479db589e/d0eb054b-55ab-51e6-8b66-940479db589e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fc1a1a80770534a1488ffbdd31081106b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/8.jpg saved to cache
2026-03-27 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d0eb054b-55ab-51e6-8b66-940479db589e
2026-03-27 16:49:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0eb054b-55ab-51e6-8b66-940479db589e, skipping ID generation
2026-03-27 16:49:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0eb054b-55ab-51e6-8b66-940479db589e with scrape type 1
2026-03-27 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0eb054b-55ab-51e6-8b66-940479db589e sending to next pipeline
2026-03-27 16:49:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d0eb054b-55ab-51e6-8b66-940479db589e, identifier: 1988348
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590590550>
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7db2fda1-a4a9-5365-9623-6a40658b62cf/7db2fda1-a4a9-5365-9623-6a40658b62cf_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F9ad4f55fbbb045f3926b6c64fbb0bbfa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/4.jpg saved to cache
2026-03-27 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7db2fda1-a4a9-5365-9623-6a40658b62cf
2026-03-27 16:49:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d0eb054b-55ab-51e6-8b66-940479db589e with identifier: 1988348
2026-03-27 16:49:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d0eb054b-55ab-51e6-8b66-940479db589e with identifier: 1988348
2026-03-27 16:49:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d0eb054b-55ab-51e6-8b66-940479db589e with identifier: 1988348 to the API
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'd0eb054b-55ab-51e6-8b66-940479db589e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'X1',
'odometer': 112596,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0eb054b-55ab-51e6-8b66-940479db589e/d0eb054b-55ab-51e6-8b66-940479db589e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474852,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0eb054b-55ab-51e6-8b66-940479db589e/d0eb054b-55ab-51e6-8b66-940479db589e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474852,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0eb054b-55ab-51e6-8b66-940479db589e/d0eb054b-55ab-51e6-8b66-940479db589e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529902,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0eb054b-55ab-51e6-8b66-940479db589e/d0eb054b-55ab-51e6-8b66-940479db589e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419968,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0eb054b-55ab-51e6-8b66-940479db589e/d0eb054b-55ab-51e6-8b66-940479db589e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387440,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0eb054b-55ab-51e6-8b66-940479db589e/d0eb054b-55ab-51e6-8b66-940479db589e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397360,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0eb054b-55ab-51e6-8b66-940479db589e/d0eb054b-55ab-51e6-8b66-940479db589e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333853,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0eb054b-55ab-51e6-8b66-940479db589e/d0eb054b-55ab-51e6-8b66-940479db589e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350466,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/c1a1a80770534a1488ffbdd31081106b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-18',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 X1 sDrive18dA 150ch Business Design',
'transmission': 'automatic',
'trim': 'X1 sDrive18dA 150ch Business Design',
'vin': None,
'year': 2021}
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988348%27 HTTP/1.1" 200 None
2026-03-27 16:49:03 [ayvens.fr] INFO: Saving data for 1988348: {'created_time': 1774630143.641301, 'last_price_update_time': 1774630143.641315, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988348') HTTP/1.1" 204 0
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb8e57b0b41294319923930eb649f1807%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/4.jpg not downloaded yet
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59064d9d0>
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7db2fda1-a4a9-5365-9623-6a40658b62cf/7db2fda1-a4a9-5365-9623-6a40658b62cf_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F9ad4f55fbbb045f3926b6c64fbb0bbfa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/3.jpg saved to cache
2026-03-27 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7db2fda1-a4a9-5365-9623-6a40658b62cf
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3dcd0>
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7db2fda1-a4a9-5365-9623-6a40658b62cf/7db2fda1-a4a9-5365-9623-6a40658b62cf_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F9ad4f55fbbb045f3926b6c64fbb0bbfa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/5.jpg saved to cache
2026-03-27 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7db2fda1-a4a9-5365-9623-6a40658b62cf
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d79550>
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7db2fda1-a4a9-5365-9623-6a40658b62cf/7db2fda1-a4a9-5365-9623-6a40658b62cf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F9ad4f55fbbb045f3926b6c64fbb0bbfa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/1.jpg saved to cache
2026-03-27 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7db2fda1-a4a9-5365-9623-6a40658b62cf
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb8e57b0b41294319923930eb649f1807%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/5.jpg not downloaded yet
2026-03-27 16:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59120ab90>
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7db2fda1-a4a9-5365-9623-6a40658b62cf/7db2fda1-a4a9-5365-9623-6a40658b62cf_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F9ad4f55fbbb045f3926b6c64fbb0bbfa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/2.jpg saved to cache
2026-03-27 16:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7db2fda1-a4a9-5365-9623-6a40658b62cf
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f31410>
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7db2fda1-a4a9-5365-9623-6a40658b62cf/7db2fda1-a4a9-5365-9623-6a40658b62cf_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F9ad4f55fbbb045f3926b6c64fbb0bbfa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/7.jpg saved to cache
2026-03-27 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7db2fda1-a4a9-5365-9623-6a40658b62cf
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59057ffd0>
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7db2fda1-a4a9-5365-9623-6a40658b62cf/7db2fda1-a4a9-5365-9623-6a40658b62cf_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F9ad4f55fbbb045f3926b6c64fbb0bbfa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/6.jpg saved to cache
2026-03-27 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7db2fda1-a4a9-5365-9623-6a40658b62cf
2026-03-27 16:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb8e57b0b41294319923930eb649f1807%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/6.jpg not downloaded yet
2026-03-27 16:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb8e57b0b41294319923930eb649f1807%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/7.jpg not downloaded yet
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910c6dd0>
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7db2fda1-a4a9-5365-9623-6a40658b62cf/7db2fda1-a4a9-5365-9623-6a40658b62cf_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F9ad4f55fbbb045f3926b6c64fbb0bbfa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/8.jpg saved to cache
2026-03-27 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7db2fda1-a4a9-5365-9623-6a40658b62cf
2026-03-27 16:49:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7db2fda1-a4a9-5365-9623-6a40658b62cf, skipping ID generation
2026-03-27 16:49:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7db2fda1-a4a9-5365-9623-6a40658b62cf with scrape type 1
2026-03-27 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7db2fda1-a4a9-5365-9623-6a40658b62cf sending to next pipeline
2026-03-27 16:49:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7db2fda1-a4a9-5365-9623-6a40658b62cf, identifier: 1988349
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e7250>
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449fac81-5d1b-5182-b8d6-e0df08fc1d20/449fac81-5d1b-5182-b8d6-e0df08fc1d20_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F19d1b80aca854601b1db89aeb1ba358e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/7.jpg saved to cache
2026-03-27 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 449fac81-5d1b-5182-b8d6-e0df08fc1d20
2026-03-27 16:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7db2fda1-a4a9-5365-9623-6a40658b62cf with identifier: 1988349
2026-03-27 16:49:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7db2fda1-a4a9-5365-9623-6a40658b62cf with identifier: 1988349
2026-03-27 16:49:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7db2fda1-a4a9-5365-9623-6a40658b62cf with identifier: 1988349 to the API
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '7db2fda1-a4a9-5365-9623-6a40658b62cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 139980,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7db2fda1-a4a9-5365-9623-6a40658b62cf/7db2fda1-a4a9-5365-9623-6a40658b62cf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420291,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7db2fda1-a4a9-5365-9623-6a40658b62cf/7db2fda1-a4a9-5365-9623-6a40658b62cf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420291,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7db2fda1-a4a9-5365-9623-6a40658b62cf/7db2fda1-a4a9-5365-9623-6a40658b62cf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328942,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7db2fda1-a4a9-5365-9623-6a40658b62cf/7db2fda1-a4a9-5365-9623-6a40658b62cf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296660,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7db2fda1-a4a9-5365-9623-6a40658b62cf/7db2fda1-a4a9-5365-9623-6a40658b62cf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367050,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7db2fda1-a4a9-5365-9623-6a40658b62cf/7db2fda1-a4a9-5365-9623-6a40658b62cf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268890,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7db2fda1-a4a9-5365-9623-6a40658b62cf/7db2fda1-a4a9-5365-9623-6a40658b62cf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290069,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7db2fda1-a4a9-5365-9623-6a40658b62cf/7db2fda1-a4a9-5365-9623-6a40658b62cf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254109,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/9ad4f55fbbb045f3926b6c64fbb0bbfa/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-30',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.5 BlueHDi 130ch S&S Active Pack',
'transmission': 'manual',
'trim': '5008 1.5 BlueHDi 130ch S&S Active Pack',
'vin': None,
'year': 2022}
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988349%27 HTTP/1.1" 200 None
2026-03-27 16:49:04 [ayvens.fr] INFO: Saving data for 1988349: {'created_time': 1774630144.770587, 'last_price_update_time': 1774630144.770599, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988349') HTTP/1.1" 204 0
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb8e57b0b41294319923930eb649f1807%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/8.jpg not downloaded yet
2026-03-27 16:49:04 [ayvens.fr] INFO: Found listing with ID: 1988352
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988352%27 HTTP/1.1" 200 None
2026-03-27 16:49:04 [ayvens.fr] INFO: Scrape type for 1988352: 1
2026-03-27 16:49:04 [ayvens.fr] INFO: Extracting data for car ID: 1988352
2026-03-27 16:49:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7227abf3-cbee-55d6-96e5-13c933ad89f6 with identifier: 1988352
2026-03-27 16:49:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7227abf3-cbee-55d6-96e5-13c933ad89f6 with scrape type 1
2026-03-27 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7227abf3-cbee-55d6-96e5-13c933ad89f6
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F11d25a3a23d34aa4a2f845472dc35a5d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/1.jpg not downloaded yet
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591000790>
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449fac81-5d1b-5182-b8d6-e0df08fc1d20/449fac81-5d1b-5182-b8d6-e0df08fc1d20_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F19d1b80aca854601b1db89aeb1ba358e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/4.jpg saved to cache
2026-03-27 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 449fac81-5d1b-5182-b8d6-e0df08fc1d20
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe3850>
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449fac81-5d1b-5182-b8d6-e0df08fc1d20/449fac81-5d1b-5182-b8d6-e0df08fc1d20_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F19d1b80aca854601b1db89aeb1ba358e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/5.jpg saved to cache
2026-03-27 16:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 449fac81-5d1b-5182-b8d6-e0df08fc1d20
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59102e950>
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449fac81-5d1b-5182-b8d6-e0df08fc1d20/449fac81-5d1b-5182-b8d6-e0df08fc1d20_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F19d1b80aca854601b1db89aeb1ba358e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/6.jpg saved to cache
2026-03-27 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 449fac81-5d1b-5182-b8d6-e0df08fc1d20
2026-03-27 16:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5914829d0>
2026-03-27 16:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449fac81-5d1b-5182-b8d6-e0df08fc1d20/449fac81-5d1b-5182-b8d6-e0df08fc1d20_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F19d1b80aca854601b1db89aeb1ba358e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/3.jpg saved to cache
2026-03-27 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 449fac81-5d1b-5182-b8d6-e0df08fc1d20
2026-03-27 16:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59102eb10>
2026-03-27 16:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449fac81-5d1b-5182-b8d6-e0df08fc1d20/449fac81-5d1b-5182-b8d6-e0df08fc1d20_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F19d1b80aca854601b1db89aeb1ba358e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/1.jpg saved to cache
2026-03-27 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 449fac81-5d1b-5182-b8d6-e0df08fc1d20
2026-03-27 16:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903de390>
2026-03-27 16:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449fac81-5d1b-5182-b8d6-e0df08fc1d20/449fac81-5d1b-5182-b8d6-e0df08fc1d20_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F19d1b80aca854601b1db89aeb1ba358e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/2.jpg saved to cache
2026-03-27 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 449fac81-5d1b-5182-b8d6-e0df08fc1d20
2026-03-27 16:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F11d25a3a23d34aa4a2f845472dc35a5d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/2.jpg not downloaded yet
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F11d25a3a23d34aa4a2f845472dc35a5d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/3.jpg not downloaded yet
2026-03-27 16:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F11d25a3a23d34aa4a2f845472dc35a5d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/4.jpg not downloaded yet
2026-03-27 16:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F11d25a3a23d34aa4a2f845472dc35a5d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/5.jpg not downloaded yet
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F11d25a3a23d34aa4a2f845472dc35a5d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/6.jpg not downloaded yet
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F11d25a3a23d34aa4a2f845472dc35a5d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/7.jpg not downloaded yet
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F11d25a3a23d34aa4a2f845472dc35a5d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/8.jpg not downloaded yet
2026-03-27 16:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dbbd90>
2026-03-27 16:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449fac81-5d1b-5182-b8d6-e0df08fc1d20/449fac81-5d1b-5182-b8d6-e0df08fc1d20_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252F19d1b80aca854601b1db89aeb1ba358e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/8.jpg saved to cache
2026-03-27 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 449fac81-5d1b-5182-b8d6-e0df08fc1d20
2026-03-27 16:49:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 449fac81-5d1b-5182-b8d6-e0df08fc1d20, skipping ID generation
2026-03-27 16:49:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 449fac81-5d1b-5182-b8d6-e0df08fc1d20 with scrape type 1
2026-03-27 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 449fac81-5d1b-5182-b8d6-e0df08fc1d20 sending to next pipeline
2026-03-27 16:49:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 449fac81-5d1b-5182-b8d6-e0df08fc1d20, identifier: 1988350
2026-03-27 16:49:05 [ayvens.fr] INFO: Found listing with ID: 1988353
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988353%27 HTTP/1.1" 200 None
2026-03-27 16:49:05 [ayvens.fr] INFO: Scrape type for 1988353: 1
2026-03-27 16:49:05 [ayvens.fr] INFO: Extracting data for car ID: 1988353
2026-03-27 16:49:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c473ac9-bf71-543a-8c3f-18a5afa46c63 with identifier: 1988353
2026-03-27 16:49:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c473ac9-bf71-543a-8c3f-18a5afa46c63 with scrape type 1
2026-03-27 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3c473ac9-bf71-543a-8c3f-18a5afa46c63
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F0c4722effc5748369e6d164d62cd1bc6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/1.jpg not downloaded yet
2026-03-27 16:49:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 449fac81-5d1b-5182-b8d6-e0df08fc1d20 with identifier: 1988350
2026-03-27 16:49:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 449fac81-5d1b-5182-b8d6-e0df08fc1d20 with identifier: 1988350
2026-03-27 16:49:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 449fac81-5d1b-5182-b8d6-e0df08fc1d20 with identifier: 1988350 to the API
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 142,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '449fac81-5d1b-5182-b8d6-e0df08fc1d20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 130153,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449fac81-5d1b-5182-b8d6-e0df08fc1d20/449fac81-5d1b-5182-b8d6-e0df08fc1d20_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458391,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449fac81-5d1b-5182-b8d6-e0df08fc1d20/449fac81-5d1b-5182-b8d6-e0df08fc1d20_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458391,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449fac81-5d1b-5182-b8d6-e0df08fc1d20/449fac81-5d1b-5182-b8d6-e0df08fc1d20_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375875,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449fac81-5d1b-5182-b8d6-e0df08fc1d20/449fac81-5d1b-5182-b8d6-e0df08fc1d20_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294672,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449fac81-5d1b-5182-b8d6-e0df08fc1d20/449fac81-5d1b-5182-b8d6-e0df08fc1d20_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361726,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449fac81-5d1b-5182-b8d6-e0df08fc1d20/449fac81-5d1b-5182-b8d6-e0df08fc1d20_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330702,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449fac81-5d1b-5182-b8d6-e0df08fc1d20/449fac81-5d1b-5182-b8d6-e0df08fc1d20_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246257,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449fac81-5d1b-5182-b8d6-e0df08fc1d20/449fac81-5d1b-5182-b8d6-e0df08fc1d20_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296380,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/19d1b80aca854601b1db89aeb1ba358e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-15',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.5 BlueHDi 130ch S&S Allure Pack EAT8',
'transmission': 'automatic',
'trim': '3008 1.5 BlueHDi 130ch S&S Allure Pack EAT8',
'vin': None,
'year': 2024}
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988350%27 HTTP/1.1" 200 None
2026-03-27 16:49:06 [ayvens.fr] INFO: Saving data for 1988350: {'created_time': 1774630146.10981, 'last_price_update_time': 1774630146.109824, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988350') HTTP/1.1" 204 0
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b69c50>
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa3f143-8e20-5e93-9987-538dbd078661/8fa3f143-8e20-5e93-9987-538dbd078661_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb8e57b0b41294319923930eb649f1807%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/1.jpg saved to cache
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8fa3f143-8e20-5e93-9987-538dbd078661
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f83110>
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa3f143-8e20-5e93-9987-538dbd078661/8fa3f143-8e20-5e93-9987-538dbd078661_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb8e57b0b41294319923930eb649f1807%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/2.jpg saved to cache
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8fa3f143-8e20-5e93-9987-538dbd078661
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7f410>
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa3f143-8e20-5e93-9987-538dbd078661/8fa3f143-8e20-5e93-9987-538dbd078661_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb8e57b0b41294319923930eb649f1807%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/5.jpg saved to cache
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8fa3f143-8e20-5e93-9987-538dbd078661
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910ed210>
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa3f143-8e20-5e93-9987-538dbd078661/8fa3f143-8e20-5e93-9987-538dbd078661_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb8e57b0b41294319923930eb649f1807%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/4.jpg saved to cache
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8fa3f143-8e20-5e93-9987-538dbd078661
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F0c4722effc5748369e6d164d62cd1bc6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/2.jpg not downloaded yet
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd8d10>
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa3f143-8e20-5e93-9987-538dbd078661/8fa3f143-8e20-5e93-9987-538dbd078661_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb8e57b0b41294319923930eb649f1807%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/3.jpg saved to cache
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8fa3f143-8e20-5e93-9987-538dbd078661
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d58e50>
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa3f143-8e20-5e93-9987-538dbd078661/8fa3f143-8e20-5e93-9987-538dbd078661_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb8e57b0b41294319923930eb649f1807%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/7.jpg saved to cache
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8fa3f143-8e20-5e93-9987-538dbd078661
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7f050>
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa3f143-8e20-5e93-9987-538dbd078661/8fa3f143-8e20-5e93-9987-538dbd078661_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb8e57b0b41294319923930eb649f1807%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/6.jpg saved to cache
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8fa3f143-8e20-5e93-9987-538dbd078661
2026-03-27 16:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:06 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at -1 pages/min), scraped 153 items (at 45 items/min)
2026-03-27 16:49:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F0c4722effc5748369e6d164d62cd1bc6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/3.jpg not downloaded yet
2026-03-27 16:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F0c4722effc5748369e6d164d62cd1bc6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/4.jpg not downloaded yet
2026-03-27 16:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F0c4722effc5748369e6d164d62cd1bc6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/5.jpg not downloaded yet
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F0c4722effc5748369e6d164d62cd1bc6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/6.jpg not downloaded yet
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F0c4722effc5748369e6d164d62cd1bc6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/7.jpg not downloaded yet
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F0c4722effc5748369e6d164d62cd1bc6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/8.jpg not downloaded yet
2026-03-27 16:49:06 [ayvens.fr] INFO: Found listing with ID: 1988354
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988354%27 HTTP/1.1" 200 None
2026-03-27 16:49:06 [ayvens.fr] INFO: Scrape type for 1988354: 1
2026-03-27 16:49:06 [ayvens.fr] INFO: Extracting data for car ID: 1988354
2026-03-27 16:49:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f4eb196-fd7c-5f54-9dbf-20982d3aa047 with identifier: 1988354
2026-03-27 16:49:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f4eb196-fd7c-5f54-9dbf-20982d3aa047 with scrape type 1
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f4eb196-fd7c-5f54-9dbf-20982d3aa047
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F840b6dc9e5e84e3d95f3191d2affbd18%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/1.jpg not downloaded yet
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F840b6dc9e5e84e3d95f3191d2affbd18%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/2.jpg not downloaded yet
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd1650>
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fa3f143-8e20-5e93-9987-538dbd078661/8fa3f143-8e20-5e93-9987-538dbd078661_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fb8e57b0b41294319923930eb649f1807%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/8.jpg saved to cache
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8fa3f143-8e20-5e93-9987-538dbd078661
2026-03-27 16:49:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8fa3f143-8e20-5e93-9987-538dbd078661, skipping ID generation
2026-03-27 16:49:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fa3f143-8e20-5e93-9987-538dbd078661 with scrape type 1
2026-03-27 16:49:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8fa3f143-8e20-5e93-9987-538dbd078661 sending to next pipeline
2026-03-27 16:49:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8fa3f143-8e20-5e93-9987-538dbd078661, identifier: 1988351
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b6bcd0>
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7227abf3-cbee-55d6-96e5-13c933ad89f6/7227abf3-cbee-55d6-96e5-13c933ad89f6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F11d25a3a23d34aa4a2f845472dc35a5d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/3.jpg saved to cache
2026-03-27 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7227abf3-cbee-55d6-96e5-13c933ad89f6
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d47110>
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7227abf3-cbee-55d6-96e5-13c933ad89f6/7227abf3-cbee-55d6-96e5-13c933ad89f6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F11d25a3a23d34aa4a2f845472dc35a5d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/7.jpg saved to cache
2026-03-27 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7227abf3-cbee-55d6-96e5-13c933ad89f6
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591481550>
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7227abf3-cbee-55d6-96e5-13c933ad89f6/7227abf3-cbee-55d6-96e5-13c933ad89f6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F11d25a3a23d34aa4a2f845472dc35a5d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/5.jpg saved to cache
2026-03-27 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7227abf3-cbee-55d6-96e5-13c933ad89f6
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd3190>
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7227abf3-cbee-55d6-96e5-13c933ad89f6/7227abf3-cbee-55d6-96e5-13c933ad89f6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F11d25a3a23d34aa4a2f845472dc35a5d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/4.jpg saved to cache
2026-03-27 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7227abf3-cbee-55d6-96e5-13c933ad89f6
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f817d0>
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7227abf3-cbee-55d6-96e5-13c933ad89f6/7227abf3-cbee-55d6-96e5-13c933ad89f6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F11d25a3a23d34aa4a2f845472dc35a5d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/6.jpg saved to cache
2026-03-27 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7227abf3-cbee-55d6-96e5-13c933ad89f6
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590510810>
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7227abf3-cbee-55d6-96e5-13c933ad89f6/7227abf3-cbee-55d6-96e5-13c933ad89f6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F11d25a3a23d34aa4a2f845472dc35a5d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/2.jpg saved to cache
2026-03-27 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7227abf3-cbee-55d6-96e5-13c933ad89f6
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910ee450>
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7227abf3-cbee-55d6-96e5-13c933ad89f6/7227abf3-cbee-55d6-96e5-13c933ad89f6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F11d25a3a23d34aa4a2f845472dc35a5d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/1.jpg saved to cache
2026-03-27 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7227abf3-cbee-55d6-96e5-13c933ad89f6
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F840b6dc9e5e84e3d95f3191d2affbd18%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/3.jpg not downloaded yet
2026-03-27 16:49:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8fa3f143-8e20-5e93-9987-538dbd078661 with identifier: 1988351
2026-03-27 16:49:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8fa3f143-8e20-5e93-9987-538dbd078661 with identifier: 1988351
2026-03-27 16:49:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8fa3f143-8e20-5e93-9987-538dbd078661 with identifier: 1988351 to the API
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'GRIS ELECTROCLASH',
'currency': 'EUR',
'doors_number': 2,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '8fa3f143-8e20-5e93-9987-538dbd078661',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 38100,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa3f143-8e20-5e93-9987-538dbd078661/8fa3f143-8e20-5e93-9987-538dbd078661_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 521776,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa3f143-8e20-5e93-9987-538dbd078661/8fa3f143-8e20-5e93-9987-538dbd078661_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 521776,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa3f143-8e20-5e93-9987-538dbd078661/8fa3f143-8e20-5e93-9987-538dbd078661_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564251,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa3f143-8e20-5e93-9987-538dbd078661/8fa3f143-8e20-5e93-9987-538dbd078661_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468873,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa3f143-8e20-5e93-9987-538dbd078661/8fa3f143-8e20-5e93-9987-538dbd078661_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398238,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa3f143-8e20-5e93-9987-538dbd078661/8fa3f143-8e20-5e93-9987-538dbd078661_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336270,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa3f143-8e20-5e93-9987-538dbd078661/8fa3f143-8e20-5e93-9987-538dbd078661_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284428,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fa3f143-8e20-5e93-9987-538dbd078661/8fa3f143-8e20-5e93-9987-538dbd078661_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283139,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/b8e57b0b41294319923930eb649f1807/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-09',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500C 1.0 70ch BSG S&S Dolcevita',
'transmission': 'manual',
'trim': '500C 1.0 70ch BSG S&S Dolcevita',
'vin': None,
'year': 2022}
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988351%27 HTTP/1.1" 200 None
2026-03-27 16:49:07 [ayvens.fr] INFO: Saving data for 1988351: {'created_time': 1774630147.932455, 'last_price_update_time': 1774630147.932471, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988351') HTTP/1.1" 204 0
2026-03-27 16:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F840b6dc9e5e84e3d95f3191d2affbd18%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/4.jpg not downloaded yet
2026-03-27 16:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F840b6dc9e5e84e3d95f3191d2affbd18%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/5.jpg not downloaded yet
2026-03-27 16:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F840b6dc9e5e84e3d95f3191d2affbd18%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/6.jpg not downloaded yet
2026-03-27 16:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F840b6dc9e5e84e3d95f3191d2affbd18%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/7.jpg not downloaded yet
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F840b6dc9e5e84e3d95f3191d2affbd18%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/8.jpg not downloaded yet
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F840b6dc9e5e84e3d95f3191d2affbd18%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/9.jpg not downloaded yet
2026-03-27 16:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591052850>
2026-03-27 16:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7227abf3-cbee-55d6-96e5-13c933ad89f6/7227abf3-cbee-55d6-96e5-13c933ad89f6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F11d25a3a23d34aa4a2f845472dc35a5d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/8.jpg saved to cache
2026-03-27 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7227abf3-cbee-55d6-96e5-13c933ad89f6
2026-03-27 16:49:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7227abf3-cbee-55d6-96e5-13c933ad89f6, skipping ID generation
2026-03-27 16:49:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7227abf3-cbee-55d6-96e5-13c933ad89f6 with scrape type 1
2026-03-27 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7227abf3-cbee-55d6-96e5-13c933ad89f6 sending to next pipeline
2026-03-27 16:49:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7227abf3-cbee-55d6-96e5-13c933ad89f6, identifier: 1988352
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F840b6dc9e5e84e3d95f3191d2affbd18%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/10.jpg not downloaded yet
2026-03-27 16:49:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7227abf3-cbee-55d6-96e5-13c933ad89f6 with identifier: 1988352
2026-03-27 16:49:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:49:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7227abf3-cbee-55d6-96e5-13c933ad89f6 with identifier: 1988352
2026-03-27 16:49:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7227abf3-cbee-55d6-96e5-13c933ad89f6 with identifier: 1988352 to the API
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'color': 'NOIR METAL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '7227abf3-cbee-55d6-96e5-13c933ad89f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'ARKANA',
'odometer': 131203,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7227abf3-cbee-55d6-96e5-13c933ad89f6/7227abf3-cbee-55d6-96e5-13c933ad89f6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 467455,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7227abf3-cbee-55d6-96e5-13c933ad89f6/7227abf3-cbee-55d6-96e5-13c933ad89f6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 467455,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7227abf3-cbee-55d6-96e5-13c933ad89f6/7227abf3-cbee-55d6-96e5-13c933ad89f6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307247,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7227abf3-cbee-55d6-96e5-13c933ad89f6/7227abf3-cbee-55d6-96e5-13c933ad89f6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363630,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7227abf3-cbee-55d6-96e5-13c933ad89f6/7227abf3-cbee-55d6-96e5-13c933ad89f6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374484,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7227abf3-cbee-55d6-96e5-13c933ad89f6/7227abf3-cbee-55d6-96e5-13c933ad89f6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312973,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7227abf3-cbee-55d6-96e5-13c933ad89f6/7227abf3-cbee-55d6-96e5-13c933ad89f6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 207902,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7227abf3-cbee-55d6-96e5-13c933ad89f6/7227abf3-cbee-55d6-96e5-13c933ad89f6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305312,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/11d25a3a23d34aa4a2f845472dc35a5d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-13',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT ARKANA Arkana 1.6 E-Tech hybride 145ch Techno',
'transmission': 'automatic',
'trim': 'Arkana 1.6 E-Tech hybride 145ch Techno',
'vin': None,
'year': 2023}
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988352%27 HTTP/1.1" 200 None
2026-03-27 16:49:08 [ayvens.fr] INFO: Saving data for 1988352: {'created_time': 1774630148.733616, 'last_price_update_time': 1774630148.733628, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988352') HTTP/1.1" 204 0
2026-03-27 16:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591053290>
2026-03-27 16:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c473ac9-bf71-543a-8c3f-18a5afa46c63/3c473ac9-bf71-543a-8c3f-18a5afa46c63_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F0c4722effc5748369e6d164d62cd1bc6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/7.jpg saved to cache
2026-03-27 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c473ac9-bf71-543a-8c3f-18a5afa46c63
2026-03-27 16:49:08 [ayvens.fr] INFO: Found listing with ID: 1988355
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988355%27 HTTP/1.1" 200 None
2026-03-27 16:49:08 [ayvens.fr] INFO: Scrape type for 1988355: 1
2026-03-27 16:49:08 [ayvens.fr] INFO: Extracting data for car ID: 1988355
2026-03-27 16:49:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc5ef921-30ea-5948-8575-d73d7728eeb7 with identifier: 1988355
2026-03-27 16:49:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc5ef921-30ea-5948-8575-d73d7728eeb7 with scrape type 1
2026-03-27 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc5ef921-30ea-5948-8575-d73d7728eeb7
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F001c75d9aa324ff4b9643e9b1ee48258%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/1.jpg not downloaded yet
2026-03-27 16:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b8bfd0>
2026-03-27 16:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c473ac9-bf71-543a-8c3f-18a5afa46c63/3c473ac9-bf71-543a-8c3f-18a5afa46c63_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F0c4722effc5748369e6d164d62cd1bc6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/3.jpg saved to cache
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c473ac9-bf71-543a-8c3f-18a5afa46c63
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591105d90>
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c473ac9-bf71-543a-8c3f-18a5afa46c63/3c473ac9-bf71-543a-8c3f-18a5afa46c63_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F0c4722effc5748369e6d164d62cd1bc6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/4.jpg saved to cache
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c473ac9-bf71-543a-8c3f-18a5afa46c63
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903dcd90>
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c473ac9-bf71-543a-8c3f-18a5afa46c63/3c473ac9-bf71-543a-8c3f-18a5afa46c63_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F0c4722effc5748369e6d164d62cd1bc6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/1.jpg saved to cache
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c473ac9-bf71-543a-8c3f-18a5afa46c63
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d46f50>
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c473ac9-bf71-543a-8c3f-18a5afa46c63/3c473ac9-bf71-543a-8c3f-18a5afa46c63_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F0c4722effc5748369e6d164d62cd1bc6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/2.jpg saved to cache
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c473ac9-bf71-543a-8c3f-18a5afa46c63
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591051d10>
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c473ac9-bf71-543a-8c3f-18a5afa46c63/3c473ac9-bf71-543a-8c3f-18a5afa46c63_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F0c4722effc5748369e6d164d62cd1bc6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/5.jpg saved to cache
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c473ac9-bf71-543a-8c3f-18a5afa46c63
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590623790>
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c473ac9-bf71-543a-8c3f-18a5afa46c63/3c473ac9-bf71-543a-8c3f-18a5afa46c63_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F0c4722effc5748369e6d164d62cd1bc6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/6.jpg saved to cache
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c473ac9-bf71-543a-8c3f-18a5afa46c63
2026-03-27 16:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F001c75d9aa324ff4b9643e9b1ee48258%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/2.jpg not downloaded yet
2026-03-27 16:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F001c75d9aa324ff4b9643e9b1ee48258%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/3.jpg not downloaded yet
2026-03-27 16:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F001c75d9aa324ff4b9643e9b1ee48258%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/4.jpg not downloaded yet
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F001c75d9aa324ff4b9643e9b1ee48258%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/5.jpg not downloaded yet
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F001c75d9aa324ff4b9643e9b1ee48258%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/6.jpg not downloaded yet
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F001c75d9aa324ff4b9643e9b1ee48258%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/7.jpg not downloaded yet
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F001c75d9aa324ff4b9643e9b1ee48258%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/8.jpg not downloaded yet
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F001c75d9aa324ff4b9643e9b1ee48258%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/9.jpg not downloaded yet
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905133d0>
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f4eb196-fd7c-5f54-9dbf-20982d3aa047/9f4eb196-fd7c-5f54-9dbf-20982d3aa047_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F840b6dc9e5e84e3d95f3191d2affbd18%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/6.jpg saved to cache
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f4eb196-fd7c-5f54-9dbf-20982d3aa047
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590513390>
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f4eb196-fd7c-5f54-9dbf-20982d3aa047/9f4eb196-fd7c-5f54-9dbf-20982d3aa047_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F840b6dc9e5e84e3d95f3191d2affbd18%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/5.jpg saved to cache
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f4eb196-fd7c-5f54-9dbf-20982d3aa047
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F001c75d9aa324ff4b9643e9b1ee48258%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/10.jpg not downloaded yet
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c3910>
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c473ac9-bf71-543a-8c3f-18a5afa46c63/3c473ac9-bf71-543a-8c3f-18a5afa46c63_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgy-%252F0c4722effc5748369e6d164d62cd1bc6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/8.jpg saved to cache
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c473ac9-bf71-543a-8c3f-18a5afa46c63
2026-03-27 16:49:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c473ac9-bf71-543a-8c3f-18a5afa46c63, skipping ID generation
2026-03-27 16:49:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c473ac9-bf71-543a-8c3f-18a5afa46c63 with scrape type 1
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c473ac9-bf71-543a-8c3f-18a5afa46c63 sending to next pipeline
2026-03-27 16:49:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3c473ac9-bf71-543a-8c3f-18a5afa46c63, identifier: 1988353
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591003bd0>
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f4eb196-fd7c-5f54-9dbf-20982d3aa047/9f4eb196-fd7c-5f54-9dbf-20982d3aa047_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F840b6dc9e5e84e3d95f3191d2affbd18%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/2.jpg saved to cache
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f4eb196-fd7c-5f54-9dbf-20982d3aa047
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591053e90>
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f4eb196-fd7c-5f54-9dbf-20982d3aa047/9f4eb196-fd7c-5f54-9dbf-20982d3aa047_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F840b6dc9e5e84e3d95f3191d2affbd18%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/3.jpg saved to cache
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f4eb196-fd7c-5f54-9dbf-20982d3aa047
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ec7910>
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f4eb196-fd7c-5f54-9dbf-20982d3aa047/9f4eb196-fd7c-5f54-9dbf-20982d3aa047_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F840b6dc9e5e84e3d95f3191d2affbd18%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/7.jpg saved to cache
2026-03-27 16:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f4eb196-fd7c-5f54-9dbf-20982d3aa047
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b66d10>
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f4eb196-fd7c-5f54-9dbf-20982d3aa047/9f4eb196-fd7c-5f54-9dbf-20982d3aa047_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F840b6dc9e5e84e3d95f3191d2affbd18%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/4.jpg saved to cache
2026-03-27 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f4eb196-fd7c-5f54-9dbf-20982d3aa047
2026-03-27 16:49:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3c473ac9-bf71-543a-8c3f-18a5afa46c63 with identifier: 1988353
2026-03-27 16:49:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3c473ac9-bf71-543a-8c3f-18a5afa46c63 with identifier: 1988353
2026-03-27 16:49:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3c473ac9-bf71-543a-8c3f-18a5afa46c63 with identifier: 1988353 to the API
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '3c473ac9-bf71-543a-8c3f-18a5afa46c63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'STONIC',
'odometer': 55210,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c473ac9-bf71-543a-8c3f-18a5afa46c63/3c473ac9-bf71-543a-8c3f-18a5afa46c63_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377556,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c473ac9-bf71-543a-8c3f-18a5afa46c63/3c473ac9-bf71-543a-8c3f-18a5afa46c63_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377556,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c473ac9-bf71-543a-8c3f-18a5afa46c63/3c473ac9-bf71-543a-8c3f-18a5afa46c63_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389463,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c473ac9-bf71-543a-8c3f-18a5afa46c63/3c473ac9-bf71-543a-8c3f-18a5afa46c63_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415440,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c473ac9-bf71-543a-8c3f-18a5afa46c63/3c473ac9-bf71-543a-8c3f-18a5afa46c63_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428700,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c473ac9-bf71-543a-8c3f-18a5afa46c63/3c473ac9-bf71-543a-8c3f-18a5afa46c63_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 449788,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c473ac9-bf71-543a-8c3f-18a5afa46c63/3c473ac9-bf71-543a-8c3f-18a5afa46c63_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 247159,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c473ac9-bf71-543a-8c3f-18a5afa46c63/3c473ac9-bf71-543a-8c3f-18a5afa46c63_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349045,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gy-/0c4722effc5748369e6d164d62cd1bc6/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-07-02',
'seats_number': 5,
'seller_name': None,
'title': 'KIA STONIC Stonic 1.0 T-GDi 120ch MHEV GT Line Premium',
'transmission': 'manual',
'trim': 'Stonic 1.0 T-GDi 120ch MHEV GT Line Premium',
'vin': None,
'year': 2024}
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988353%27 HTTP/1.1" 200 None
2026-03-27 16:49:10 [ayvens.fr] INFO: Saving data for 1988353: {'created_time': 1774630150.424383, 'last_price_update_time': 1774630150.424396, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988353') HTTP/1.1" 204 0
2026-03-27 16:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:10 [ayvens.fr] INFO: Found listing with ID: 1988356
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988356%27 HTTP/1.1" 200 None
2026-03-27 16:49:10 [ayvens.fr] INFO: Scrape type for 1988356: 1
2026-03-27 16:49:10 [ayvens.fr] INFO: Extracting data for car ID: 1988356
2026-03-27 16:49:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 101262c0-92db-502a-8965-c1980a638e92 with identifier: 1988356
2026-03-27 16:49:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 101262c0-92db-502a-8965-c1980a638e92 with scrape type 1
2026-03-27 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 101262c0-92db-502a-8965-c1980a638e92
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F9ae1f7facfcf453d91c1957dfaa5130f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/1.jpg not downloaded yet
2026-03-27 16:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592829950>
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f4eb196-fd7c-5f54-9dbf-20982d3aa047/9f4eb196-fd7c-5f54-9dbf-20982d3aa047_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F840b6dc9e5e84e3d95f3191d2affbd18%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/1.jpg saved to cache
2026-03-27 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f4eb196-fd7c-5f54-9dbf-20982d3aa047
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F9ae1f7facfcf453d91c1957dfaa5130f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/2.jpg not downloaded yet
2026-03-27 16:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F9ae1f7facfcf453d91c1957dfaa5130f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/3.jpg not downloaded yet
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfd410>
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc5ef921-30ea-5948-8575-d73d7728eeb7/dc5ef921-30ea-5948-8575-d73d7728eeb7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F001c75d9aa324ff4b9643e9b1ee48258%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/2.jpg saved to cache
2026-03-27 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc5ef921-30ea-5948-8575-d73d7728eeb7
2026-03-27 16:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F9ae1f7facfcf453d91c1957dfaa5130f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/4.jpg not downloaded yet
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0fa10>
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc5ef921-30ea-5948-8575-d73d7728eeb7/dc5ef921-30ea-5948-8575-d73d7728eeb7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F001c75d9aa324ff4b9643e9b1ee48258%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/4.jpg saved to cache
2026-03-27 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc5ef921-30ea-5948-8575-d73d7728eeb7
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F9ae1f7facfcf453d91c1957dfaa5130f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/5.jpg not downloaded yet
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590676ad0>
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc5ef921-30ea-5948-8575-d73d7728eeb7/dc5ef921-30ea-5948-8575-d73d7728eeb7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F001c75d9aa324ff4b9643e9b1ee48258%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/3.jpg saved to cache
2026-03-27 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc5ef921-30ea-5948-8575-d73d7728eeb7
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e8e090>
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc5ef921-30ea-5948-8575-d73d7728eeb7/dc5ef921-30ea-5948-8575-d73d7728eeb7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F001c75d9aa324ff4b9643e9b1ee48258%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/1.jpg saved to cache
2026-03-27 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc5ef921-30ea-5948-8575-d73d7728eeb7
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee26d0>
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc5ef921-30ea-5948-8575-d73d7728eeb7/dc5ef921-30ea-5948-8575-d73d7728eeb7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F001c75d9aa324ff4b9643e9b1ee48258%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/5.jpg saved to cache
2026-03-27 16:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc5ef921-30ea-5948-8575-d73d7728eeb7
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590623610>
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f4eb196-fd7c-5f54-9dbf-20982d3aa047/9f4eb196-fd7c-5f54-9dbf-20982d3aa047_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F840b6dc9e5e84e3d95f3191d2affbd18%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/9.jpg saved to cache
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f4eb196-fd7c-5f54-9dbf-20982d3aa047
2026-03-27 16:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F9ae1f7facfcf453d91c1957dfaa5130f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/6.jpg not downloaded yet
2026-03-27 16:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F9ae1f7facfcf453d91c1957dfaa5130f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/7.jpg not downloaded yet
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b1390>
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f4eb196-fd7c-5f54-9dbf-20982d3aa047/9f4eb196-fd7c-5f54-9dbf-20982d3aa047_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F840b6dc9e5e84e3d95f3191d2affbd18%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/10.jpg saved to cache
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f4eb196-fd7c-5f54-9dbf-20982d3aa047
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b19d0>
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f4eb196-fd7c-5f54-9dbf-20982d3aa047/9f4eb196-fd7c-5f54-9dbf-20982d3aa047_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F840b6dc9e5e84e3d95f3191d2affbd18%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/8.jpg saved to cache
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f4eb196-fd7c-5f54-9dbf-20982d3aa047
2026-03-27 16:49:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f4eb196-fd7c-5f54-9dbf-20982d3aa047, skipping ID generation
2026-03-27 16:49:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f4eb196-fd7c-5f54-9dbf-20982d3aa047 with scrape type 1
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f4eb196-fd7c-5f54-9dbf-20982d3aa047 sending to next pipeline
2026-03-27 16:49:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9f4eb196-fd7c-5f54-9dbf-20982d3aa047, identifier: 1988354
2026-03-27 16:49:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9f4eb196-fd7c-5f54-9dbf-20982d3aa047 with identifier: 1988354
2026-03-27 16:49:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:49:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9f4eb196-fd7c-5f54-9dbf-20982d3aa047 with identifier: 1988354
2026-03-27 16:49:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9f4eb196-fd7c-5f54-9dbf-20982d3aa047 with identifier: 1988354 to the API
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLANC NACR',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '9f4eb196-fd7c-5f54-9dbf-20982d3aa047',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'CA AIRCROSS',
'odometer': 122289,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f4eb196-fd7c-5f54-9dbf-20982d3aa047/9f4eb196-fd7c-5f54-9dbf-20982d3aa047_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 399420,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f4eb196-fd7c-5f54-9dbf-20982d3aa047/9f4eb196-fd7c-5f54-9dbf-20982d3aa047_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288475,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f4eb196-fd7c-5f54-9dbf-20982d3aa047/9f4eb196-fd7c-5f54-9dbf-20982d3aa047_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305452,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f4eb196-fd7c-5f54-9dbf-20982d3aa047/9f4eb196-fd7c-5f54-9dbf-20982d3aa047_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373214,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f4eb196-fd7c-5f54-9dbf-20982d3aa047/9f4eb196-fd7c-5f54-9dbf-20982d3aa047_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223269,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f4eb196-fd7c-5f54-9dbf-20982d3aa047/9f4eb196-fd7c-5f54-9dbf-20982d3aa047_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237609,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f4eb196-fd7c-5f54-9dbf-20982d3aa047/9f4eb196-fd7c-5f54-9dbf-20982d3aa047_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302807,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f4eb196-fd7c-5f54-9dbf-20982d3aa047/9f4eb196-fd7c-5f54-9dbf-20982d3aa047_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 508754,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f4eb196-fd7c-5f54-9dbf-20982d3aa047/9f4eb196-fd7c-5f54-9dbf-20982d3aa047_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414370,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f4eb196-fd7c-5f54-9dbf-20982d3aa047/9f4eb196-fd7c-5f54-9dbf-20982d3aa047_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 479966,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/840b6dc9e5e84e3d95f3191d2affbd18/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-23',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN CA AIRCROSS C5 Aircross BlueHDi 130ch S&S Shine EAT8',
'transmission': 'automatic',
'trim': 'C5 Aircross BlueHDi 130ch S&S Shine EAT8',
'vin': None,
'year': 2020}
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988354%27 HTTP/1.1" 200 None
2026-03-27 16:49:11 [ayvens.fr] INFO: Saving data for 1988354: {'created_time': 1774630151.668444, 'last_price_update_time': 1774630151.668455, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988354') HTTP/1.1" 204 0
2026-03-27 16:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F9ae1f7facfcf453d91c1957dfaa5130f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/8.jpg not downloaded yet
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b69c10>
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc5ef921-30ea-5948-8575-d73d7728eeb7/dc5ef921-30ea-5948-8575-d73d7728eeb7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F001c75d9aa324ff4b9643e9b1ee48258%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/8.jpg saved to cache
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc5ef921-30ea-5948-8575-d73d7728eeb7
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b420d0>
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc5ef921-30ea-5948-8575-d73d7728eeb7/dc5ef921-30ea-5948-8575-d73d7728eeb7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F001c75d9aa324ff4b9643e9b1ee48258%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/6.jpg saved to cache
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc5ef921-30ea-5948-8575-d73d7728eeb7
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050f410>
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc5ef921-30ea-5948-8575-d73d7728eeb7/dc5ef921-30ea-5948-8575-d73d7728eeb7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F001c75d9aa324ff4b9643e9b1ee48258%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/10.jpg saved to cache
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dc5ef921-30ea-5948-8575-d73d7728eeb7
2026-03-27 16:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:11 [ayvens.fr] INFO: Found listing with ID: 1988357
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988357%27 HTTP/1.1" 200 None
2026-03-27 16:49:11 [ayvens.fr] INFO: Scrape type for 1988357: 1
2026-03-27 16:49:11 [ayvens.fr] INFO: Extracting data for car ID: 1988357
2026-03-27 16:49:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f825e59-2177-5c40-bfc4-4aa53f25ef7c with identifier: 1988357
2026-03-27 16:49:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f825e59-2177-5c40-bfc4-4aa53f25ef7c with scrape type 1
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4f825e59-2177-5c40-bfc4-4aa53f25ef7c
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcb0870f68f3342ceb791958fb8a08378%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/1.jpg not downloaded yet
2026-03-27 16:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcb0870f68f3342ceb791958fb8a08378%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/2.jpg not downloaded yet
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903ce410>
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc5ef921-30ea-5948-8575-d73d7728eeb7/dc5ef921-30ea-5948-8575-d73d7728eeb7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F001c75d9aa324ff4b9643e9b1ee48258%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/7.jpg saved to cache
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc5ef921-30ea-5948-8575-d73d7728eeb7
2026-03-27 16:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcb0870f68f3342ceb791958fb8a08378%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/3.jpg not downloaded yet
2026-03-27 16:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906168d0>
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc5ef921-30ea-5948-8575-d73d7728eeb7/dc5ef921-30ea-5948-8575-d73d7728eeb7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F001c75d9aa324ff4b9643e9b1ee48258%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/9.jpg saved to cache
2026-03-27 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc5ef921-30ea-5948-8575-d73d7728eeb7
2026-03-27 16:49:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc5ef921-30ea-5948-8575-d73d7728eeb7, skipping ID generation
2026-03-27 16:49:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc5ef921-30ea-5948-8575-d73d7728eeb7 with scrape type 1
2026-03-27 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc5ef921-30ea-5948-8575-d73d7728eeb7 sending to next pipeline
2026-03-27 16:49:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: dc5ef921-30ea-5948-8575-d73d7728eeb7, identifier: 1988355
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d7ae50>
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101262c0-92db-502a-8965-c1980a638e92/101262c0-92db-502a-8965-c1980a638e92_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F9ae1f7facfcf453d91c1957dfaa5130f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/2.jpg saved to cache
2026-03-27 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 101262c0-92db-502a-8965-c1980a638e92
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d47890>
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101262c0-92db-502a-8965-c1980a638e92/101262c0-92db-502a-8965-c1980a638e92_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F9ae1f7facfcf453d91c1957dfaa5130f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/1.jpg saved to cache
2026-03-27 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 101262c0-92db-502a-8965-c1980a638e92
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d51a50>
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101262c0-92db-502a-8965-c1980a638e92/101262c0-92db-502a-8965-c1980a638e92_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F9ae1f7facfcf453d91c1957dfaa5130f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/3.jpg saved to cache
2026-03-27 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 101262c0-92db-502a-8965-c1980a638e92
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcb0870f68f3342ceb791958fb8a08378%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/4.jpg not downloaded yet
2026-03-27 16:49:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: dc5ef921-30ea-5948-8575-d73d7728eeb7 with identifier: 1988355
2026-03-27 16:49:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: dc5ef921-30ea-5948-8575-d73d7728eeb7 with identifier: 1988355
2026-03-27 16:49:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: dc5ef921-30ea-5948-8575-d73d7728eeb7 with identifier: 1988355 to the API
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid',
'id': 'dc5ef921-30ea-5948-8575-d73d7728eeb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 111883,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5ef921-30ea-5948-8575-d73d7728eeb7/dc5ef921-30ea-5948-8575-d73d7728eeb7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373241,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5ef921-30ea-5948-8575-d73d7728eeb7/dc5ef921-30ea-5948-8575-d73d7728eeb7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244338,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5ef921-30ea-5948-8575-d73d7728eeb7/dc5ef921-30ea-5948-8575-d73d7728eeb7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338029,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5ef921-30ea-5948-8575-d73d7728eeb7/dc5ef921-30ea-5948-8575-d73d7728eeb7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223182,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5ef921-30ea-5948-8575-d73d7728eeb7/dc5ef921-30ea-5948-8575-d73d7728eeb7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332514,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5ef921-30ea-5948-8575-d73d7728eeb7/dc5ef921-30ea-5948-8575-d73d7728eeb7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244009,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5ef921-30ea-5948-8575-d73d7728eeb7/dc5ef921-30ea-5948-8575-d73d7728eeb7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290832,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5ef921-30ea-5948-8575-d73d7728eeb7/dc5ef921-30ea-5948-8575-d73d7728eeb7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 142999,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5ef921-30ea-5948-8575-d73d7728eeb7/dc5ef921-30ea-5948-8575-d73d7728eeb7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353480,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5ef921-30ea-5948-8575-d73d7728eeb7/dc5ef921-30ea-5948-8575-d73d7728eeb7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189407,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/001c75d9aa324ff4b9643e9b1ee48258/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-01',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA YARIS Yaris 116h France Business 5p + Stage Hybrid Academy',
'transmission': 'automatic',
'trim': 'Yaris 116h France Business 5p + Stage Hybrid Academy',
'vin': None,
'year': 2021}
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988355%27 HTTP/1.1" 200 None
2026-03-27 16:49:12 [ayvens.fr] INFO: Saving data for 1988355: {'created_time': 1774630152.687835, 'last_price_update_time': 1774630152.687849, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988355') HTTP/1.1" 204 0
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903ce2d0>
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101262c0-92db-502a-8965-c1980a638e92/101262c0-92db-502a-8965-c1980a638e92_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F9ae1f7facfcf453d91c1957dfaa5130f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/4.jpg saved to cache
2026-03-27 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 101262c0-92db-502a-8965-c1980a638e92
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcb0870f68f3342ceb791958fb8a08378%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/5.jpg not downloaded yet
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905b16d0>
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101262c0-92db-502a-8965-c1980a638e92/101262c0-92db-502a-8965-c1980a638e92_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F9ae1f7facfcf453d91c1957dfaa5130f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/5.jpg saved to cache
2026-03-27 16:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 101262c0-92db-502a-8965-c1980a638e92
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0d990>
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101262c0-92db-502a-8965-c1980a638e92/101262c0-92db-502a-8965-c1980a638e92_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F9ae1f7facfcf453d91c1957dfaa5130f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/6.jpg saved to cache
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 101262c0-92db-502a-8965-c1980a638e92
2026-03-27 16:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcb0870f68f3342ceb791958fb8a08378%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/6.jpg not downloaded yet
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcb0870f68f3342ceb791958fb8a08378%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/7.jpg not downloaded yet
2026-03-27 16:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcb0870f68f3342ceb791958fb8a08378%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/8.jpg not downloaded yet
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcb0870f68f3342ceb791958fb8a08378%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/9.jpg not downloaded yet
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcb0870f68f3342ceb791958fb8a08378%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/10.jpg not downloaded yet
2026-03-27 16:49:13 [ayvens.fr] INFO: Found listing with ID: 1988358
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988358%27 HTTP/1.1" 200 None
2026-03-27 16:49:13 [ayvens.fr] INFO: Scrape type for 1988358: 1
2026-03-27 16:49:13 [ayvens.fr] INFO: Extracting data for car ID: 1988358
2026-03-27 16:49:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df0627ae-4e12-599d-a942-511570138f6e with identifier: 1988358
2026-03-27 16:49:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df0627ae-4e12-599d-a942-511570138f6e with scrape type 1
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df0627ae-4e12-599d-a942-511570138f6e
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa5e8d841ec4243cfa6df640a782245b7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/1.jpg not downloaded yet
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa5e8d841ec4243cfa6df640a782245b7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/2.jpg not downloaded yet
2026-03-27 16:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d7bf50>
2026-03-27 16:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101262c0-92db-502a-8965-c1980a638e92/101262c0-92db-502a-8965-c1980a638e92_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F9ae1f7facfcf453d91c1957dfaa5130f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/8.jpg saved to cache
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 101262c0-92db-502a-8965-c1980a638e92
2026-03-27 16:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a3bd0>
2026-03-27 16:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101262c0-92db-502a-8965-c1980a638e92/101262c0-92db-502a-8965-c1980a638e92_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F9ae1f7facfcf453d91c1957dfaa5130f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/7.jpg saved to cache
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 101262c0-92db-502a-8965-c1980a638e92
2026-03-27 16:49:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 101262c0-92db-502a-8965-c1980a638e92, skipping ID generation
2026-03-27 16:49:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 101262c0-92db-502a-8965-c1980a638e92 with scrape type 1
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 101262c0-92db-502a-8965-c1980a638e92 sending to next pipeline
2026-03-27 16:49:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 101262c0-92db-502a-8965-c1980a638e92, identifier: 1988356
2026-03-27 16:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa5e8d841ec4243cfa6df640a782245b7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/3.jpg not downloaded yet
2026-03-27 16:49:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 101262c0-92db-502a-8965-c1980a638e92 with identifier: 1988356
2026-03-27 16:49:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 101262c0-92db-502a-8965-c1980a638e92 with identifier: 1988356
2026-03-27 16:49:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 101262c0-92db-502a-8965-c1980a638e92 with identifier: 1988356 to the API
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '101262c0-92db-502a-8965-c1980a638e92',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'ZOE',
'odometer': 11973,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101262c0-92db-502a-8965-c1980a638e92/101262c0-92db-502a-8965-c1980a638e92_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101262c0-92db-502a-8965-c1980a638e92/101262c0-92db-502a-8965-c1980a638e92_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101262c0-92db-502a-8965-c1980a638e92/101262c0-92db-502a-8965-c1980a638e92_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330890,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101262c0-92db-502a-8965-c1980a638e92/101262c0-92db-502a-8965-c1980a638e92_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310163,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101262c0-92db-502a-8965-c1980a638e92/101262c0-92db-502a-8965-c1980a638e92_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315891,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101262c0-92db-502a-8965-c1980a638e92/101262c0-92db-502a-8965-c1980a638e92_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286292,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101262c0-92db-502a-8965-c1980a638e92/101262c0-92db-502a-8965-c1980a638e92_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340695,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101262c0-92db-502a-8965-c1980a638e92/101262c0-92db-502a-8965-c1980a638e92_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345346,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/9ae1f7facfcf453d91c1957dfaa5130f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT ZOE Zoe E-Tech Business charge normale R110 Achat Intégral',
'transmission': 'automatic',
'trim': 'Zoe E-Tech Business charge normale R110 Achat Intégral',
'vin': None,
'year': 2021}
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988356%27 HTTP/1.1" 200 None
2026-03-27 16:49:13 [ayvens.fr] INFO: Saving data for 1988356: {'created_time': 1774630153.770881, 'last_price_update_time': 1774630153.770894, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988356') HTTP/1.1" 204 0
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa5e8d841ec4243cfa6df640a782245b7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/4.jpg not downloaded yet
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa5e8d841ec4243cfa6df640a782245b7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/5.jpg not downloaded yet
2026-03-27 16:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b50e90>
2026-03-27 16:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f825e59-2177-5c40-bfc4-4aa53f25ef7c/4f825e59-2177-5c40-bfc4-4aa53f25ef7c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcb0870f68f3342ceb791958fb8a08378%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/1.jpg saved to cache
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f825e59-2177-5c40-bfc4-4aa53f25ef7c
2026-03-27 16:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfdb10>
2026-03-27 16:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f825e59-2177-5c40-bfc4-4aa53f25ef7c/4f825e59-2177-5c40-bfc4-4aa53f25ef7c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcb0870f68f3342ceb791958fb8a08378%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/2.jpg saved to cache
2026-03-27 16:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f825e59-2177-5c40-bfc4-4aa53f25ef7c
2026-03-27 16:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592871350>
2026-03-27 16:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f825e59-2177-5c40-bfc4-4aa53f25ef7c/4f825e59-2177-5c40-bfc4-4aa53f25ef7c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcb0870f68f3342ceb791958fb8a08378%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/3.jpg saved to cache
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f825e59-2177-5c40-bfc4-4aa53f25ef7c
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050e410>
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f825e59-2177-5c40-bfc4-4aa53f25ef7c/4f825e59-2177-5c40-bfc4-4aa53f25ef7c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcb0870f68f3342ceb791958fb8a08378%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/4.jpg saved to cache
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f825e59-2177-5c40-bfc4-4aa53f25ef7c
2026-03-27 16:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa5e8d841ec4243cfa6df640a782245b7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/6.jpg not downloaded yet
2026-03-27 16:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa5e8d841ec4243cfa6df640a782245b7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/7.jpg not downloaded yet
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa5e8d841ec4243cfa6df640a782245b7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/8.jpg not downloaded yet
2026-03-27 16:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa5e8d841ec4243cfa6df640a782245b7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/9.jpg not downloaded yet
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa5e8d841ec4243cfa6df640a782245b7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/10.jpg not downloaded yet
2026-03-27 16:49:14 [ayvens.fr] INFO: Found listing with ID: 1988359
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988359%27 HTTP/1.1" 200 None
2026-03-27 16:49:14 [ayvens.fr] INFO: Scrape type for 1988359: 1
2026-03-27 16:49:14 [ayvens.fr] INFO: Extracting data for car ID: 1988359
2026-03-27 16:49:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9beee96-6968-50c4-a87c-6dba2cf334a3 with identifier: 1988359
2026-03-27 16:49:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9beee96-6968-50c4-a87c-6dba2cf334a3 with scrape type 1
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9beee96-6968-50c4-a87c-6dba2cf334a3
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fddef320c9bf44eca8048af73a871b25a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/1.jpg not downloaded yet
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fddef320c9bf44eca8048af73a871b25a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/2.jpg not downloaded yet
2026-03-27 16:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fddef320c9bf44eca8048af73a871b25a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/3.jpg not downloaded yet
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c0190>
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f825e59-2177-5c40-bfc4-4aa53f25ef7c/4f825e59-2177-5c40-bfc4-4aa53f25ef7c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcb0870f68f3342ceb791958fb8a08378%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/5.jpg saved to cache
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f825e59-2177-5c40-bfc4-4aa53f25ef7c
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4c850>
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f825e59-2177-5c40-bfc4-4aa53f25ef7c/4f825e59-2177-5c40-bfc4-4aa53f25ef7c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcb0870f68f3342ceb791958fb8a08378%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/7.jpg saved to cache
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f825e59-2177-5c40-bfc4-4aa53f25ef7c
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4c310>
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f825e59-2177-5c40-bfc4-4aa53f25ef7c/4f825e59-2177-5c40-bfc4-4aa53f25ef7c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcb0870f68f3342ceb791958fb8a08378%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/8.jpg saved to cache
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f825e59-2177-5c40-bfc4-4aa53f25ef7c
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590eff090>
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f825e59-2177-5c40-bfc4-4aa53f25ef7c/4f825e59-2177-5c40-bfc4-4aa53f25ef7c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcb0870f68f3342ceb791958fb8a08378%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/9.jpg saved to cache
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4f825e59-2177-5c40-bfc4-4aa53f25ef7c
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2d8d0>
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f825e59-2177-5c40-bfc4-4aa53f25ef7c/4f825e59-2177-5c40-bfc4-4aa53f25ef7c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcb0870f68f3342ceb791958fb8a08378%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/10.jpg saved to cache
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4f825e59-2177-5c40-bfc4-4aa53f25ef7c
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efd250>
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f825e59-2177-5c40-bfc4-4aa53f25ef7c/4f825e59-2177-5c40-bfc4-4aa53f25ef7c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Fcb0870f68f3342ceb791958fb8a08378%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/6.jpg saved to cache
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f825e59-2177-5c40-bfc4-4aa53f25ef7c
2026-03-27 16:49:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f825e59-2177-5c40-bfc4-4aa53f25ef7c, skipping ID generation
2026-03-27 16:49:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f825e59-2177-5c40-bfc4-4aa53f25ef7c with scrape type 1
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f825e59-2177-5c40-bfc4-4aa53f25ef7c sending to next pipeline
2026-03-27 16:49:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4f825e59-2177-5c40-bfc4-4aa53f25ef7c, identifier: 1988357
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592870410>
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df0627ae-4e12-599d-a942-511570138f6e/df0627ae-4e12-599d-a942-511570138f6e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa5e8d841ec4243cfa6df640a782245b7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/1.jpg saved to cache
2026-03-27 16:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df0627ae-4e12-599d-a942-511570138f6e
2026-03-27 16:49:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4f825e59-2177-5c40-bfc4-4aa53f25ef7c with identifier: 1988357
2026-03-27 16:49:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:49:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4f825e59-2177-5c40-bfc4-4aa53f25ef7c with identifier: 1988357
2026-03-27 16:49:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4f825e59-2177-5c40-bfc4-4aa53f25ef7c with identifier: 1988357 to the API
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIS',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '4f825e59-2177-5c40-bfc4-4aa53f25ef7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'CLASSE A',
'odometer': 75040,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f825e59-2177-5c40-bfc4-4aa53f25ef7c/4f825e59-2177-5c40-bfc4-4aa53f25ef7c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440144,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f825e59-2177-5c40-bfc4-4aa53f25ef7c/4f825e59-2177-5c40-bfc4-4aa53f25ef7c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305380,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f825e59-2177-5c40-bfc4-4aa53f25ef7c/4f825e59-2177-5c40-bfc4-4aa53f25ef7c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322497,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f825e59-2177-5c40-bfc4-4aa53f25ef7c/4f825e59-2177-5c40-bfc4-4aa53f25ef7c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253509,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f825e59-2177-5c40-bfc4-4aa53f25ef7c/4f825e59-2177-5c40-bfc4-4aa53f25ef7c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340108,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f825e59-2177-5c40-bfc4-4aa53f25ef7c/4f825e59-2177-5c40-bfc4-4aa53f25ef7c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410815,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f825e59-2177-5c40-bfc4-4aa53f25ef7c/4f825e59-2177-5c40-bfc4-4aa53f25ef7c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402698,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f825e59-2177-5c40-bfc4-4aa53f25ef7c/4f825e59-2177-5c40-bfc4-4aa53f25ef7c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271269,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f825e59-2177-5c40-bfc4-4aa53f25ef7c/4f825e59-2177-5c40-bfc4-4aa53f25ef7c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331267,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f825e59-2177-5c40-bfc4-4aa53f25ef7c/4f825e59-2177-5c40-bfc4-4aa53f25ef7c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420625,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/cb0870f68f3342ceb791958fb8a08378/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-19',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ CLASSE A Classe A 180 136ch Business Line 7G-DCT',
'transmission': 'automatic',
'trim': 'Classe A 180 136ch Business Line 7G-DCT',
'vin': None,
'year': 2022}
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988357%27 HTTP/1.1" 200 None
2026-03-27 16:49:15 [ayvens.fr] INFO: Saving data for 1988357: {'created_time': 1774630155.439282, 'last_price_update_time': 1774630155.439295, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988357') HTTP/1.1" 204 0
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fddef320c9bf44eca8048af73a871b25a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/4.jpg not downloaded yet
2026-03-27 16:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590510f10>
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df0627ae-4e12-599d-a942-511570138f6e/df0627ae-4e12-599d-a942-511570138f6e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa5e8d841ec4243cfa6df640a782245b7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/2.jpg saved to cache
2026-03-27 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df0627ae-4e12-599d-a942-511570138f6e
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065c750>
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df0627ae-4e12-599d-a942-511570138f6e/df0627ae-4e12-599d-a942-511570138f6e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa5e8d841ec4243cfa6df640a782245b7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/5.jpg saved to cache
2026-03-27 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df0627ae-4e12-599d-a942-511570138f6e
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ac75d0>
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df0627ae-4e12-599d-a942-511570138f6e/df0627ae-4e12-599d-a942-511570138f6e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa5e8d841ec4243cfa6df640a782245b7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/3.jpg saved to cache
2026-03-27 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df0627ae-4e12-599d-a942-511570138f6e
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fddef320c9bf44eca8048af73a871b25a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/5.jpg not downloaded yet
2026-03-27 16:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fddef320c9bf44eca8048af73a871b25a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/6.jpg not downloaded yet
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910d1150>
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df0627ae-4e12-599d-a942-511570138f6e/df0627ae-4e12-599d-a942-511570138f6e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa5e8d841ec4243cfa6df640a782245b7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/6.jpg saved to cache
2026-03-27 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df0627ae-4e12-599d-a942-511570138f6e
2026-03-27 16:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fddef320c9bf44eca8048af73a871b25a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/7.jpg not downloaded yet
2026-03-27 16:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fddef320c9bf44eca8048af73a871b25a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/8.jpg not downloaded yet
2026-03-27 16:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fddef320c9bf44eca8048af73a871b25a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/9.jpg not downloaded yet
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fddef320c9bf44eca8048af73a871b25a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/10.jpg not downloaded yet
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905122d0>
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df0627ae-4e12-599d-a942-511570138f6e/df0627ae-4e12-599d-a942-511570138f6e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa5e8d841ec4243cfa6df640a782245b7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/4.jpg saved to cache
2026-03-27 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df0627ae-4e12-599d-a942-511570138f6e
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efed90>
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df0627ae-4e12-599d-a942-511570138f6e/df0627ae-4e12-599d-a942-511570138f6e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa5e8d841ec4243cfa6df640a782245b7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/7.jpg saved to cache
2026-03-27 16:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df0627ae-4e12-599d-a942-511570138f6e
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7dbd0>
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df0627ae-4e12-599d-a942-511570138f6e/df0627ae-4e12-599d-a942-511570138f6e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa5e8d841ec4243cfa6df640a782245b7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/9.jpg saved to cache
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df0627ae-4e12-599d-a942-511570138f6e
2026-03-27 16:49:16 [ayvens.fr] INFO: Found listing with ID: 1988360
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988360%27 HTTP/1.1" 200 None
2026-03-27 16:49:16 [ayvens.fr] INFO: Scrape type for 1988360: 1
2026-03-27 16:49:16 [ayvens.fr] INFO: Extracting data for car ID: 1988360
2026-03-27 16:49:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c784e4ba-6ede-501e-a7fd-fd5509f29699 with identifier: 1988360
2026-03-27 16:49:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c784e4ba-6ede-501e-a7fd-fd5509f29699 with scrape type 1
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c784e4ba-6ede-501e-a7fd-fd5509f29699
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff8f545afe05648c7a852c8a36b16db65%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/1.jpg not downloaded yet
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff8f545afe05648c7a852c8a36b16db65%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/2.jpg not downloaded yet
2026-03-27 16:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff8f545afe05648c7a852c8a36b16db65%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/3.jpg not downloaded yet
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7e190>
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df0627ae-4e12-599d-a942-511570138f6e/df0627ae-4e12-599d-a942-511570138f6e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa5e8d841ec4243cfa6df640a782245b7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/8.jpg saved to cache
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df0627ae-4e12-599d-a942-511570138f6e
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e083d0>
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df0627ae-4e12-599d-a942-511570138f6e/df0627ae-4e12-599d-a942-511570138f6e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fa5e8d841ec4243cfa6df640a782245b7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/10.jpg saved to cache
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df0627ae-4e12-599d-a942-511570138f6e
2026-03-27 16:49:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df0627ae-4e12-599d-a942-511570138f6e, skipping ID generation
2026-03-27 16:49:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df0627ae-4e12-599d-a942-511570138f6e with scrape type 1
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df0627ae-4e12-599d-a942-511570138f6e sending to next pipeline
2026-03-27 16:49:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: df0627ae-4e12-599d-a942-511570138f6e, identifier: 1988358
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b8b490>
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9beee96-6968-50c4-a87c-6dba2cf334a3/e9beee96-6968-50c4-a87c-6dba2cf334a3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fddef320c9bf44eca8048af73a871b25a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/1.jpg saved to cache
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9beee96-6968-50c4-a87c-6dba2cf334a3
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ac5a90>
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9beee96-6968-50c4-a87c-6dba2cf334a3/e9beee96-6968-50c4-a87c-6dba2cf334a3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fddef320c9bf44eca8048af73a871b25a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/2.jpg saved to cache
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9beee96-6968-50c4-a87c-6dba2cf334a3
2026-03-27 16:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: df0627ae-4e12-599d-a942-511570138f6e with identifier: 1988358
2026-03-27 16:49:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: df0627ae-4e12-599d-a942-511570138f6e with identifier: 1988358
2026-03-27 16:49:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: df0627ae-4e12-599d-a942-511570138f6e with identifier: 1988358 to the API
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIS',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': 'df0627ae-4e12-599d-a942-511570138f6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 98446,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df0627ae-4e12-599d-a942-511570138f6e/df0627ae-4e12-599d-a942-511570138f6e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 427275,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df0627ae-4e12-599d-a942-511570138f6e/df0627ae-4e12-599d-a942-511570138f6e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338220,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df0627ae-4e12-599d-a942-511570138f6e/df0627ae-4e12-599d-a942-511570138f6e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368807,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df0627ae-4e12-599d-a942-511570138f6e/df0627ae-4e12-599d-a942-511570138f6e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317210,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df0627ae-4e12-599d-a942-511570138f6e/df0627ae-4e12-599d-a942-511570138f6e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248133,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df0627ae-4e12-599d-a942-511570138f6e/df0627ae-4e12-599d-a942-511570138f6e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186521,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df0627ae-4e12-599d-a942-511570138f6e/df0627ae-4e12-599d-a942-511570138f6e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374975,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df0627ae-4e12-599d-a942-511570138f6e/df0627ae-4e12-599d-a942-511570138f6e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 413073,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df0627ae-4e12-599d-a942-511570138f6e/df0627ae-4e12-599d-a942-511570138f6e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378497,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df0627ae-4e12-599d-a942-511570138f6e/df0627ae-4e12-599d-a942-511570138f6e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 484682,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/a5e8d841ec4243cfa6df640a782245b7/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-15',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE Megane E-Tech Electric EV60 220ch Equilibre optimum '
'charge',
'transmission': 'automatic',
'trim': 'Megane E-Tech Electric EV60 220ch Equilibre optimum charge',
'vin': None,
'year': 2022}
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988358%27 HTTP/1.1" 200 None
2026-03-27 16:49:16 [ayvens.fr] INFO: Saving data for 1988358: {'created_time': 1774630156.811121, 'last_price_update_time': 1774630156.811133, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988358') HTTP/1.1" 204 0
2026-03-27 16:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff8f545afe05648c7a852c8a36b16db65%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/4.jpg not downloaded yet
2026-03-27 16:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff8f545afe05648c7a852c8a36b16db65%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/5.jpg not downloaded yet
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910eddd0>
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9beee96-6968-50c4-a87c-6dba2cf334a3/e9beee96-6968-50c4-a87c-6dba2cf334a3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fddef320c9bf44eca8048af73a871b25a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/3.jpg saved to cache
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9beee96-6968-50c4-a87c-6dba2cf334a3
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b66f10>
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9beee96-6968-50c4-a87c-6dba2cf334a3/e9beee96-6968-50c4-a87c-6dba2cf334a3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fddef320c9bf44eca8048af73a871b25a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/6.jpg saved to cache
2026-03-27 16:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9beee96-6968-50c4-a87c-6dba2cf334a3
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903dd550>
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9beee96-6968-50c4-a87c-6dba2cf334a3/e9beee96-6968-50c4-a87c-6dba2cf334a3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fddef320c9bf44eca8048af73a871b25a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/8.jpg saved to cache
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9beee96-6968-50c4-a87c-6dba2cf334a3
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff8f545afe05648c7a852c8a36b16db65%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/6.jpg not downloaded yet
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff8f545afe05648c7a852c8a36b16db65%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/7.jpg not downloaded yet
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591446ed0>
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9beee96-6968-50c4-a87c-6dba2cf334a3/e9beee96-6968-50c4-a87c-6dba2cf334a3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fddef320c9bf44eca8048af73a871b25a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/4.jpg saved to cache
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9beee96-6968-50c4-a87c-6dba2cf334a3
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911c9d90>
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9beee96-6968-50c4-a87c-6dba2cf334a3/e9beee96-6968-50c4-a87c-6dba2cf334a3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fddef320c9bf44eca8048af73a871b25a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/7.jpg saved to cache
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9beee96-6968-50c4-a87c-6dba2cf334a3
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e4650>
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9beee96-6968-50c4-a87c-6dba2cf334a3/e9beee96-6968-50c4-a87c-6dba2cf334a3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fddef320c9bf44eca8048af73a871b25a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/5.jpg saved to cache
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9beee96-6968-50c4-a87c-6dba2cf334a3
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a99d0>
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9beee96-6968-50c4-a87c-6dba2cf334a3/e9beee96-6968-50c4-a87c-6dba2cf334a3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fddef320c9bf44eca8048af73a871b25a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/9.jpg saved to cache
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e9beee96-6968-50c4-a87c-6dba2cf334a3
2026-03-27 16:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff8f545afe05648c7a852c8a36b16db65%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/8.jpg not downloaded yet
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff8f545afe05648c7a852c8a36b16db65%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/9.jpg not downloaded yet
2026-03-27 16:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff8f545afe05648c7a852c8a36b16db65%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/10.jpg not downloaded yet
2026-03-27 16:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:17 [ayvens.fr] INFO: Found listing with ID: 1988361
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988361%27 HTTP/1.1" 200 None
2026-03-27 16:49:17 [ayvens.fr] INFO: Scrape type for 1988361: 1
2026-03-27 16:49:17 [ayvens.fr] INFO: Extracting data for car ID: 1988361
2026-03-27 16:49:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2070f47-c90a-53d2-8b3e-60baa35937ff with identifier: 1988361
2026-03-27 16:49:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2070f47-c90a-53d2-8b3e-60baa35937ff with scrape type 1
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f2070f47-c90a-53d2-8b3e-60baa35937ff
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F9f4d23aba90c41118d6a6c359e51f2de%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/1.jpg not downloaded yet
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F9f4d23aba90c41118d6a6c359e51f2de%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/2.jpg not downloaded yet
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F9f4d23aba90c41118d6a6c359e51f2de%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/3.jpg not downloaded yet
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d2c50>
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9beee96-6968-50c4-a87c-6dba2cf334a3/e9beee96-6968-50c4-a87c-6dba2cf334a3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fddef320c9bf44eca8048af73a871b25a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/10.jpg saved to cache
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e9beee96-6968-50c4-a87c-6dba2cf334a3
2026-03-27 16:49:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9beee96-6968-50c4-a87c-6dba2cf334a3, skipping ID generation
2026-03-27 16:49:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9beee96-6968-50c4-a87c-6dba2cf334a3 with scrape type 1
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9beee96-6968-50c4-a87c-6dba2cf334a3 sending to next pipeline
2026-03-27 16:49:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e9beee96-6968-50c4-a87c-6dba2cf334a3, identifier: 1988359
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903ddf90>
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c784e4ba-6ede-501e-a7fd-fd5509f29699/c784e4ba-6ede-501e-a7fd-fd5509f29699_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff8f545afe05648c7a852c8a36b16db65%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/1.jpg saved to cache
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c784e4ba-6ede-501e-a7fd-fd5509f29699
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F9f4d23aba90c41118d6a6c359e51f2de%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/4.jpg not downloaded yet
2026-03-27 16:49:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e9beee96-6968-50c4-a87c-6dba2cf334a3 with identifier: 1988359
2026-03-27 16:49:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:49:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e9beee96-6968-50c4-a87c-6dba2cf334a3 with identifier: 1988359
2026-03-27 16:49:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e9beee96-6968-50c4-a87c-6dba2cf334a3 with identifier: 1988359 to the API
2026-03-27 16:49:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLEU',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'e9beee96-6968-50c4-a87c-6dba2cf334a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 69875,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9beee96-6968-50c4-a87c-6dba2cf334a3/e9beee96-6968-50c4-a87c-6dba2cf334a3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440659,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9beee96-6968-50c4-a87c-6dba2cf334a3/e9beee96-6968-50c4-a87c-6dba2cf334a3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461709,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9beee96-6968-50c4-a87c-6dba2cf334a3/e9beee96-6968-50c4-a87c-6dba2cf334a3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312718,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9beee96-6968-50c4-a87c-6dba2cf334a3/e9beee96-6968-50c4-a87c-6dba2cf334a3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355895,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9beee96-6968-50c4-a87c-6dba2cf334a3/e9beee96-6968-50c4-a87c-6dba2cf334a3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 413591,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9beee96-6968-50c4-a87c-6dba2cf334a3/e9beee96-6968-50c4-a87c-6dba2cf334a3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319696,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9beee96-6968-50c4-a87c-6dba2cf334a3/e9beee96-6968-50c4-a87c-6dba2cf334a3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360512,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9beee96-6968-50c4-a87c-6dba2cf334a3/e9beee96-6968-50c4-a87c-6dba2cf334a3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324974,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9beee96-6968-50c4-a87c-6dba2cf334a3/e9beee96-6968-50c4-a87c-6dba2cf334a3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182658,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9beee96-6968-50c4-a87c-6dba2cf334a3/e9beee96-6968-50c4-a87c-6dba2cf334a3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514158,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/ddef320c9bf44eca8048af73a871b25a/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-26',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 SW 308 SW 1.2 PureTech 130ch S&S Allure Pack EAT8',
'transmission': 'automatic',
'trim': '308 SW 1.2 PureTech 130ch S&S Allure Pack EAT8',
'vin': None,
'year': 2022}
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988359%27 HTTP/1.1" 200 None
2026-03-27 16:49:18 [ayvens.fr] INFO: Saving data for 1988359: {'created_time': 1774630158.195789, 'last_price_update_time': 1774630158.1958, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988359') HTTP/1.1" 204 0
2026-03-27 16:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F9f4d23aba90c41118d6a6c359e51f2de%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/5.jpg not downloaded yet
2026-03-27 16:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F9f4d23aba90c41118d6a6c359e51f2de%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/6.jpg not downloaded yet
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d8f110>
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c784e4ba-6ede-501e-a7fd-fd5509f29699/c784e4ba-6ede-501e-a7fd-fd5509f29699_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff8f545afe05648c7a852c8a36b16db65%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/3.jpg saved to cache
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c784e4ba-6ede-501e-a7fd-fd5509f29699
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e5890>
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c784e4ba-6ede-501e-a7fd-fd5509f29699/c784e4ba-6ede-501e-a7fd-fd5509f29699_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff8f545afe05648c7a852c8a36b16db65%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/2.jpg saved to cache
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c784e4ba-6ede-501e-a7fd-fd5509f29699
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066e410>
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c784e4ba-6ede-501e-a7fd-fd5509f29699/c784e4ba-6ede-501e-a7fd-fd5509f29699_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff8f545afe05648c7a852c8a36b16db65%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/5.jpg saved to cache
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c784e4ba-6ede-501e-a7fd-fd5509f29699
2026-03-27 16:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F9f4d23aba90c41118d6a6c359e51f2de%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/7.jpg not downloaded yet
2026-03-27 16:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F9f4d23aba90c41118d6a6c359e51f2de%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/8.jpg not downloaded yet
2026-03-27 16:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910c0f90>
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c784e4ba-6ede-501e-a7fd-fd5509f29699/c784e4ba-6ede-501e-a7fd-fd5509f29699_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff8f545afe05648c7a852c8a36b16db65%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/6.jpg saved to cache
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c784e4ba-6ede-501e-a7fd-fd5509f29699
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590511c10>
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c784e4ba-6ede-501e-a7fd-fd5509f29699/c784e4ba-6ede-501e-a7fd-fd5509f29699_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff8f545afe05648c7a852c8a36b16db65%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/4.jpg saved to cache
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c784e4ba-6ede-501e-a7fd-fd5509f29699
2026-03-27 16:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F9f4d23aba90c41118d6a6c359e51f2de%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/9.jpg not downloaded yet
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F9f4d23aba90c41118d6a6c359e51f2de%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/10.jpg not downloaded yet
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59067fe90>
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c784e4ba-6ede-501e-a7fd-fd5509f29699/c784e4ba-6ede-501e-a7fd-fd5509f29699_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff8f545afe05648c7a852c8a36b16db65%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/9.jpg saved to cache
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c784e4ba-6ede-501e-a7fd-fd5509f29699
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d63750>
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c784e4ba-6ede-501e-a7fd-fd5509f29699/c784e4ba-6ede-501e-a7fd-fd5509f29699_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff8f545afe05648c7a852c8a36b16db65%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/10.jpg saved to cache
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c784e4ba-6ede-501e-a7fd-fd5509f29699
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2de10>
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c784e4ba-6ede-501e-a7fd-fd5509f29699/c784e4ba-6ede-501e-a7fd-fd5509f29699_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff8f545afe05648c7a852c8a36b16db65%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/7.jpg saved to cache
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c784e4ba-6ede-501e-a7fd-fd5509f29699
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590616c10>
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c784e4ba-6ede-501e-a7fd-fd5509f29699/c784e4ba-6ede-501e-a7fd-fd5509f29699_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff8f545afe05648c7a852c8a36b16db65%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/8.jpg saved to cache
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c784e4ba-6ede-501e-a7fd-fd5509f29699
2026-03-27 16:49:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c784e4ba-6ede-501e-a7fd-fd5509f29699, skipping ID generation
2026-03-27 16:49:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c784e4ba-6ede-501e-a7fd-fd5509f29699 with scrape type 1
2026-03-27 16:49:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c784e4ba-6ede-501e-a7fd-fd5509f29699 sending to next pipeline
2026-03-27 16:49:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c784e4ba-6ede-501e-a7fd-fd5509f29699, identifier: 1988360
2026-03-27 16:49:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c784e4ba-6ede-501e-a7fd-fd5509f29699 with identifier: 1988360
2026-03-27 16:49:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c784e4ba-6ede-501e-a7fd-fd5509f29699 with identifier: 1988360
2026-03-27 16:49:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c784e4ba-6ede-501e-a7fd-fd5509f29699 with identifier: 1988360 to the API
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIS',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'c784e4ba-6ede-501e-a7fd-fd5509f29699',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 81010,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c784e4ba-6ede-501e-a7fd-fd5509f29699/c784e4ba-6ede-501e-a7fd-fd5509f29699_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416346,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c784e4ba-6ede-501e-a7fd-fd5509f29699/c784e4ba-6ede-501e-a7fd-fd5509f29699_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354651,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c784e4ba-6ede-501e-a7fd-fd5509f29699/c784e4ba-6ede-501e-a7fd-fd5509f29699_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453641,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c784e4ba-6ede-501e-a7fd-fd5509f29699/c784e4ba-6ede-501e-a7fd-fd5509f29699_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437003,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c784e4ba-6ede-501e-a7fd-fd5509f29699/c784e4ba-6ede-501e-a7fd-fd5509f29699_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442816,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c784e4ba-6ede-501e-a7fd-fd5509f29699/c784e4ba-6ede-501e-a7fd-fd5509f29699_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249854,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c784e4ba-6ede-501e-a7fd-fd5509f29699/c784e4ba-6ede-501e-a7fd-fd5509f29699_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 495993,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c784e4ba-6ede-501e-a7fd-fd5509f29699/c784e4ba-6ede-501e-a7fd-fd5509f29699_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 507760,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c784e4ba-6ede-501e-a7fd-fd5509f29699/c784e4ba-6ede-501e-a7fd-fd5509f29699_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310198,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c784e4ba-6ede-501e-a7fd-fd5509f29699/c784e4ba-6ede-501e-a7fd-fd5509f29699_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365098,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/f8f545afe05648c7a852c8a36b16db65/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-30',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Active Pack',
'transmission': 'manual',
'trim': '5008 1.2 PureTech 130ch S&S Active Pack',
'vin': None,
'year': 2023}
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988360%27 HTTP/1.1" 200 None
2026-03-27 16:49:19 [ayvens.fr] INFO: Saving data for 1988360: {'created_time': 1774630159.487574, 'last_price_update_time': 1774630159.487586, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988360') HTTP/1.1" 204 0
2026-03-27 16:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2db10>
2026-03-27 16:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2070f47-c90a-53d2-8b3e-60baa35937ff/f2070f47-c90a-53d2-8b3e-60baa35937ff_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F9f4d23aba90c41118d6a6c359e51f2de%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/1.jpg saved to cache
2026-03-27 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2070f47-c90a-53d2-8b3e-60baa35937ff
2026-03-27 16:49:19 [ayvens.fr] INFO: Found listing with ID: 1988362
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988362%27 HTTP/1.1" 200 None
2026-03-27 16:49:19 [ayvens.fr] INFO: Scrape type for 1988362: 1
2026-03-27 16:49:19 [ayvens.fr] INFO: Extracting data for car ID: 1988362
2026-03-27 16:49:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 913ef2dc-241f-5fad-b6e6-dc43dd79dacd with identifier: 1988362
2026-03-27 16:49:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 913ef2dc-241f-5fad-b6e6-dc43dd79dacd with scrape type 1
2026-03-27 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 913ef2dc-241f-5fad-b6e6-dc43dd79dacd
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd9e25b8909f24007ba9c5d727ebb35b6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/1.jpg not downloaded yet
2026-03-27 16:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910d9450>
2026-03-27 16:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2070f47-c90a-53d2-8b3e-60baa35937ff/f2070f47-c90a-53d2-8b3e-60baa35937ff_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F9f4d23aba90c41118d6a6c359e51f2de%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/2.jpg saved to cache
2026-03-27 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2070f47-c90a-53d2-8b3e-60baa35937ff
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd9e25b8909f24007ba9c5d727ebb35b6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/2.jpg not downloaded yet
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd9e25b8909f24007ba9c5d727ebb35b6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/3.jpg not downloaded yet
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd9e25b8909f24007ba9c5d727ebb35b6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/4.jpg not downloaded yet
2026-03-27 16:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd9e25b8909f24007ba9c5d727ebb35b6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/5.jpg not downloaded yet
2026-03-27 16:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de7810>
2026-03-27 16:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2070f47-c90a-53d2-8b3e-60baa35937ff/f2070f47-c90a-53d2-8b3e-60baa35937ff_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F9f4d23aba90c41118d6a6c359e51f2de%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/3.jpg saved to cache
2026-03-27 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2070f47-c90a-53d2-8b3e-60baa35937ff
2026-03-27 16:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd9e25b8909f24007ba9c5d727ebb35b6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/6.jpg not downloaded yet
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd9e25b8909f24007ba9c5d727ebb35b6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/7.jpg not downloaded yet
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd9e25b8909f24007ba9c5d727ebb35b6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/8.jpg not downloaded yet
2026-03-27 16:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d45810>
2026-03-27 16:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2070f47-c90a-53d2-8b3e-60baa35937ff/f2070f47-c90a-53d2-8b3e-60baa35937ff_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F9f4d23aba90c41118d6a6c359e51f2de%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/4.jpg saved to cache
2026-03-27 16:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2070f47-c90a-53d2-8b3e-60baa35937ff
2026-03-27 16:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590daea50>
2026-03-27 16:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2070f47-c90a-53d2-8b3e-60baa35937ff/f2070f47-c90a-53d2-8b3e-60baa35937ff_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F9f4d23aba90c41118d6a6c359e51f2de%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/5.jpg saved to cache
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2070f47-c90a-53d2-8b3e-60baa35937ff
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c1010>
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2070f47-c90a-53d2-8b3e-60baa35937ff/f2070f47-c90a-53d2-8b3e-60baa35937ff_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F9f4d23aba90c41118d6a6c359e51f2de%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/6.jpg saved to cache
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2070f47-c90a-53d2-8b3e-60baa35937ff
2026-03-27 16:49:20 [ayvens.fr] INFO: Found listing with ID: 1988363
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988363%27 HTTP/1.1" 200 None
2026-03-27 16:49:20 [ayvens.fr] INFO: Scrape type for 1988363: 1
2026-03-27 16:49:20 [ayvens.fr] INFO: Extracting data for car ID: 1988363
2026-03-27 16:49:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b671213b-0141-5329-8835-4d859e91d6b0 with identifier: 1988363
2026-03-27 16:49:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b671213b-0141-5329-8835-4d859e91d6b0 with scrape type 1
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b671213b-0141-5329-8835-4d859e91d6b0
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F2250e5549e8f43c5920c81ff852c11c6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/1.jpg not downloaded yet
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F2250e5549e8f43c5920c81ff852c11c6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/2.jpg not downloaded yet
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903dded0>
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2070f47-c90a-53d2-8b3e-60baa35937ff/f2070f47-c90a-53d2-8b3e-60baa35937ff_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F9f4d23aba90c41118d6a6c359e51f2de%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/8.jpg saved to cache
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2070f47-c90a-53d2-8b3e-60baa35937ff
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911ecb90>
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2070f47-c90a-53d2-8b3e-60baa35937ff/f2070f47-c90a-53d2-8b3e-60baa35937ff_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F9f4d23aba90c41118d6a6c359e51f2de%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/7.jpg saved to cache
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f2070f47-c90a-53d2-8b3e-60baa35937ff
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592c40fd0>
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2070f47-c90a-53d2-8b3e-60baa35937ff/f2070f47-c90a-53d2-8b3e-60baa35937ff_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F9f4d23aba90c41118d6a6c359e51f2de%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/9.jpg saved to cache
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f2070f47-c90a-53d2-8b3e-60baa35937ff
2026-03-27 16:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F2250e5549e8f43c5920c81ff852c11c6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/3.jpg not downloaded yet
2026-03-27 16:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F2250e5549e8f43c5920c81ff852c11c6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/4.jpg not downloaded yet
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F2250e5549e8f43c5920c81ff852c11c6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/5.jpg not downloaded yet
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F2250e5549e8f43c5920c81ff852c11c6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/6.jpg not downloaded yet
2026-03-27 16:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F2250e5549e8f43c5920c81ff852c11c6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/7.jpg not downloaded yet
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F2250e5549e8f43c5920c81ff852c11c6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/8.jpg not downloaded yet
2026-03-27 16:49:20 [ayvens.fr] INFO: Found listing with ID: 1988364
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988364%27 HTTP/1.1" 200 None
2026-03-27 16:49:20 [ayvens.fr] INFO: Scrape type for 1988364: 1
2026-03-27 16:49:20 [ayvens.fr] INFO: Extracting data for car ID: 1988364
2026-03-27 16:49:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84dde02e-528a-5498-8b13-8d5400a7a272 with identifier: 1988364
2026-03-27 16:49:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84dde02e-528a-5498-8b13-8d5400a7a272 with scrape type 1
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 84dde02e-528a-5498-8b13-8d5400a7a272
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fd89be1a94c174d81819fc0156616f57a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/1.jpg not downloaded yet
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ac6910>
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_913ef2dc-241f-5fad-b6e6-dc43dd79dacd/913ef2dc-241f-5fad-b6e6-dc43dd79dacd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd9e25b8909f24007ba9c5d727ebb35b6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/1.jpg saved to cache
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 913ef2dc-241f-5fad-b6e6-dc43dd79dacd
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d60350>
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_913ef2dc-241f-5fad-b6e6-dc43dd79dacd/913ef2dc-241f-5fad-b6e6-dc43dd79dacd_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd9e25b8909f24007ba9c5d727ebb35b6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/6.jpg saved to cache
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 913ef2dc-241f-5fad-b6e6-dc43dd79dacd
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fd89be1a94c174d81819fc0156616f57a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/2.jpg not downloaded yet
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b657d0>
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_913ef2dc-241f-5fad-b6e6-dc43dd79dacd/913ef2dc-241f-5fad-b6e6-dc43dd79dacd_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd9e25b8909f24007ba9c5d727ebb35b6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/5.jpg saved to cache
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 913ef2dc-241f-5fad-b6e6-dc43dd79dacd
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59287ae50>
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_913ef2dc-241f-5fad-b6e6-dc43dd79dacd/913ef2dc-241f-5fad-b6e6-dc43dd79dacd_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd9e25b8909f24007ba9c5d727ebb35b6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/3.jpg saved to cache
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 913ef2dc-241f-5fad-b6e6-dc43dd79dacd
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906542d0>
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2070f47-c90a-53d2-8b3e-60baa35937ff/f2070f47-c90a-53d2-8b3e-60baa35937ff_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffc-%252F9f4d23aba90c41118d6a6c359e51f2de%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/10.jpg saved to cache
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f2070f47-c90a-53d2-8b3e-60baa35937ff
2026-03-27 16:49:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2070f47-c90a-53d2-8b3e-60baa35937ff, skipping ID generation
2026-03-27 16:49:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2070f47-c90a-53d2-8b3e-60baa35937ff with scrape type 1
2026-03-27 16:49:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2070f47-c90a-53d2-8b3e-60baa35937ff sending to next pipeline
2026-03-27 16:49:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f2070f47-c90a-53d2-8b3e-60baa35937ff, identifier: 1988361
2026-03-27 16:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906954d0>
2026-03-27 16:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_913ef2dc-241f-5fad-b6e6-dc43dd79dacd/913ef2dc-241f-5fad-b6e6-dc43dd79dacd_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd9e25b8909f24007ba9c5d727ebb35b6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/4.jpg saved to cache
2026-03-27 16:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 913ef2dc-241f-5fad-b6e6-dc43dd79dacd
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fd89be1a94c174d81819fc0156616f57a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/3.jpg not downloaded yet
2026-03-27 16:49:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f2070f47-c90a-53d2-8b3e-60baa35937ff with identifier: 1988361
2026-03-27 16:49:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:49:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f2070f47-c90a-53d2-8b3e-60baa35937ff with identifier: 1988361
2026-03-27 16:49:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f2070f47-c90a-53d2-8b3e-60baa35937ff with identifier: 1988361 to the API
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': 79,
'color': 'NOIR EBENE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'f2070f47-c90a-53d2-8b3e-60baa35937ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'NIRO',
'odometer': 137536,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2070f47-c90a-53d2-8b3e-60baa35937ff/f2070f47-c90a-53d2-8b3e-60baa35937ff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 573836,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2070f47-c90a-53d2-8b3e-60baa35937ff/f2070f47-c90a-53d2-8b3e-60baa35937ff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 573836,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2070f47-c90a-53d2-8b3e-60baa35937ff/f2070f47-c90a-53d2-8b3e-60baa35937ff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 554128,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2070f47-c90a-53d2-8b3e-60baa35937ff/f2070f47-c90a-53d2-8b3e-60baa35937ff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 574951,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2070f47-c90a-53d2-8b3e-60baa35937ff/f2070f47-c90a-53d2-8b3e-60baa35937ff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 582805,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2070f47-c90a-53d2-8b3e-60baa35937ff/f2070f47-c90a-53d2-8b3e-60baa35937ff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561446,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2070f47-c90a-53d2-8b3e-60baa35937ff/f2070f47-c90a-53d2-8b3e-60baa35937ff_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 698175,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2070f47-c90a-53d2-8b3e-60baa35937ff/f2070f47-c90a-53d2-8b3e-60baa35937ff_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 614204,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2070f47-c90a-53d2-8b3e-60baa35937ff/f2070f47-c90a-53d2-8b3e-60baa35937ff_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 576269,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2070f47-c90a-53d2-8b3e-60baa35937ff/f2070f47-c90a-53d2-8b3e-60baa35937ff_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 684202,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fc-/9f4d23aba90c41118d6a6c359e51f2de/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-17',
'seats_number': 5,
'seller_name': None,
'title': 'KIA NIRO Niro 1.6 GDi 105ch ISG + electrique 43.5ch Active Business '
'DCT6',
'transmission': 'automatic',
'trim': 'Niro 1.6 GDi 105ch ISG + electrique 43.5ch Active Business DCT6',
'vin': None,
'year': 2018}
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988361%27 HTTP/1.1" 200 None
2026-03-27 16:49:21 [ayvens.fr] INFO: Saving data for 1988361: {'created_time': 1774630161.579587, 'last_price_update_time': 1774630161.579599, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988361') HTTP/1.1" 204 0
2026-03-27 16:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fd89be1a94c174d81819fc0156616f57a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/4.jpg not downloaded yet
2026-03-27 16:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3a050>
2026-03-27 16:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_913ef2dc-241f-5fad-b6e6-dc43dd79dacd/913ef2dc-241f-5fad-b6e6-dc43dd79dacd_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd9e25b8909f24007ba9c5d727ebb35b6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/7.jpg saved to cache
2026-03-27 16:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 913ef2dc-241f-5fad-b6e6-dc43dd79dacd
2026-03-27 16:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904d4290>
2026-03-27 16:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_913ef2dc-241f-5fad-b6e6-dc43dd79dacd/913ef2dc-241f-5fad-b6e6-dc43dd79dacd_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd9e25b8909f24007ba9c5d727ebb35b6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/2.jpg saved to cache
2026-03-27 16:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 913ef2dc-241f-5fad-b6e6-dc43dd79dacd
2026-03-27 16:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fd89be1a94c174d81819fc0156616f57a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/5.jpg not downloaded yet
2026-03-27 16:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fd89be1a94c174d81819fc0156616f57a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/6.jpg not downloaded yet
2026-03-27 16:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590aba690>
2026-03-27 16:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_913ef2dc-241f-5fad-b6e6-dc43dd79dacd/913ef2dc-241f-5fad-b6e6-dc43dd79dacd_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd9e25b8909f24007ba9c5d727ebb35b6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/8.jpg saved to cache
2026-03-27 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 913ef2dc-241f-5fad-b6e6-dc43dd79dacd
2026-03-27 16:49:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 913ef2dc-241f-5fad-b6e6-dc43dd79dacd, skipping ID generation
2026-03-27 16:49:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 913ef2dc-241f-5fad-b6e6-dc43dd79dacd with scrape type 1
2026-03-27 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 913ef2dc-241f-5fad-b6e6-dc43dd79dacd sending to next pipeline
2026-03-27 16:49:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 913ef2dc-241f-5fad-b6e6-dc43dd79dacd, identifier: 1988362
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fd89be1a94c174d81819fc0156616f57a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/7.jpg not downloaded yet
2026-03-27 16:49:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 913ef2dc-241f-5fad-b6e6-dc43dd79dacd with identifier: 1988362
2026-03-27 16:49:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 913ef2dc-241f-5fad-b6e6-dc43dd79dacd with identifier: 1988362
2026-03-27 16:49:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 913ef2dc-241f-5fad-b6e6-dc43dd79dacd with identifier: 1988362 to the API
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 29,
'color': 'GRIS TITANIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '913ef2dc-241f-5fad-b6e6-dc43dd79dacd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 132706,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913ef2dc-241f-5fad-b6e6-dc43dd79dacd/913ef2dc-241f-5fad-b6e6-dc43dd79dacd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414804,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913ef2dc-241f-5fad-b6e6-dc43dd79dacd/913ef2dc-241f-5fad-b6e6-dc43dd79dacd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414804,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913ef2dc-241f-5fad-b6e6-dc43dd79dacd/913ef2dc-241f-5fad-b6e6-dc43dd79dacd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323967,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913ef2dc-241f-5fad-b6e6-dc43dd79dacd/913ef2dc-241f-5fad-b6e6-dc43dd79dacd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385121,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913ef2dc-241f-5fad-b6e6-dc43dd79dacd/913ef2dc-241f-5fad-b6e6-dc43dd79dacd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299524,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913ef2dc-241f-5fad-b6e6-dc43dd79dacd/913ef2dc-241f-5fad-b6e6-dc43dd79dacd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 259784,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913ef2dc-241f-5fad-b6e6-dc43dd79dacd/913ef2dc-241f-5fad-b6e6-dc43dd79dacd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288110,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913ef2dc-241f-5fad-b6e6-dc43dd79dacd/913ef2dc-241f-5fad-b6e6-dc43dd79dacd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286513,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d9e25b8909f24007ba9c5d727ebb35b6/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE Megane Estate 1.6 E-Tech Plug-in 160ch Business',
'transmission': 'automatic',
'trim': 'Megane Estate 1.6 E-Tech Plug-in 160ch Business',
'vin': None,
'year': 2021}
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988362%27 HTTP/1.1" 200 None
2026-03-27 16:49:22 [ayvens.fr] INFO: Saving data for 1988362: {'created_time': 1774630162.55627, 'last_price_update_time': 1774630162.556284, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988362') HTTP/1.1" 204 0
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fd89be1a94c174d81819fc0156616f57a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/8.jpg not downloaded yet
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3b010>
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b671213b-0141-5329-8835-4d859e91d6b0/b671213b-0141-5329-8835-4d859e91d6b0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F2250e5549e8f43c5920c81ff852c11c6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/7.jpg saved to cache
2026-03-27 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b671213b-0141-5329-8835-4d859e91d6b0
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904d7e90>
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b671213b-0141-5329-8835-4d859e91d6b0/b671213b-0141-5329-8835-4d859e91d6b0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F2250e5549e8f43c5920c81ff852c11c6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/1.jpg saved to cache
2026-03-27 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b671213b-0141-5329-8835-4d859e91d6b0
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068d690>
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b671213b-0141-5329-8835-4d859e91d6b0/b671213b-0141-5329-8835-4d859e91d6b0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F2250e5549e8f43c5920c81ff852c11c6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/2.jpg saved to cache
2026-03-27 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b671213b-0141-5329-8835-4d859e91d6b0
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903cf550>
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b671213b-0141-5329-8835-4d859e91d6b0/b671213b-0141-5329-8835-4d859e91d6b0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F2250e5549e8f43c5920c81ff852c11c6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/5.jpg saved to cache
2026-03-27 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b671213b-0141-5329-8835-4d859e91d6b0
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7c390>
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b671213b-0141-5329-8835-4d859e91d6b0/b671213b-0141-5329-8835-4d859e91d6b0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F2250e5549e8f43c5920c81ff852c11c6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/6.jpg saved to cache
2026-03-27 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b671213b-0141-5329-8835-4d859e91d6b0
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2d390>
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b671213b-0141-5329-8835-4d859e91d6b0/b671213b-0141-5329-8835-4d859e91d6b0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F2250e5549e8f43c5920c81ff852c11c6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/3.jpg saved to cache
2026-03-27 16:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b671213b-0141-5329-8835-4d859e91d6b0
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae16d0>
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b671213b-0141-5329-8835-4d859e91d6b0/b671213b-0141-5329-8835-4d859e91d6b0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F2250e5549e8f43c5920c81ff852c11c6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/4.jpg saved to cache
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b671213b-0141-5329-8835-4d859e91d6b0
2026-03-27 16:49:23 [ayvens.fr] INFO: Found listing with ID: 1988365
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988365%27 HTTP/1.1" 200 None
2026-03-27 16:49:23 [ayvens.fr] INFO: Scrape type for 1988365: 1
2026-03-27 16:49:23 [ayvens.fr] INFO: Extracting data for car ID: 1988365
2026-03-27 16:49:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 576a2ead-a68e-5d27-b22a-620de5c8d532 with identifier: 1988365
2026-03-27 16:49:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 576a2ead-a68e-5d27-b22a-620de5c8d532 with scrape type 1
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 576a2ead-a68e-5d27-b22a-620de5c8d532
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd11e8bfe43f440b2aec4bd0a2f6e589d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/1.jpg not downloaded yet
2026-03-27 16:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd11e8bfe43f440b2aec4bd0a2f6e589d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/2.jpg not downloaded yet
2026-03-27 16:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd11e8bfe43f440b2aec4bd0a2f6e589d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/3.jpg not downloaded yet
2026-03-27 16:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd11e8bfe43f440b2aec4bd0a2f6e589d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/4.jpg not downloaded yet
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd11e8bfe43f440b2aec4bd0a2f6e589d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/5.jpg not downloaded yet
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd11e8bfe43f440b2aec4bd0a2f6e589d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/6.jpg not downloaded yet
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd11e8bfe43f440b2aec4bd0a2f6e589d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/7.jpg not downloaded yet
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd11e8bfe43f440b2aec4bd0a2f6e589d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/8.jpg not downloaded yet
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b68e10>
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84dde02e-528a-5498-8b13-8d5400a7a272/84dde02e-528a-5498-8b13-8d5400a7a272_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fd89be1a94c174d81819fc0156616f57a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/4.jpg saved to cache
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84dde02e-528a-5498-8b13-8d5400a7a272
2026-03-27 16:49:23 [ayvens.fr] INFO: Found listing with ID: 1988366
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988366%27 HTTP/1.1" 200 None
2026-03-27 16:49:23 [ayvens.fr] INFO: Scrape type for 1988366: 1
2026-03-27 16:49:23 [ayvens.fr] INFO: Extracting data for car ID: 1988366
2026-03-27 16:49:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73cafb49-61b3-553e-bb0d-01b914f1e4b2 with identifier: 1988366
2026-03-27 16:49:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73cafb49-61b3-553e-bb0d-01b914f1e4b2 with scrape type 1
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 73cafb49-61b3-553e-bb0d-01b914f1e4b2
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F969f1cedcad24a0983ab839966cb6070%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/1.jpg not downloaded yet
2026-03-27 16:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F969f1cedcad24a0983ab839966cb6070%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/2.jpg not downloaded yet
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59062d9d0>
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84dde02e-528a-5498-8b13-8d5400a7a272/84dde02e-528a-5498-8b13-8d5400a7a272_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fd89be1a94c174d81819fc0156616f57a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/3.jpg saved to cache
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84dde02e-528a-5498-8b13-8d5400a7a272
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e4d10>
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84dde02e-528a-5498-8b13-8d5400a7a272/84dde02e-528a-5498-8b13-8d5400a7a272_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fd89be1a94c174d81819fc0156616f57a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/1.jpg saved to cache
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84dde02e-528a-5498-8b13-8d5400a7a272
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f81290>
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84dde02e-528a-5498-8b13-8d5400a7a272/84dde02e-528a-5498-8b13-8d5400a7a272_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fd89be1a94c174d81819fc0156616f57a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/2.jpg saved to cache
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84dde02e-528a-5498-8b13-8d5400a7a272
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e4c50>
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b671213b-0141-5329-8835-4d859e91d6b0/b671213b-0141-5329-8835-4d859e91d6b0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F2250e5549e8f43c5920c81ff852c11c6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/8.jpg saved to cache
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b671213b-0141-5329-8835-4d859e91d6b0
2026-03-27 16:49:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b671213b-0141-5329-8835-4d859e91d6b0, skipping ID generation
2026-03-27 16:49:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b671213b-0141-5329-8835-4d859e91d6b0 with scrape type 1
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b671213b-0141-5329-8835-4d859e91d6b0 sending to next pipeline
2026-03-27 16:49:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b671213b-0141-5329-8835-4d859e91d6b0, identifier: 1988363
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae9550>
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84dde02e-528a-5498-8b13-8d5400a7a272/84dde02e-528a-5498-8b13-8d5400a7a272_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fd89be1a94c174d81819fc0156616f57a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/5.jpg saved to cache
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84dde02e-528a-5498-8b13-8d5400a7a272
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b74490>
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84dde02e-528a-5498-8b13-8d5400a7a272/84dde02e-528a-5498-8b13-8d5400a7a272_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fd89be1a94c174d81819fc0156616f57a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/6.jpg saved to cache
2026-03-27 16:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84dde02e-528a-5498-8b13-8d5400a7a272
2026-03-27 16:49:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b671213b-0141-5329-8835-4d859e91d6b0 with identifier: 1988363
2026-03-27 16:49:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:49:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b671213b-0141-5329-8835-4d859e91d6b0 with identifier: 1988363
2026-03-27 16:49:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b671213b-0141-5329-8835-4d859e91d6b0 with identifier: 1988363 to the API
2026-03-27 16:49:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': 'GRIS FONC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'b671213b-0141-5329-8835-4d859e91d6b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'SEAT',
'model': 'LEON',
'odometer': 78559,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b671213b-0141-5329-8835-4d859e91d6b0/b671213b-0141-5329-8835-4d859e91d6b0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450612,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b671213b-0141-5329-8835-4d859e91d6b0/b671213b-0141-5329-8835-4d859e91d6b0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450612,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b671213b-0141-5329-8835-4d859e91d6b0/b671213b-0141-5329-8835-4d859e91d6b0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476577,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b671213b-0141-5329-8835-4d859e91d6b0/b671213b-0141-5329-8835-4d859e91d6b0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414146,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b671213b-0141-5329-8835-4d859e91d6b0/b671213b-0141-5329-8835-4d859e91d6b0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364190,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b671213b-0141-5329-8835-4d859e91d6b0/b671213b-0141-5329-8835-4d859e91d6b0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329480,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b671213b-0141-5329-8835-4d859e91d6b0/b671213b-0141-5329-8835-4d859e91d6b0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274536,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b671213b-0141-5329-8835-4d859e91d6b0/b671213b-0141-5329-8835-4d859e91d6b0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 642262,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/2250e5549e8f43c5920c81ff852c11c6/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-21',
'seats_number': 5,
'seller_name': None,
'title': 'SEAT LEON Leon 2.0 TDI 150ch Style Business DSG7',
'transmission': 'automatic',
'trim': 'Leon 2.0 TDI 150ch Style Business DSG7',
'vin': None,
'year': 2023}
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988363%27 HTTP/1.1" 200 None
2026-03-27 16:49:24 [ayvens.fr] INFO: Saving data for 1988363: {'created_time': 1774630164.252053, 'last_price_update_time': 1774630164.252065, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988363') HTTP/1.1" 204 0
2026-03-27 16:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F969f1cedcad24a0983ab839966cb6070%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/3.jpg not downloaded yet
2026-03-27 16:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F969f1cedcad24a0983ab839966cb6070%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/4.jpg not downloaded yet
2026-03-27 16:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911cac90>
2026-03-27 16:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84dde02e-528a-5498-8b13-8d5400a7a272/84dde02e-528a-5498-8b13-8d5400a7a272_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fd89be1a94c174d81819fc0156616f57a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/8.jpg saved to cache
2026-03-27 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84dde02e-528a-5498-8b13-8d5400a7a272
2026-03-27 16:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F969f1cedcad24a0983ab839966cb6070%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/5.jpg not downloaded yet
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F969f1cedcad24a0983ab839966cb6070%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/6.jpg not downloaded yet
2026-03-27 16:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4fd50>
2026-03-27 16:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84dde02e-528a-5498-8b13-8d5400a7a272/84dde02e-528a-5498-8b13-8d5400a7a272_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Fd89be1a94c174d81819fc0156616f57a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/7.jpg saved to cache
2026-03-27 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84dde02e-528a-5498-8b13-8d5400a7a272
2026-03-27 16:49:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84dde02e-528a-5498-8b13-8d5400a7a272, skipping ID generation
2026-03-27 16:49:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84dde02e-528a-5498-8b13-8d5400a7a272 with scrape type 1
2026-03-27 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84dde02e-528a-5498-8b13-8d5400a7a272 sending to next pipeline
2026-03-27 16:49:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 84dde02e-528a-5498-8b13-8d5400a7a272, identifier: 1988364
2026-03-27 16:49:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 84dde02e-528a-5498-8b13-8d5400a7a272 with identifier: 1988364
2026-03-27 16:49:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 84dde02e-528a-5498-8b13-8d5400a7a272 with identifier: 1988364
2026-03-27 16:49:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 84dde02e-528a-5498-8b13-8d5400a7a272 with identifier: 1988364 to the API
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid',
'id': '84dde02e-528a-5498-8b13-8d5400a7a272',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'PUMA',
'odometer': 129281,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84dde02e-528a-5498-8b13-8d5400a7a272/84dde02e-528a-5498-8b13-8d5400a7a272_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400355,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84dde02e-528a-5498-8b13-8d5400a7a272/84dde02e-528a-5498-8b13-8d5400a7a272_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400355,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84dde02e-528a-5498-8b13-8d5400a7a272/84dde02e-528a-5498-8b13-8d5400a7a272_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412441,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84dde02e-528a-5498-8b13-8d5400a7a272/84dde02e-528a-5498-8b13-8d5400a7a272_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361025,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84dde02e-528a-5498-8b13-8d5400a7a272/84dde02e-528a-5498-8b13-8d5400a7a272_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341220,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84dde02e-528a-5498-8b13-8d5400a7a272/84dde02e-528a-5498-8b13-8d5400a7a272_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333792,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84dde02e-528a-5498-8b13-8d5400a7a272/84dde02e-528a-5498-8b13-8d5400a7a272_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240935,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84dde02e-528a-5498-8b13-8d5400a7a272/84dde02e-528a-5498-8b13-8d5400a7a272_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268793,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/d89be1a94c174d81819fc0156616f57a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-11',
'seats_number': 5,
'seller_name': None,
'title': 'FORD PUMA Puma 1.0 Flexifuel 125ch S&S mHEV Titanium Design 3',
'transmission': 'manual',
'trim': 'Puma 1.0 Flexifuel 125ch S&S mHEV Titanium Design 3',
'vin': None,
'year': 2022}
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988364%27 HTTP/1.1" 200 None
2026-03-27 16:49:24 [ayvens.fr] INFO: Saving data for 1988364: {'created_time': 1774630164.859711, 'last_price_update_time': 1774630164.859725, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988364') HTTP/1.1" 204 0
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F969f1cedcad24a0983ab839966cb6070%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/7.jpg not downloaded yet
2026-03-27 16:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911edb50>
2026-03-27 16:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_576a2ead-a68e-5d27-b22a-620de5c8d532/576a2ead-a68e-5d27-b22a-620de5c8d532_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd11e8bfe43f440b2aec4bd0a2f6e589d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/3.jpg saved to cache
2026-03-27 16:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 576a2ead-a68e-5d27-b22a-620de5c8d532
2026-03-27 16:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4a310>
2026-03-27 16:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_576a2ead-a68e-5d27-b22a-620de5c8d532/576a2ead-a68e-5d27-b22a-620de5c8d532_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd11e8bfe43f440b2aec4bd0a2f6e589d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/1.jpg saved to cache
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 576a2ead-a68e-5d27-b22a-620de5c8d532
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4d850>
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_576a2ead-a68e-5d27-b22a-620de5c8d532/576a2ead-a68e-5d27-b22a-620de5c8d532_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd11e8bfe43f440b2aec4bd0a2f6e589d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/6.jpg saved to cache
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 576a2ead-a68e-5d27-b22a-620de5c8d532
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e8d910>
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_576a2ead-a68e-5d27-b22a-620de5c8d532/576a2ead-a68e-5d27-b22a-620de5c8d532_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd11e8bfe43f440b2aec4bd0a2f6e589d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/2.jpg saved to cache
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 576a2ead-a68e-5d27-b22a-620de5c8d532
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4f210>
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_576a2ead-a68e-5d27-b22a-620de5c8d532/576a2ead-a68e-5d27-b22a-620de5c8d532_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd11e8bfe43f440b2aec4bd0a2f6e589d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/4.jpg saved to cache
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 576a2ead-a68e-5d27-b22a-620de5c8d532
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4c250>
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_576a2ead-a68e-5d27-b22a-620de5c8d532/576a2ead-a68e-5d27-b22a-620de5c8d532_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd11e8bfe43f440b2aec4bd0a2f6e589d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/5.jpg saved to cache
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 576a2ead-a68e-5d27-b22a-620de5c8d532
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591432850>
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_576a2ead-a68e-5d27-b22a-620de5c8d532/576a2ead-a68e-5d27-b22a-620de5c8d532_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd11e8bfe43f440b2aec4bd0a2f6e589d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/7.jpg saved to cache
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 576a2ead-a68e-5d27-b22a-620de5c8d532
2026-03-27 16:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F969f1cedcad24a0983ab839966cb6070%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/8.jpg not downloaded yet
2026-03-27 16:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:25 [ayvens.fr] INFO: Found listing with ID: 1988367
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988367%27 HTTP/1.1" 200 None
2026-03-27 16:49:25 [ayvens.fr] INFO: Scrape type for 1988367: 1
2026-03-27 16:49:25 [ayvens.fr] INFO: Extracting data for car ID: 1988367
2026-03-27 16:49:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4775fb03-d43f-5938-8585-2ff57cdb1d79 with identifier: 1988367
2026-03-27 16:49:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4775fb03-d43f-5938-8585-2ff57cdb1d79 with scrape type 1
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4775fb03-d43f-5938-8585-2ff57cdb1d79
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff7f51dc4aa464a8c80a35a485ee0a899%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/1.jpg not downloaded yet
2026-03-27 16:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff7f51dc4aa464a8c80a35a485ee0a899%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/2.jpg not downloaded yet
2026-03-27 16:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff7f51dc4aa464a8c80a35a485ee0a899%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/3.jpg not downloaded yet
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff7f51dc4aa464a8c80a35a485ee0a899%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/4.jpg not downloaded yet
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff7f51dc4aa464a8c80a35a485ee0a899%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/5.jpg not downloaded yet
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590affa50>
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_576a2ead-a68e-5d27-b22a-620de5c8d532/576a2ead-a68e-5d27-b22a-620de5c8d532_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd11e8bfe43f440b2aec4bd0a2f6e589d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/8.jpg saved to cache
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 576a2ead-a68e-5d27-b22a-620de5c8d532
2026-03-27 16:49:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 576a2ead-a68e-5d27-b22a-620de5c8d532, skipping ID generation
2026-03-27 16:49:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 576a2ead-a68e-5d27-b22a-620de5c8d532 with scrape type 1
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 576a2ead-a68e-5d27-b22a-620de5c8d532 sending to next pipeline
2026-03-27 16:49:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 576a2ead-a68e-5d27-b22a-620de5c8d532, identifier: 1988365
2026-03-27 16:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff7f51dc4aa464a8c80a35a485ee0a899%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/6.jpg not downloaded yet
2026-03-27 16:49:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 576a2ead-a68e-5d27-b22a-620de5c8d532 with identifier: 1988365
2026-03-27 16:49:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:49:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 576a2ead-a68e-5d27-b22a-620de5c8d532 with identifier: 1988365
2026-03-27 16:49:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 576a2ead-a68e-5d27-b22a-620de5c8d532 with identifier: 1988365 to the API
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 54,
'color': 'SABLE LUMINEUX',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '576a2ead-a68e-5d27-b22a-620de5c8d532',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC60',
'odometer': 70781,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_576a2ead-a68e-5d27-b22a-620de5c8d532/576a2ead-a68e-5d27-b22a-620de5c8d532_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339151,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_576a2ead-a68e-5d27-b22a-620de5c8d532/576a2ead-a68e-5d27-b22a-620de5c8d532_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339151,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_576a2ead-a68e-5d27-b22a-620de5c8d532/576a2ead-a68e-5d27-b22a-620de5c8d532_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341839,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_576a2ead-a68e-5d27-b22a-620de5c8d532/576a2ead-a68e-5d27-b22a-620de5c8d532_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354676,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_576a2ead-a68e-5d27-b22a-620de5c8d532/576a2ead-a68e-5d27-b22a-620de5c8d532_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359272,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_576a2ead-a68e-5d27-b22a-620de5c8d532/576a2ead-a68e-5d27-b22a-620de5c8d532_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299477,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_576a2ead-a68e-5d27-b22a-620de5c8d532/576a2ead-a68e-5d27-b22a-620de5c8d532_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223750,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_576a2ead-a68e-5d27-b22a-620de5c8d532/576a2ead-a68e-5d27-b22a-620de5c8d532_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191426,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d11e8bfe43f440b2aec4bd0a2f6e589d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-09',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC60 XC60 T6 AWD 253 + 87ch Inscription Business Geartronic',
'transmission': 'automatic',
'trim': 'XC60 T6 AWD 253 + 87ch Inscription Business Geartronic',
'vin': None,
'year': 2021}
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988365%27 HTTP/1.1" 200 None
2026-03-27 16:49:26 [ayvens.fr] INFO: Saving data for 1988365: {'created_time': 1774630166.086871, 'last_price_update_time': 1774630166.086883, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988365') HTTP/1.1" 204 0
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591002810>
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73cafb49-61b3-553e-bb0d-01b914f1e4b2/73cafb49-61b3-553e-bb0d-01b914f1e4b2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F969f1cedcad24a0983ab839966cb6070%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/1.jpg saved to cache
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73cafb49-61b3-553e-bb0d-01b914f1e4b2
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e08890>
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73cafb49-61b3-553e-bb0d-01b914f1e4b2/73cafb49-61b3-553e-bb0d-01b914f1e4b2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F969f1cedcad24a0983ab839966cb6070%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/2.jpg saved to cache
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73cafb49-61b3-553e-bb0d-01b914f1e4b2
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590675f10>
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73cafb49-61b3-553e-bb0d-01b914f1e4b2/73cafb49-61b3-553e-bb0d-01b914f1e4b2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F969f1cedcad24a0983ab839966cb6070%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/4.jpg saved to cache
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73cafb49-61b3-553e-bb0d-01b914f1e4b2
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff7f51dc4aa464a8c80a35a485ee0a899%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/7.jpg not downloaded yet
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3e190>
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73cafb49-61b3-553e-bb0d-01b914f1e4b2/73cafb49-61b3-553e-bb0d-01b914f1e4b2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F969f1cedcad24a0983ab839966cb6070%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/3.jpg saved to cache
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73cafb49-61b3-553e-bb0d-01b914f1e4b2
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59064cf90>
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73cafb49-61b3-553e-bb0d-01b914f1e4b2/73cafb49-61b3-553e-bb0d-01b914f1e4b2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F969f1cedcad24a0983ab839966cb6070%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/5.jpg saved to cache
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73cafb49-61b3-553e-bb0d-01b914f1e4b2
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903cced0>
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73cafb49-61b3-553e-bb0d-01b914f1e4b2/73cafb49-61b3-553e-bb0d-01b914f1e4b2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F969f1cedcad24a0983ab839966cb6070%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/7.jpg saved to cache
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73cafb49-61b3-553e-bb0d-01b914f1e4b2
2026-03-27 16:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff7f51dc4aa464a8c80a35a485ee0a899%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/8.jpg not downloaded yet
2026-03-27 16:49:26 [ayvens.fr] INFO: Found listing with ID: 1988368
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988368%27 HTTP/1.1" 200 None
2026-03-27 16:49:26 [ayvens.fr] INFO: Scrape type for 1988368: 1
2026-03-27 16:49:26 [ayvens.fr] INFO: Extracting data for car ID: 1988368
2026-03-27 16:49:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c227381-bf76-5ae1-a1df-aa9f09540105 with identifier: 1988368
2026-03-27 16:49:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c227381-bf76-5ae1-a1df-aa9f09540105 with scrape type 1
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 9c227381-bf76-5ae1-a1df-aa9f09540105
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Feaf38d5dca2a4f5d91bc796656981c28%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/1.jpg not downloaded yet
2026-03-27 16:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Feaf38d5dca2a4f5d91bc796656981c28%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/2.jpg not downloaded yet
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Feaf38d5dca2a4f5d91bc796656981c28%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/3.jpg not downloaded yet
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Feaf38d5dca2a4f5d91bc796656981c28%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/4.jpg not downloaded yet
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Feaf38d5dca2a4f5d91bc796656981c28%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/5.jpg not downloaded yet
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b42f50>
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73cafb49-61b3-553e-bb0d-01b914f1e4b2/73cafb49-61b3-553e-bb0d-01b914f1e4b2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F969f1cedcad24a0983ab839966cb6070%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/6.jpg saved to cache
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73cafb49-61b3-553e-bb0d-01b914f1e4b2
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3db10>
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73cafb49-61b3-553e-bb0d-01b914f1e4b2/73cafb49-61b3-553e-bb0d-01b914f1e4b2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F969f1cedcad24a0983ab839966cb6070%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/8.jpg saved to cache
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73cafb49-61b3-553e-bb0d-01b914f1e4b2
2026-03-27 16:49:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73cafb49-61b3-553e-bb0d-01b914f1e4b2, skipping ID generation
2026-03-27 16:49:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73cafb49-61b3-553e-bb0d-01b914f1e4b2 with scrape type 1
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73cafb49-61b3-553e-bb0d-01b914f1e4b2 sending to next pipeline
2026-03-27 16:49:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 73cafb49-61b3-553e-bb0d-01b914f1e4b2, identifier: 1988366
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Feaf38d5dca2a4f5d91bc796656981c28%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/6.jpg not downloaded yet
2026-03-27 16:49:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 73cafb49-61b3-553e-bb0d-01b914f1e4b2 with identifier: 1988366
2026-03-27 16:49:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:49:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 73cafb49-61b3-553e-bb0d-01b914f1e4b2 with identifier: 1988366
2026-03-27 16:49:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 73cafb49-61b3-553e-bb0d-01b914f1e4b2 with identifier: 1988366 to the API
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'GLACIERSILBER M',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '73cafb49-61b3-553e-bb0d-01b914f1e4b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'X1',
'odometer': 102667,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73cafb49-61b3-553e-bb0d-01b914f1e4b2/73cafb49-61b3-553e-bb0d-01b914f1e4b2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323749,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73cafb49-61b3-553e-bb0d-01b914f1e4b2/73cafb49-61b3-553e-bb0d-01b914f1e4b2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323749,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73cafb49-61b3-553e-bb0d-01b914f1e4b2/73cafb49-61b3-553e-bb0d-01b914f1e4b2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331428,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73cafb49-61b3-553e-bb0d-01b914f1e4b2/73cafb49-61b3-553e-bb0d-01b914f1e4b2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315483,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73cafb49-61b3-553e-bb0d-01b914f1e4b2/73cafb49-61b3-553e-bb0d-01b914f1e4b2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311041,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73cafb49-61b3-553e-bb0d-01b914f1e4b2/73cafb49-61b3-553e-bb0d-01b914f1e4b2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304326,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73cafb49-61b3-553e-bb0d-01b914f1e4b2/73cafb49-61b3-553e-bb0d-01b914f1e4b2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285091,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73cafb49-61b3-553e-bb0d-01b914f1e4b2/73cafb49-61b3-553e-bb0d-01b914f1e4b2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298403,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/969f1cedcad24a0983ab839966cb6070/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-31',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 X1 sDrive18dA 150ch xLine',
'transmission': 'automatic',
'trim': 'X1 sDrive18dA 150ch xLine',
'vin': None,
'year': 2019}
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988366%27 HTTP/1.1" 200 None
2026-03-27 16:49:27 [ayvens.fr] INFO: Saving data for 1988366: {'created_time': 1774630167.388322, 'last_price_update_time': 1774630167.388335, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988366') HTTP/1.1" 204 0
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Feaf38d5dca2a4f5d91bc796656981c28%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/7.jpg not downloaded yet
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Feaf38d5dca2a4f5d91bc796656981c28%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/8.jpg not downloaded yet
2026-03-27 16:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590eda290>
2026-03-27 16:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4775fb03-d43f-5938-8585-2ff57cdb1d79/4775fb03-d43f-5938-8585-2ff57cdb1d79_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff7f51dc4aa464a8c80a35a485ee0a899%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/1.jpg saved to cache
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4775fb03-d43f-5938-8585-2ff57cdb1d79
2026-03-27 16:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe2550>
2026-03-27 16:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4775fb03-d43f-5938-8585-2ff57cdb1d79/4775fb03-d43f-5938-8585-2ff57cdb1d79_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff7f51dc4aa464a8c80a35a485ee0a899%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/2.jpg saved to cache
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4775fb03-d43f-5938-8585-2ff57cdb1d79
2026-03-27 16:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910d8b50>
2026-03-27 16:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4775fb03-d43f-5938-8585-2ff57cdb1d79/4775fb03-d43f-5938-8585-2ff57cdb1d79_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff7f51dc4aa464a8c80a35a485ee0a899%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/3.jpg saved to cache
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4775fb03-d43f-5938-8585-2ff57cdb1d79
2026-03-27 16:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910d0fd0>
2026-03-27 16:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4775fb03-d43f-5938-8585-2ff57cdb1d79/4775fb03-d43f-5938-8585-2ff57cdb1d79_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff7f51dc4aa464a8c80a35a485ee0a899%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/4.jpg saved to cache
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4775fb03-d43f-5938-8585-2ff57cdb1d79
2026-03-27 16:49:27 [ayvens.fr] INFO: Found listing with ID: 1988369
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988369%27 HTTP/1.1" 200 None
2026-03-27 16:49:27 [ayvens.fr] INFO: Scrape type for 1988369: 1
2026-03-27 16:49:27 [ayvens.fr] INFO: Extracting data for car ID: 1988369
2026-03-27 16:49:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c54807-5edc-594d-8533-fdcf9fca2b1a with identifier: 1988369
2026-03-27 16:49:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c54807-5edc-594d-8533-fdcf9fca2b1a with scrape type 1
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b2c54807-5edc-594d-8533-fdcf9fca2b1a
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F39e502a742fe4b3e994b6a3c21f43842%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/1.jpg not downloaded yet
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F39e502a742fe4b3e994b6a3c21f43842%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/2.jpg not downloaded yet
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F39e502a742fe4b3e994b6a3c21f43842%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/3.jpg not downloaded yet
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F39e502a742fe4b3e994b6a3c21f43842%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/4.jpg not downloaded yet
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F39e502a742fe4b3e994b6a3c21f43842%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/5.jpg not downloaded yet
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F39e502a742fe4b3e994b6a3c21f43842%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/6.jpg not downloaded yet
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F39e502a742fe4b3e994b6a3c21f43842%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/7.jpg not downloaded yet
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F39e502a742fe4b3e994b6a3c21f43842%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/8.jpg not downloaded yet
2026-03-27 16:49:27 [ayvens.fr] INFO: Found listing with ID: 1988370
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988370%27 HTTP/1.1" 200 None
2026-03-27 16:49:27 [ayvens.fr] INFO: Scrape type for 1988370: 1
2026-03-27 16:49:27 [ayvens.fr] INFO: Extracting data for car ID: 1988370
2026-03-27 16:49:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f with identifier: 1988370
2026-03-27 16:49:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f with scrape type 1
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F19a2ec158c1340b1b292450fb356ceb1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/1.jpg not downloaded yet
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F19a2ec158c1340b1b292450fb356ceb1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/2.jpg not downloaded yet
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F19a2ec158c1340b1b292450fb356ceb1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/3.jpg not downloaded yet
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F19a2ec158c1340b1b292450fb356ceb1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/4.jpg not downloaded yet
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F19a2ec158c1340b1b292450fb356ceb1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/5.jpg not downloaded yet
2026-03-27 16:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F19a2ec158c1340b1b292450fb356ceb1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/6.jpg not downloaded yet
2026-03-27 16:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F19a2ec158c1340b1b292450fb356ceb1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/7.jpg not downloaded yet
2026-03-27 16:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F19a2ec158c1340b1b292450fb356ceb1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/8.jpg not downloaded yet
2026-03-27 16:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:28 [ayvens.fr] INFO: Found listing with ID: 1988371
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988371%27 HTTP/1.1" 200 None
2026-03-27 16:49:28 [ayvens.fr] INFO: Scrape type for 1988371: 1
2026-03-27 16:49:28 [ayvens.fr] INFO: Extracting data for car ID: 1988371
2026-03-27 16:49:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b422baff-c576-5f54-9a8a-81ad7e0383ee with identifier: 1988371
2026-03-27 16:49:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b422baff-c576-5f54-9a8a-81ad7e0383ee with scrape type 1
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b422baff-c576-5f54-9a8a-81ad7e0383ee
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc9cd24fb9b95406ea1a0a3910bcea78f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/1.jpg not downloaded yet
2026-03-27 16:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc9cd24fb9b95406ea1a0a3910bcea78f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/2.jpg not downloaded yet
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dac690>
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4775fb03-d43f-5938-8585-2ff57cdb1d79/4775fb03-d43f-5938-8585-2ff57cdb1d79_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff7f51dc4aa464a8c80a35a485ee0a899%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/5.jpg saved to cache
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4775fb03-d43f-5938-8585-2ff57cdb1d79
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590af21d0>
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c227381-bf76-5ae1-a1df-aa9f09540105/9c227381-bf76-5ae1-a1df-aa9f09540105_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Feaf38d5dca2a4f5d91bc796656981c28%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/2.jpg saved to cache
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c227381-bf76-5ae1-a1df-aa9f09540105
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc9cd24fb9b95406ea1a0a3910bcea78f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/3.jpg not downloaded yet
2026-03-27 16:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc9cd24fb9b95406ea1a0a3910bcea78f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/4.jpg not downloaded yet
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906754d0>
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4775fb03-d43f-5938-8585-2ff57cdb1d79/4775fb03-d43f-5938-8585-2ff57cdb1d79_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff7f51dc4aa464a8c80a35a485ee0a899%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/6.jpg saved to cache
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4775fb03-d43f-5938-8585-2ff57cdb1d79
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f80290>
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4775fb03-d43f-5938-8585-2ff57cdb1d79/4775fb03-d43f-5938-8585-2ff57cdb1d79_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff7f51dc4aa464a8c80a35a485ee0a899%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/8.jpg saved to cache
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4775fb03-d43f-5938-8585-2ff57cdb1d79
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfc910>
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c227381-bf76-5ae1-a1df-aa9f09540105/9c227381-bf76-5ae1-a1df-aa9f09540105_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Feaf38d5dca2a4f5d91bc796656981c28%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/3.jpg saved to cache
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c227381-bf76-5ae1-a1df-aa9f09540105
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df4810>
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c227381-bf76-5ae1-a1df-aa9f09540105/9c227381-bf76-5ae1-a1df-aa9f09540105_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Feaf38d5dca2a4f5d91bc796656981c28%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/1.jpg saved to cache
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c227381-bf76-5ae1-a1df-aa9f09540105
2026-03-27 16:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc9cd24fb9b95406ea1a0a3910bcea78f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/5.jpg not downloaded yet
2026-03-27 16:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc9cd24fb9b95406ea1a0a3910bcea78f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/6.jpg not downloaded yet
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59103f7d0>
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c227381-bf76-5ae1-a1df-aa9f09540105/9c227381-bf76-5ae1-a1df-aa9f09540105_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Feaf38d5dca2a4f5d91bc796656981c28%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/6.jpg saved to cache
2026-03-27 16:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c227381-bf76-5ae1-a1df-aa9f09540105
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590674590>
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c227381-bf76-5ae1-a1df-aa9f09540105/9c227381-bf76-5ae1-a1df-aa9f09540105_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Feaf38d5dca2a4f5d91bc796656981c28%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/5.jpg saved to cache
2026-03-27 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c227381-bf76-5ae1-a1df-aa9f09540105
2026-03-27 16:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fca710>
2026-03-27 16:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c227381-bf76-5ae1-a1df-aa9f09540105/9c227381-bf76-5ae1-a1df-aa9f09540105_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Feaf38d5dca2a4f5d91bc796656981c28%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/7.jpg saved to cache
2026-03-27 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c227381-bf76-5ae1-a1df-aa9f09540105
2026-03-27 16:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc9cd24fb9b95406ea1a0a3910bcea78f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/7.jpg not downloaded yet
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc9cd24fb9b95406ea1a0a3910bcea78f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/8.jpg not downloaded yet
2026-03-27 16:49:29 [ayvens.fr] INFO: Found listing with ID: 1988372
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988372%27 HTTP/1.1" 200 None
2026-03-27 16:49:29 [ayvens.fr] INFO: Scrape type for 1988372: 1
2026-03-27 16:49:29 [ayvens.fr] INFO: Extracting data for car ID: 1988372
2026-03-27 16:49:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 901702fd-df23-53e6-b514-4365fadbcc72 with identifier: 1988372
2026-03-27 16:49:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 901702fd-df23-53e6-b514-4365fadbcc72 with scrape type 1
2026-03-27 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 901702fd-df23-53e6-b514-4365fadbcc72
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa55a871269dd49dfaa25e2e92bf998d1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/1.jpg not downloaded yet
2026-03-27 16:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906170d0>
2026-03-27 16:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c227381-bf76-5ae1-a1df-aa9f09540105/9c227381-bf76-5ae1-a1df-aa9f09540105_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Feaf38d5dca2a4f5d91bc796656981c28%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/4.jpg saved to cache
2026-03-27 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c227381-bf76-5ae1-a1df-aa9f09540105
2026-03-27 16:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2dc10>
2026-03-27 16:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4775fb03-d43f-5938-8585-2ff57cdb1d79/4775fb03-d43f-5938-8585-2ff57cdb1d79_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff7f51dc4aa464a8c80a35a485ee0a899%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/7.jpg saved to cache
2026-03-27 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4775fb03-d43f-5938-8585-2ff57cdb1d79
2026-03-27 16:49:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4775fb03-d43f-5938-8585-2ff57cdb1d79, skipping ID generation
2026-03-27 16:49:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4775fb03-d43f-5938-8585-2ff57cdb1d79 with scrape type 1
2026-03-27 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4775fb03-d43f-5938-8585-2ff57cdb1d79 sending to next pipeline
2026-03-27 16:49:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4775fb03-d43f-5938-8585-2ff57cdb1d79, identifier: 1988367
2026-03-27 16:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd2e50>
2026-03-27 16:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c227381-bf76-5ae1-a1df-aa9f09540105/9c227381-bf76-5ae1-a1df-aa9f09540105_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Feaf38d5dca2a4f5d91bc796656981c28%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/8.jpg saved to cache
2026-03-27 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c227381-bf76-5ae1-a1df-aa9f09540105
2026-03-27 16:49:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c227381-bf76-5ae1-a1df-aa9f09540105, skipping ID generation
2026-03-27 16:49:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c227381-bf76-5ae1-a1df-aa9f09540105 with scrape type 1
2026-03-27 16:49:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c227381-bf76-5ae1-a1df-aa9f09540105 sending to next pipeline
2026-03-27 16:49:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9c227381-bf76-5ae1-a1df-aa9f09540105, identifier: 1988368
2026-03-27 16:49:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4775fb03-d43f-5938-8585-2ff57cdb1d79 with identifier: 1988367
2026-03-27 16:49:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:49:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4775fb03-d43f-5938-8585-2ff57cdb1d79 with identifier: 1988367
2026-03-27 16:49:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4775fb03-d43f-5938-8585-2ff57cdb1d79 with identifier: 1988367 to the API
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 148,
'color': 'MINERALGRAU M',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '4775fb03-d43f-5938-8585-2ff57cdb1d79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'X1',
'odometer': 97565,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4775fb03-d43f-5938-8585-2ff57cdb1d79/4775fb03-d43f-5938-8585-2ff57cdb1d79_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4775fb03-d43f-5938-8585-2ff57cdb1d79/4775fb03-d43f-5938-8585-2ff57cdb1d79_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4775fb03-d43f-5938-8585-2ff57cdb1d79/4775fb03-d43f-5938-8585-2ff57cdb1d79_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385209,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4775fb03-d43f-5938-8585-2ff57cdb1d79/4775fb03-d43f-5938-8585-2ff57cdb1d79_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402252,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4775fb03-d43f-5938-8585-2ff57cdb1d79/4775fb03-d43f-5938-8585-2ff57cdb1d79_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332086,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4775fb03-d43f-5938-8585-2ff57cdb1d79/4775fb03-d43f-5938-8585-2ff57cdb1d79_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337959,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4775fb03-d43f-5938-8585-2ff57cdb1d79/4775fb03-d43f-5938-8585-2ff57cdb1d79_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315155,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4775fb03-d43f-5938-8585-2ff57cdb1d79/4775fb03-d43f-5938-8585-2ff57cdb1d79_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402775,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f7f51dc4aa464a8c80a35a485ee0a899/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-12',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 X1 sDrive18iA 136ch Business Design DKG7',
'transmission': 'automatic',
'trim': 'X1 sDrive18iA 136ch Business Design DKG7',
'vin': None,
'year': 2022}
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988367%27 HTTP/1.1" 200 None
2026-03-27 16:49:30 [ayvens.fr] INFO: Saving data for 1988367: {'created_time': 1774630170.074274, 'last_price_update_time': 1774630170.07429, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988367') HTTP/1.1" 204 0
2026-03-27 16:49:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9c227381-bf76-5ae1-a1df-aa9f09540105 with identifier: 1988368
2026-03-27 16:49:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:49:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9c227381-bf76-5ae1-a1df-aa9f09540105 with identifier: 1988368
2026-03-27 16:49:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9c227381-bf76-5ae1-a1df-aa9f09540105 with identifier: 1988368 to the API
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'color': 'GRIS HIGHLAND',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '9c227381-bf76-5ae1-a1df-aa9f09540105',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 83326,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c227381-bf76-5ae1-a1df-aa9f09540105/9c227381-bf76-5ae1-a1df-aa9f09540105_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296417,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c227381-bf76-5ae1-a1df-aa9f09540105/9c227381-bf76-5ae1-a1df-aa9f09540105_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296417,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c227381-bf76-5ae1-a1df-aa9f09540105/9c227381-bf76-5ae1-a1df-aa9f09540105_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315844,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c227381-bf76-5ae1-a1df-aa9f09540105/9c227381-bf76-5ae1-a1df-aa9f09540105_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302479,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c227381-bf76-5ae1-a1df-aa9f09540105/9c227381-bf76-5ae1-a1df-aa9f09540105_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313440,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c227381-bf76-5ae1-a1df-aa9f09540105/9c227381-bf76-5ae1-a1df-aa9f09540105_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263848,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c227381-bf76-5ae1-a1df-aa9f09540105/9c227381-bf76-5ae1-a1df-aa9f09540105_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318954,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c227381-bf76-5ae1-a1df-aa9f09540105/9c227381-bf76-5ae1-a1df-aa9f09540105_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356919,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/eaf38d5dca2a4f5d91bc796656981c28/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-15',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CAPTUR Captur 1.5 Blue dCi 115ch Business EDC',
'transmission': 'automatic',
'trim': 'Captur 1.5 Blue dCi 115ch Business EDC',
'vin': None,
'year': 2021}
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988368%27 HTTP/1.1" 200 None
2026-03-27 16:49:30 [ayvens.fr] INFO: Saving data for 1988368: {'created_time': 1774630170.433174, 'last_price_update_time': 1774630170.433185, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988368') HTTP/1.1" 204 0
2026-03-27 16:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa55a871269dd49dfaa25e2e92bf998d1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/2.jpg not downloaded yet
2026-03-27 16:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa55a871269dd49dfaa25e2e92bf998d1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/3.jpg not downloaded yet
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b047d0>
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c54807-5edc-594d-8533-fdcf9fca2b1a/b2c54807-5edc-594d-8533-fdcf9fca2b1a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F39e502a742fe4b3e994b6a3c21f43842%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/1.jpg saved to cache
2026-03-27 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2c54807-5edc-594d-8533-fdcf9fca2b1a
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ed8f90>
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c54807-5edc-594d-8533-fdcf9fca2b1a/b2c54807-5edc-594d-8533-fdcf9fca2b1a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F39e502a742fe4b3e994b6a3c21f43842%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/2.jpg saved to cache
2026-03-27 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2c54807-5edc-594d-8533-fdcf9fca2b1a
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa55a871269dd49dfaa25e2e92bf998d1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/4.jpg not downloaded yet
2026-03-27 16:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa55a871269dd49dfaa25e2e92bf998d1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/5.jpg not downloaded yet
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911baa50>
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f/1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F19a2ec158c1340b1b292450fb356ceb1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/3.jpg saved to cache
2026-03-27 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590517e90>
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f/1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F19a2ec158c1340b1b292450fb356ceb1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/4.jpg saved to cache
2026-03-27 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911a7550>
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c54807-5edc-594d-8533-fdcf9fca2b1a/b2c54807-5edc-594d-8533-fdcf9fca2b1a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F39e502a742fe4b3e994b6a3c21f43842%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/3.jpg saved to cache
2026-03-27 16:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2c54807-5edc-594d-8533-fdcf9fca2b1a
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911cf210>
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f/1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F19a2ec158c1340b1b292450fb356ceb1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/5.jpg saved to cache
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911a44d0>
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c54807-5edc-594d-8533-fdcf9fca2b1a/b2c54807-5edc-594d-8533-fdcf9fca2b1a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F39e502a742fe4b3e994b6a3c21f43842%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/4.jpg saved to cache
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2c54807-5edc-594d-8533-fdcf9fca2b1a
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa55a871269dd49dfaa25e2e92bf998d1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/6.jpg not downloaded yet
2026-03-27 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa55a871269dd49dfaa25e2e92bf998d1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/7.jpg not downloaded yet
2026-03-27 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fab690>
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f/1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F19a2ec158c1340b1b292450fb356ceb1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/7.jpg saved to cache
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dba650>
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f/1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F19a2ec158c1340b1b292450fb356ceb1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/6.jpg saved to cache
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa55a871269dd49dfaa25e2e92bf998d1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/8.jpg not downloaded yet
2026-03-27 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:31 [ayvens.fr] INFO: Found listing with ID: 1988373
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988373%27 HTTP/1.1" 200 None
2026-03-27 16:49:31 [ayvens.fr] INFO: Scrape type for 1988373: 1
2026-03-27 16:49:31 [ayvens.fr] INFO: Extracting data for car ID: 1988373
2026-03-27 16:49:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1a64d63-568d-5f40-893c-9603d31a522f with identifier: 1988373
2026-03-27 16:49:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1a64d63-568d-5f40-893c-9603d31a522f with scrape type 1
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e1a64d63-568d-5f40-893c-9603d31a522f
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6fb7248bc0084130a79664f65c9ad913%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/1.jpg not downloaded yet
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6fb7248bc0084130a79664f65c9ad913%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/2.jpg not downloaded yet
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904cbd10>
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f/1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F19a2ec158c1340b1b292450fb356ceb1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/8.jpg saved to cache
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903cf190>
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b422baff-c576-5f54-9a8a-81ad7e0383ee/b422baff-c576-5f54-9a8a-81ad7e0383ee_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc9cd24fb9b95406ea1a0a3910bcea78f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/1.jpg saved to cache
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b422baff-c576-5f54-9a8a-81ad7e0383ee
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6e2d0>
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b422baff-c576-5f54-9a8a-81ad7e0383ee/b422baff-c576-5f54-9a8a-81ad7e0383ee_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc9cd24fb9b95406ea1a0a3910bcea78f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/2.jpg saved to cache
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b422baff-c576-5f54-9a8a-81ad7e0383ee
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590512ad0>
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b422baff-c576-5f54-9a8a-81ad7e0383ee/b422baff-c576-5f54-9a8a-81ad7e0383ee_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc9cd24fb9b95406ea1a0a3910bcea78f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/3.jpg saved to cache
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b422baff-c576-5f54-9a8a-81ad7e0383ee
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6e310>
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b422baff-c576-5f54-9a8a-81ad7e0383ee/b422baff-c576-5f54-9a8a-81ad7e0383ee_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc9cd24fb9b95406ea1a0a3910bcea78f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/4.jpg saved to cache
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b422baff-c576-5f54-9a8a-81ad7e0383ee
2026-03-27 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6fb7248bc0084130a79664f65c9ad913%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/3.jpg not downloaded yet
2026-03-27 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6fb7248bc0084130a79664f65c9ad913%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/4.jpg not downloaded yet
2026-03-27 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee1c90>
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f/1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F19a2ec158c1340b1b292450fb356ceb1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/2.jpg saved to cache
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f
2026-03-27 16:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6fb7248bc0084130a79664f65c9ad913%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/5.jpg not downloaded yet
2026-03-27 16:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6fb7248bc0084130a79664f65c9ad913%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/6.jpg not downloaded yet
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6fb7248bc0084130a79664f65c9ad913%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/7.jpg not downloaded yet
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de5d10>
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b422baff-c576-5f54-9a8a-81ad7e0383ee/b422baff-c576-5f54-9a8a-81ad7e0383ee_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc9cd24fb9b95406ea1a0a3910bcea78f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/5.jpg saved to cache
2026-03-27 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b422baff-c576-5f54-9a8a-81ad7e0383ee
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590668250>
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f/1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F19a2ec158c1340b1b292450fb356ceb1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/1.jpg saved to cache
2026-03-27 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f
2026-03-27 16:49:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f, skipping ID generation
2026-03-27 16:49:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f with scrape type 1
2026-03-27 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f sending to next pipeline
2026-03-27 16:49:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f, identifier: 1988370
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f330d0>
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b422baff-c576-5f54-9a8a-81ad7e0383ee/b422baff-c576-5f54-9a8a-81ad7e0383ee_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc9cd24fb9b95406ea1a0a3910bcea78f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/6.jpg saved to cache
2026-03-27 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b422baff-c576-5f54-9a8a-81ad7e0383ee
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590afc790>
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b422baff-c576-5f54-9a8a-81ad7e0383ee/b422baff-c576-5f54-9a8a-81ad7e0383ee_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc9cd24fb9b95406ea1a0a3910bcea78f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/8.jpg saved to cache
2026-03-27 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b422baff-c576-5f54-9a8a-81ad7e0383ee
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59057e1d0>
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_901702fd-df23-53e6-b514-4365fadbcc72/901702fd-df23-53e6-b514-4365fadbcc72_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa55a871269dd49dfaa25e2e92bf998d1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/1.jpg saved to cache
2026-03-27 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 901702fd-df23-53e6-b514-4365fadbcc72
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050cb10>
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b422baff-c576-5f54-9a8a-81ad7e0383ee/b422baff-c576-5f54-9a8a-81ad7e0383ee_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc9cd24fb9b95406ea1a0a3910bcea78f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/7.jpg saved to cache
2026-03-27 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b422baff-c576-5f54-9a8a-81ad7e0383ee
2026-03-27 16:49:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b422baff-c576-5f54-9a8a-81ad7e0383ee, skipping ID generation
2026-03-27 16:49:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b422baff-c576-5f54-9a8a-81ad7e0383ee with scrape type 1
2026-03-27 16:49:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b422baff-c576-5f54-9a8a-81ad7e0383ee sending to next pipeline
2026-03-27 16:49:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b422baff-c576-5f54-9a8a-81ad7e0383ee, identifier: 1988371
2026-03-27 16:49:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f with identifier: 1988370
2026-03-27 16:49:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:49:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f with identifier: 1988370
2026-03-27 16:49:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f with identifier: 1988370 to the API
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'GRIS PLATINIUM METALLISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C5 AIRCROSS',
'odometer': 104167,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f/1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436286,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f/1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436286,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f/1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 390004,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f/1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359819,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f/1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f/1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f/1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336677,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f/1cb4f12c-61ce-5838-a6d6-f505a1aa7e0f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 621947,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/19a2ec158c1340b1b292450fb356ceb1/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-05',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C5 AIRCROSS C5 Aircross PureTech 130ch S&S Live',
'transmission': 'manual',
'trim': 'C5 Aircross PureTech 130ch S&S Live',
'vin': None,
'year': 2022}
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988370%27 HTTP/1.1" 200 None
2026-03-27 16:49:33 [ayvens.fr] INFO: Saving data for 1988370: {'created_time': 1774630173.433621, 'last_price_update_time': 1774630173.433634, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988370') HTTP/1.1" 204 0
2026-03-27 16:49:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b422baff-c576-5f54-9a8a-81ad7e0383ee with identifier: 1988371
2026-03-27 16:49:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b422baff-c576-5f54-9a8a-81ad7e0383ee with identifier: 1988371
2026-03-27 16:49:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b422baff-c576-5f54-9a8a-81ad7e0383ee with identifier: 1988371 to the API
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 96,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'b422baff-c576-5f54-9a8a-81ad7e0383ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 46379,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b422baff-c576-5f54-9a8a-81ad7e0383ee/b422baff-c576-5f54-9a8a-81ad7e0383ee_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313972,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b422baff-c576-5f54-9a8a-81ad7e0383ee/b422baff-c576-5f54-9a8a-81ad7e0383ee_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313972,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b422baff-c576-5f54-9a8a-81ad7e0383ee/b422baff-c576-5f54-9a8a-81ad7e0383ee_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306070,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b422baff-c576-5f54-9a8a-81ad7e0383ee/b422baff-c576-5f54-9a8a-81ad7e0383ee_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319064,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b422baff-c576-5f54-9a8a-81ad7e0383ee/b422baff-c576-5f54-9a8a-81ad7e0383ee_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343666,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b422baff-c576-5f54-9a8a-81ad7e0383ee/b422baff-c576-5f54-9a8a-81ad7e0383ee_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340160,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b422baff-c576-5f54-9a8a-81ad7e0383ee/b422baff-c576-5f54-9a8a-81ad7e0383ee_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316223,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b422baff-c576-5f54-9a8a-81ad7e0383ee/b422baff-c576-5f54-9a8a-81ad7e0383ee_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409817,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/c9cd24fb9b95406ea1a0a3910bcea78f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-21',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 PureTech 82ch Feel Business S&S',
'transmission': 'manual',
'trim': 'C3 PureTech 82ch Feel Business S&S',
'vin': None,
'year': 2019}
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988371%27 HTTP/1.1" 200 None
2026-03-27 16:49:33 [ayvens.fr] INFO: Saving data for 1988371: {'created_time': 1774630173.819352, 'last_price_update_time': 1774630173.819368, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988371') HTTP/1.1" 204 0
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6fb7248bc0084130a79664f65c9ad913%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/8.jpg not downloaded yet
2026-03-27 16:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ec4f50>
2026-03-27 16:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c54807-5edc-594d-8533-fdcf9fca2b1a/b2c54807-5edc-594d-8533-fdcf9fca2b1a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F39e502a742fe4b3e994b6a3c21f43842%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/8.jpg saved to cache
2026-03-27 16:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b2c54807-5edc-594d-8533-fdcf9fca2b1a
2026-03-27 16:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e8de10>
2026-03-27 16:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c54807-5edc-594d-8533-fdcf9fca2b1a/b2c54807-5edc-594d-8533-fdcf9fca2b1a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F39e502a742fe4b3e994b6a3c21f43842%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/7.jpg saved to cache
2026-03-27 16:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b2c54807-5edc-594d-8533-fdcf9fca2b1a
2026-03-27 16:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:33 [ayvens.fr] INFO: Found listing with ID: 1988374
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988374%27 HTTP/1.1" 200 None
2026-03-27 16:49:34 [ayvens.fr] INFO: Scrape type for 1988374: 1
2026-03-27 16:49:34 [ayvens.fr] INFO: Extracting data for car ID: 1988374
2026-03-27 16:49:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1b52a27-d385-52e5-8b0a-68a7ff685930 with identifier: 1988374
2026-03-27 16:49:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1b52a27-d385-52e5-8b0a-68a7ff685930 with scrape type 1
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a1b52a27-d385-52e5-8b0a-68a7ff685930
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F18b258a673d04daa85e6f924402f4692%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/1.jpg not downloaded yet
2026-03-27 16:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F18b258a673d04daa85e6f924402f4692%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/2.jpg not downloaded yet
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ac4d10>
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_901702fd-df23-53e6-b514-4365fadbcc72/901702fd-df23-53e6-b514-4365fadbcc72_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa55a871269dd49dfaa25e2e92bf998d1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/3.jpg saved to cache
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 901702fd-df23-53e6-b514-4365fadbcc72
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590edacd0>
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_901702fd-df23-53e6-b514-4365fadbcc72/901702fd-df23-53e6-b514-4365fadbcc72_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa55a871269dd49dfaa25e2e92bf998d1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/4.jpg saved to cache
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 901702fd-df23-53e6-b514-4365fadbcc72
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590aeaed0>
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_901702fd-df23-53e6-b514-4365fadbcc72/901702fd-df23-53e6-b514-4365fadbcc72_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa55a871269dd49dfaa25e2e92bf998d1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/5.jpg saved to cache
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 901702fd-df23-53e6-b514-4365fadbcc72
2026-03-27 16:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F18b258a673d04daa85e6f924402f4692%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/3.jpg not downloaded yet
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F18b258a673d04daa85e6f924402f4692%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/4.jpg not downloaded yet
2026-03-27 16:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e8d050>
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_901702fd-df23-53e6-b514-4365fadbcc72/901702fd-df23-53e6-b514-4365fadbcc72_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa55a871269dd49dfaa25e2e92bf998d1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/6.jpg saved to cache
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 901702fd-df23-53e6-b514-4365fadbcc72
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f13410>
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_901702fd-df23-53e6-b514-4365fadbcc72/901702fd-df23-53e6-b514-4365fadbcc72_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa55a871269dd49dfaa25e2e92bf998d1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/7.jpg saved to cache
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 901702fd-df23-53e6-b514-4365fadbcc72
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e08fd0>
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c54807-5edc-594d-8533-fdcf9fca2b1a/b2c54807-5edc-594d-8533-fdcf9fca2b1a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F39e502a742fe4b3e994b6a3c21f43842%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/6.jpg saved to cache
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b2c54807-5edc-594d-8533-fdcf9fca2b1a
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ec5bd0>
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c54807-5edc-594d-8533-fdcf9fca2b1a/b2c54807-5edc-594d-8533-fdcf9fca2b1a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F39e502a742fe4b3e994b6a3c21f43842%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/5.jpg saved to cache
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2c54807-5edc-594d-8533-fdcf9fca2b1a
2026-03-27 16:49:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2c54807-5edc-594d-8533-fdcf9fca2b1a, skipping ID generation
2026-03-27 16:49:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c54807-5edc-594d-8533-fdcf9fca2b1a with scrape type 1
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2c54807-5edc-594d-8533-fdcf9fca2b1a sending to next pipeline
2026-03-27 16:49:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b2c54807-5edc-594d-8533-fdcf9fca2b1a, identifier: 1988369
2026-03-27 16:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F18b258a673d04daa85e6f924402f4692%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/5.jpg not downloaded yet
2026-03-27 16:49:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b2c54807-5edc-594d-8533-fdcf9fca2b1a with identifier: 1988369
2026-03-27 16:49:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:49:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b2c54807-5edc-594d-8533-fdcf9fca2b1a with identifier: 1988369
2026-03-27 16:49:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b2c54807-5edc-594d-8533-fdcf9fca2b1a with identifier: 1988369 to the API
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'ROUGE VELVET',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'b2c54807-5edc-594d-8533-fdcf9fca2b1a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'DS AUTOMOBILES',
'model': 'DS4',
'odometer': 86084,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c54807-5edc-594d-8533-fdcf9fca2b1a/b2c54807-5edc-594d-8533-fdcf9fca2b1a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457684,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c54807-5edc-594d-8533-fdcf9fca2b1a/b2c54807-5edc-594d-8533-fdcf9fca2b1a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457684,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c54807-5edc-594d-8533-fdcf9fca2b1a/b2c54807-5edc-594d-8533-fdcf9fca2b1a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 472397,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c54807-5edc-594d-8533-fdcf9fca2b1a/b2c54807-5edc-594d-8533-fdcf9fca2b1a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414163,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c54807-5edc-594d-8533-fdcf9fca2b1a/b2c54807-5edc-594d-8533-fdcf9fca2b1a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369100,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c54807-5edc-594d-8533-fdcf9fca2b1a/b2c54807-5edc-594d-8533-fdcf9fca2b1a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350221,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c54807-5edc-594d-8533-fdcf9fca2b1a/b2c54807-5edc-594d-8533-fdcf9fca2b1a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262592,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c54807-5edc-594d-8533-fdcf9fca2b1a/b2c54807-5edc-594d-8533-fdcf9fca2b1a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386384,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/39e502a742fe4b3e994b6a3c21f43842/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'DS AUTOMOBILES DS4 DS 4 PureTech 130ch Bastille Automatique',
'transmission': 'automatic',
'trim': 'DS 4 PureTech 130ch Bastille Automatique',
'vin': None,
'year': 2023}
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988369%27 HTTP/1.1" 200 None
2026-03-27 16:49:35 [ayvens.fr] INFO: Saving data for 1988369: {'created_time': 1774630175.092329, 'last_price_update_time': 1774630175.092402, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988369') HTTP/1.1" 204 0
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F18b258a673d04daa85e6f924402f4692%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/6.jpg not downloaded yet
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b06610>
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_901702fd-df23-53e6-b514-4365fadbcc72/901702fd-df23-53e6-b514-4365fadbcc72_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa55a871269dd49dfaa25e2e92bf998d1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/2.jpg saved to cache
2026-03-27 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 901702fd-df23-53e6-b514-4365fadbcc72
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911ec4d0>
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a64d63-568d-5f40-893c-9603d31a522f/e1a64d63-568d-5f40-893c-9603d31a522f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6fb7248bc0084130a79664f65c9ad913%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/2.jpg saved to cache
2026-03-27 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e1a64d63-568d-5f40-893c-9603d31a522f
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d95050>
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a64d63-568d-5f40-893c-9603d31a522f/e1a64d63-568d-5f40-893c-9603d31a522f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6fb7248bc0084130a79664f65c9ad913%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/1.jpg saved to cache
2026-03-27 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1a64d63-568d-5f40-893c-9603d31a522f
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051d010>
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a64d63-568d-5f40-893c-9603d31a522f/e1a64d63-568d-5f40-893c-9603d31a522f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6fb7248bc0084130a79664f65c9ad913%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/5.jpg saved to cache
2026-03-27 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e1a64d63-568d-5f40-893c-9603d31a522f
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d94090>
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_901702fd-df23-53e6-b514-4365fadbcc72/901702fd-df23-53e6-b514-4365fadbcc72_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fa55a871269dd49dfaa25e2e92bf998d1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/8.jpg saved to cache
2026-03-27 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 901702fd-df23-53e6-b514-4365fadbcc72
2026-03-27 16:49:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 901702fd-df23-53e6-b514-4365fadbcc72, skipping ID generation
2026-03-27 16:49:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 901702fd-df23-53e6-b514-4365fadbcc72 with scrape type 1
2026-03-27 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 901702fd-df23-53e6-b514-4365fadbcc72 sending to next pipeline
2026-03-27 16:49:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 901702fd-df23-53e6-b514-4365fadbcc72, identifier: 1988372
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efda90>
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a64d63-568d-5f40-893c-9603d31a522f/e1a64d63-568d-5f40-893c-9603d31a522f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6fb7248bc0084130a79664f65c9ad913%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/4.jpg saved to cache
2026-03-27 16:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e1a64d63-568d-5f40-893c-9603d31a522f
2026-03-27 16:49:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 901702fd-df23-53e6-b514-4365fadbcc72 with identifier: 1988372
2026-03-27 16:49:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:49:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 901702fd-df23-53e6-b514-4365fadbcc72 with identifier: 1988372
2026-03-27 16:49:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 901702fd-df23-53e6-b514-4365fadbcc72 with identifier: 1988372 to the API
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'ROUGE MULTICOUCHE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.5L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '901702fd-df23-53e6-b514-4365fadbcc72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'MODEL 3',
'odometer': 106662,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_901702fd-df23-53e6-b514-4365fadbcc72/901702fd-df23-53e6-b514-4365fadbcc72_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492422,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_901702fd-df23-53e6-b514-4365fadbcc72/901702fd-df23-53e6-b514-4365fadbcc72_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492422,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_901702fd-df23-53e6-b514-4365fadbcc72/901702fd-df23-53e6-b514-4365fadbcc72_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 454551,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_901702fd-df23-53e6-b514-4365fadbcc72/901702fd-df23-53e6-b514-4365fadbcc72_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359581,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_901702fd-df23-53e6-b514-4365fadbcc72/901702fd-df23-53e6-b514-4365fadbcc72_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260774,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_901702fd-df23-53e6-b514-4365fadbcc72/901702fd-df23-53e6-b514-4365fadbcc72_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262165,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_901702fd-df23-53e6-b514-4365fadbcc72/901702fd-df23-53e6-b514-4365fadbcc72_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245615,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_901702fd-df23-53e6-b514-4365fadbcc72/901702fd-df23-53e6-b514-4365fadbcc72_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196587,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/a55a871269dd49dfaa25e2e92bf998d1/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-09',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA MODEL 3 Model 3 Long-Range Dual Motor AWD',
'transmission': 'automatic',
'trim': 'Model 3 Long-Range Dual Motor AWD',
'vin': None,
'year': 2022}
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988372%27 HTTP/1.1" 200 None
2026-03-27 16:49:35 [ayvens.fr] INFO: Saving data for 1988372: {'created_time': 1774630175.989593, 'last_price_update_time': 1774630175.989606, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988372') HTTP/1.1" 204 0
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d97350>
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a64d63-568d-5f40-893c-9603d31a522f/e1a64d63-568d-5f40-893c-9603d31a522f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6fb7248bc0084130a79664f65c9ad913%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/3.jpg saved to cache
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e1a64d63-568d-5f40-893c-9603d31a522f
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905290d0>
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a64d63-568d-5f40-893c-9603d31a522f/e1a64d63-568d-5f40-893c-9603d31a522f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6fb7248bc0084130a79664f65c9ad913%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/6.jpg saved to cache
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e1a64d63-568d-5f40-893c-9603d31a522f
2026-03-27 16:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F18b258a673d04daa85e6f924402f4692%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/7.jpg not downloaded yet
2026-03-27 16:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F18b258a673d04daa85e6f924402f4692%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/8.jpg not downloaded yet
2026-03-27 16:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:36 [ayvens.fr] INFO: Found listing with ID: 1988375
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988375%27 HTTP/1.1" 200 None
2026-03-27 16:49:36 [ayvens.fr] INFO: Scrape type for 1988375: 1
2026-03-27 16:49:36 [ayvens.fr] INFO: Extracting data for car ID: 1988375
2026-03-27 16:49:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 563471e3-eea3-5fba-873f-632f8fa65bc5 with identifier: 1988375
2026-03-27 16:49:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 563471e3-eea3-5fba-873f-632f8fa65bc5 with scrape type 1
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 563471e3-eea3-5fba-873f-632f8fa65bc5
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6f3d7da3cfd146c19962927c7b132c70%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/1.jpg not downloaded yet
2026-03-27 16:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6f3d7da3cfd146c19962927c7b132c70%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/2.jpg not downloaded yet
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6f3d7da3cfd146c19962927c7b132c70%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/3.jpg not downloaded yet
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d7aed0>
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a64d63-568d-5f40-893c-9603d31a522f/e1a64d63-568d-5f40-893c-9603d31a522f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6fb7248bc0084130a79664f65c9ad913%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/7.jpg saved to cache
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e1a64d63-568d-5f40-893c-9603d31a522f
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6f3d7da3cfd146c19962927c7b132c70%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/4.jpg not downloaded yet
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6f3d7da3cfd146c19962927c7b132c70%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/5.jpg not downloaded yet
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590faad90>
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a64d63-568d-5f40-893c-9603d31a522f/e1a64d63-568d-5f40-893c-9603d31a522f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6fb7248bc0084130a79664f65c9ad913%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/8.jpg saved to cache
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e1a64d63-568d-5f40-893c-9603d31a522f
2026-03-27 16:49:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1a64d63-568d-5f40-893c-9603d31a522f, skipping ID generation
2026-03-27 16:49:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1a64d63-568d-5f40-893c-9603d31a522f with scrape type 1
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1a64d63-568d-5f40-893c-9603d31a522f sending to next pipeline
2026-03-27 16:49:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e1a64d63-568d-5f40-893c-9603d31a522f, identifier: 1988373
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4ff10>
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1b52a27-d385-52e5-8b0a-68a7ff685930/a1b52a27-d385-52e5-8b0a-68a7ff685930_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F18b258a673d04daa85e6f924402f4692%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/1.jpg saved to cache
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1b52a27-d385-52e5-8b0a-68a7ff685930
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590faacd0>
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1b52a27-d385-52e5-8b0a-68a7ff685930/a1b52a27-d385-52e5-8b0a-68a7ff685930_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F18b258a673d04daa85e6f924402f4692%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/2.jpg saved to cache
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1b52a27-d385-52e5-8b0a-68a7ff685930
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591445950>
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1b52a27-d385-52e5-8b0a-68a7ff685930/a1b52a27-d385-52e5-8b0a-68a7ff685930_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F18b258a673d04daa85e6f924402f4692%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/4.jpg saved to cache
2026-03-27 16:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1b52a27-d385-52e5-8b0a-68a7ff685930
2026-03-27 16:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e1a64d63-568d-5f40-893c-9603d31a522f with identifier: 1988373
2026-03-27 16:49:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e1a64d63-568d-5f40-893c-9603d31a522f with identifier: 1988373
2026-03-27 16:49:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e1a64d63-568d-5f40-893c-9603d31a522f with identifier: 1988373 to the API
2026-03-27 16:49:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'e1a64d63-568d-5f40-893c-9603d31a522f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 7263,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a64d63-568d-5f40-893c-9603d31a522f/e1a64d63-568d-5f40-893c-9603d31a522f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298639,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a64d63-568d-5f40-893c-9603d31a522f/e1a64d63-568d-5f40-893c-9603d31a522f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298639,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a64d63-568d-5f40-893c-9603d31a522f/e1a64d63-568d-5f40-893c-9603d31a522f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285806,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a64d63-568d-5f40-893c-9603d31a522f/e1a64d63-568d-5f40-893c-9603d31a522f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248156,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a64d63-568d-5f40-893c-9603d31a522f/e1a64d63-568d-5f40-893c-9603d31a522f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 234049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a64d63-568d-5f40-893c-9603d31a522f/e1a64d63-568d-5f40-893c-9603d31a522f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280915,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a64d63-568d-5f40-893c-9603d31a522f/e1a64d63-568d-5f40-893c-9603d31a522f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229923,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a64d63-568d-5f40-893c-9603d31a522f/e1a64d63-568d-5f40-893c-9603d31a522f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319235,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/6fb7248bc0084130a79664f65c9ad913/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-08',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.2 PureTech 75ch S&S Style',
'transmission': 'manual',
'trim': '208 1.2 PureTech 75ch S&S Style',
'vin': None,
'year': 2024}
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988373%27 HTTP/1.1" 200 None
2026-03-27 16:49:37 [ayvens.fr] INFO: Saving data for 1988373: {'created_time': 1774630177.32876, 'last_price_update_time': 1774630177.328771, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988373') HTTP/1.1" 204 0
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6f3d7da3cfd146c19962927c7b132c70%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/6.jpg not downloaded yet
2026-03-27 16:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f61750>
2026-03-27 16:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1b52a27-d385-52e5-8b0a-68a7ff685930/a1b52a27-d385-52e5-8b0a-68a7ff685930_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F18b258a673d04daa85e6f924402f4692%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/3.jpg saved to cache
2026-03-27 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1b52a27-d385-52e5-8b0a-68a7ff685930
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6f3d7da3cfd146c19962927c7b132c70%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/7.jpg not downloaded yet
2026-03-27 16:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b3190>
2026-03-27 16:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1b52a27-d385-52e5-8b0a-68a7ff685930/a1b52a27-d385-52e5-8b0a-68a7ff685930_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F18b258a673d04daa85e6f924402f4692%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/7.jpg saved to cache
2026-03-27 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1b52a27-d385-52e5-8b0a-68a7ff685930
2026-03-27 16:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6f3d7da3cfd146c19962927c7b132c70%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/8.jpg not downloaded yet
2026-03-27 16:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:37 [ayvens.fr] INFO: Found listing with ID: 1988376
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988376%27 HTTP/1.1" 200 None
2026-03-27 16:49:37 [ayvens.fr] INFO: Scrape type for 1988376: 1
2026-03-27 16:49:37 [ayvens.fr] INFO: Extracting data for car ID: 1988376
2026-03-27 16:49:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4f2df7a-bc2a-5c76-b690-06e38da637a8 with identifier: 1988376
2026-03-27 16:49:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4f2df7a-bc2a-5c76-b690-06e38da637a8 with scrape type 1
2026-03-27 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f4f2df7a-bc2a-5c76-b690-06e38da637a8
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7585ba126b5f47cdb0a12cb8b4ad4438%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/1.jpg not downloaded yet
2026-03-27 16:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591431e10>
2026-03-27 16:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1b52a27-d385-52e5-8b0a-68a7ff685930/a1b52a27-d385-52e5-8b0a-68a7ff685930_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F18b258a673d04daa85e6f924402f4692%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/5.jpg saved to cache
2026-03-27 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1b52a27-d385-52e5-8b0a-68a7ff685930
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7585ba126b5f47cdb0a12cb8b4ad4438%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/2.jpg not downloaded yet
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7585ba126b5f47cdb0a12cb8b4ad4438%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/3.jpg not downloaded yet
2026-03-27 16:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d8f990>
2026-03-27 16:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1b52a27-d385-52e5-8b0a-68a7ff685930/a1b52a27-d385-52e5-8b0a-68a7ff685930_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F18b258a673d04daa85e6f924402f4692%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/6.jpg saved to cache
2026-03-27 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1b52a27-d385-52e5-8b0a-68a7ff685930
2026-03-27 16:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59052a110>
2026-03-27 16:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1b52a27-d385-52e5-8b0a-68a7ff685930/a1b52a27-d385-52e5-8b0a-68a7ff685930_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F18b258a673d04daa85e6f924402f4692%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/8.jpg saved to cache
2026-03-27 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1b52a27-d385-52e5-8b0a-68a7ff685930
2026-03-27 16:49:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1b52a27-d385-52e5-8b0a-68a7ff685930, skipping ID generation
2026-03-27 16:49:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1b52a27-d385-52e5-8b0a-68a7ff685930 with scrape type 1
2026-03-27 16:49:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1b52a27-d385-52e5-8b0a-68a7ff685930 sending to next pipeline
2026-03-27 16:49:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a1b52a27-d385-52e5-8b0a-68a7ff685930, identifier: 1988374
2026-03-27 16:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59287a990>
2026-03-27 16:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563471e3-eea3-5fba-873f-632f8fa65bc5/563471e3-eea3-5fba-873f-632f8fa65bc5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6f3d7da3cfd146c19962927c7b132c70%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/1.jpg saved to cache
2026-03-27 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 563471e3-eea3-5fba-873f-632f8fa65bc5
2026-03-27 16:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7c790>
2026-03-27 16:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563471e3-eea3-5fba-873f-632f8fa65bc5/563471e3-eea3-5fba-873f-632f8fa65bc5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6f3d7da3cfd146c19962927c7b132c70%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/2.jpg saved to cache
2026-03-27 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 563471e3-eea3-5fba-873f-632f8fa65bc5
2026-03-27 16:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4b050>
2026-03-27 16:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563471e3-eea3-5fba-873f-632f8fa65bc5/563471e3-eea3-5fba-873f-632f8fa65bc5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6f3d7da3cfd146c19962927c7b132c70%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/3.jpg saved to cache
2026-03-27 16:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 563471e3-eea3-5fba-873f-632f8fa65bc5
2026-03-27 16:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a1b52a27-d385-52e5-8b0a-68a7ff685930 with identifier: 1988374
2026-03-27 16:49:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a1b52a27-d385-52e5-8b0a-68a7ff685930 with identifier: 1988374
2026-03-27 16:49:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a1b52a27-d385-52e5-8b0a-68a7ff685930 with identifier: 1988374 to the API
2026-03-27 16:49:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'NOIR PERLANERA METAL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'a1b52a27-d385-52e5-8b0a-68a7ff685930',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308',
'odometer': 105289,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1b52a27-d385-52e5-8b0a-68a7ff685930/a1b52a27-d385-52e5-8b0a-68a7ff685930_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447031,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1b52a27-d385-52e5-8b0a-68a7ff685930/a1b52a27-d385-52e5-8b0a-68a7ff685930_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447031,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1b52a27-d385-52e5-8b0a-68a7ff685930/a1b52a27-d385-52e5-8b0a-68a7ff685930_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405233,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1b52a27-d385-52e5-8b0a-68a7ff685930/a1b52a27-d385-52e5-8b0a-68a7ff685930_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1b52a27-d385-52e5-8b0a-68a7ff685930/a1b52a27-d385-52e5-8b0a-68a7ff685930_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398393,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1b52a27-d385-52e5-8b0a-68a7ff685930/a1b52a27-d385-52e5-8b0a-68a7ff685930_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330877,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1b52a27-d385-52e5-8b0a-68a7ff685930/a1b52a27-d385-52e5-8b0a-68a7ff685930_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 267860,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1b52a27-d385-52e5-8b0a-68a7ff685930/a1b52a27-d385-52e5-8b0a-68a7ff685930_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430540,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/18b258a673d04daa85e6f924402f4692/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-19',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 308 1.5 BlueHDi 130ch S&S Active Pack',
'transmission': 'manual',
'trim': '308 1.5 BlueHDi 130ch S&S Active Pack',
'vin': None,
'year': 2022}
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988374%27 HTTP/1.1" 200 None
2026-03-27 16:49:39 [ayvens.fr] INFO: Saving data for 1988374: {'created_time': 1774630179.345903, 'last_price_update_time': 1774630179.345918, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988374') HTTP/1.1" 204 0
2026-03-27 16:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7585ba126b5f47cdb0a12cb8b4ad4438%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/4.jpg not downloaded yet
2026-03-27 16:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7585ba126b5f47cdb0a12cb8b4ad4438%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/5.jpg not downloaded yet
2026-03-27 16:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d58990>
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563471e3-eea3-5fba-873f-632f8fa65bc5/563471e3-eea3-5fba-873f-632f8fa65bc5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6f3d7da3cfd146c19962927c7b132c70%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/4.jpg saved to cache
2026-03-27 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 563471e3-eea3-5fba-873f-632f8fa65bc5
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7585ba126b5f47cdb0a12cb8b4ad4438%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/6.jpg not downloaded yet
2026-03-27 16:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7585ba126b5f47cdb0a12cb8b4ad4438%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/7.jpg not downloaded yet
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59062e710>
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563471e3-eea3-5fba-873f-632f8fa65bc5/563471e3-eea3-5fba-873f-632f8fa65bc5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6f3d7da3cfd146c19962927c7b132c70%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/5.jpg saved to cache
2026-03-27 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 563471e3-eea3-5fba-873f-632f8fa65bc5
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59064d810>
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563471e3-eea3-5fba-873f-632f8fa65bc5/563471e3-eea3-5fba-873f-632f8fa65bc5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6f3d7da3cfd146c19962927c7b132c70%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/6.jpg saved to cache
2026-03-27 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 563471e3-eea3-5fba-873f-632f8fa65bc5
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abdb10>
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563471e3-eea3-5fba-873f-632f8fa65bc5/563471e3-eea3-5fba-873f-632f8fa65bc5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6f3d7da3cfd146c19962927c7b132c70%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/7.jpg saved to cache
2026-03-27 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 563471e3-eea3-5fba-873f-632f8fa65bc5
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7585ba126b5f47cdb0a12cb8b4ad4438%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/8.jpg not downloaded yet
2026-03-27 16:49:39 [ayvens.fr] INFO: Found listing with ID: 1988377
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988377%27 HTTP/1.1" 200 None
2026-03-27 16:49:39 [ayvens.fr] INFO: Scrape type for 1988377: 1
2026-03-27 16:49:39 [ayvens.fr] INFO: Extracting data for car ID: 1988377
2026-03-27 16:49:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58300cea-14a2-535f-b69a-34d9bed04942 with identifier: 1988377
2026-03-27 16:49:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58300cea-14a2-535f-b69a-34d9bed04942 with scrape type 1
2026-03-27 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 58300cea-14a2-535f-b69a-34d9bed04942
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdb98511fc0b44eec882f74eef77ee1e8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/1.jpg not downloaded yet
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590528f50>
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563471e3-eea3-5fba-873f-632f8fa65bc5/563471e3-eea3-5fba-873f-632f8fa65bc5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F6f3d7da3cfd146c19962927c7b132c70%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/8.jpg saved to cache
2026-03-27 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 563471e3-eea3-5fba-873f-632f8fa65bc5
2026-03-27 16:49:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 563471e3-eea3-5fba-873f-632f8fa65bc5, skipping ID generation
2026-03-27 16:49:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 563471e3-eea3-5fba-873f-632f8fa65bc5 with scrape type 1
2026-03-27 16:49:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 563471e3-eea3-5fba-873f-632f8fa65bc5 sending to next pipeline
2026-03-27 16:49:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 563471e3-eea3-5fba-873f-632f8fa65bc5, identifier: 1988375
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f83ed0>
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4f2df7a-bc2a-5c76-b690-06e38da637a8/f4f2df7a-bc2a-5c76-b690-06e38da637a8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7585ba126b5f47cdb0a12cb8b4ad4438%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/1.jpg saved to cache
2026-03-27 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f4f2df7a-bc2a-5c76-b690-06e38da637a8
2026-03-27 16:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdb98511fc0b44eec882f74eef77ee1e8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/2.jpg not downloaded yet
2026-03-27 16:49:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 563471e3-eea3-5fba-873f-632f8fa65bc5 with identifier: 1988375
2026-03-27 16:49:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 563471e3-eea3-5fba-873f-632f8fa65bc5 with identifier: 1988375
2026-03-27 16:49:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 563471e3-eea3-5fba-873f-632f8fa65bc5 with identifier: 1988375 to the API
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '563471e3-eea3-5fba-873f-632f8fa65bc5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 22484,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563471e3-eea3-5fba-873f-632f8fa65bc5/563471e3-eea3-5fba-873f-632f8fa65bc5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425326,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563471e3-eea3-5fba-873f-632f8fa65bc5/563471e3-eea3-5fba-873f-632f8fa65bc5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425326,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563471e3-eea3-5fba-873f-632f8fa65bc5/563471e3-eea3-5fba-873f-632f8fa65bc5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424884,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563471e3-eea3-5fba-873f-632f8fa65bc5/563471e3-eea3-5fba-873f-632f8fa65bc5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341187,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563471e3-eea3-5fba-873f-632f8fa65bc5/563471e3-eea3-5fba-873f-632f8fa65bc5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316511,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563471e3-eea3-5fba-873f-632f8fa65bc5/563471e3-eea3-5fba-873f-632f8fa65bc5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304867,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563471e3-eea3-5fba-873f-632f8fa65bc5/563471e3-eea3-5fba-873f-632f8fa65bc5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245674,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563471e3-eea3-5fba-873f-632f8fa65bc5/563471e3-eea3-5fba-873f-632f8fa65bc5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356727,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/6f3d7da3cfd146c19962927c7b132c70/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-25',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.2 PureTech 75ch S&S Style',
'transmission': 'manual',
'trim': '208 1.2 PureTech 75ch S&S Style',
'vin': None,
'year': 2024}
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988375%27 HTTP/1.1" 200 None
2026-03-27 16:49:40 [ayvens.fr] INFO: Saving data for 1988375: {'created_time': 1774630180.506028, 'last_price_update_time': 1774630180.50604, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988375') HTTP/1.1" 204 0
2026-03-27 16:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdb98511fc0b44eec882f74eef77ee1e8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/3.jpg not downloaded yet
2026-03-27 16:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd3350>
2026-03-27 16:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4f2df7a-bc2a-5c76-b690-06e38da637a8/f4f2df7a-bc2a-5c76-b690-06e38da637a8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7585ba126b5f47cdb0a12cb8b4ad4438%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/2.jpg saved to cache
2026-03-27 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f4f2df7a-bc2a-5c76-b690-06e38da637a8
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdb98511fc0b44eec882f74eef77ee1e8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/4.jpg not downloaded yet
2026-03-27 16:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdb98511fc0b44eec882f74eef77ee1e8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/5.jpg not downloaded yet
2026-03-27 16:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdb98511fc0b44eec882f74eef77ee1e8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/6.jpg not downloaded yet
2026-03-27 16:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd2910>
2026-03-27 16:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4f2df7a-bc2a-5c76-b690-06e38da637a8/f4f2df7a-bc2a-5c76-b690-06e38da637a8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7585ba126b5f47cdb0a12cb8b4ad4438%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/4.jpg saved to cache
2026-03-27 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f4f2df7a-bc2a-5c76-b690-06e38da637a8
2026-03-27 16:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa23d0>
2026-03-27 16:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4f2df7a-bc2a-5c76-b690-06e38da637a8/f4f2df7a-bc2a-5c76-b690-06e38da637a8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7585ba126b5f47cdb0a12cb8b4ad4438%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/5.jpg saved to cache
2026-03-27 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f4f2df7a-bc2a-5c76-b690-06e38da637a8
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdb98511fc0b44eec882f74eef77ee1e8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/7.jpg not downloaded yet
2026-03-27 16:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd2210>
2026-03-27 16:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4f2df7a-bc2a-5c76-b690-06e38da637a8/f4f2df7a-bc2a-5c76-b690-06e38da637a8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7585ba126b5f47cdb0a12cb8b4ad4438%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/3.jpg saved to cache
2026-03-27 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f4f2df7a-bc2a-5c76-b690-06e38da637a8
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdb98511fc0b44eec882f74eef77ee1e8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/8.jpg not downloaded yet
2026-03-27 16:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4c110>
2026-03-27 16:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4f2df7a-bc2a-5c76-b690-06e38da637a8/f4f2df7a-bc2a-5c76-b690-06e38da637a8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7585ba126b5f47cdb0a12cb8b4ad4438%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/7.jpg saved to cache
2026-03-27 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f4f2df7a-bc2a-5c76-b690-06e38da637a8
2026-03-27 16:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7f4d0>
2026-03-27 16:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4f2df7a-bc2a-5c76-b690-06e38da637a8/f4f2df7a-bc2a-5c76-b690-06e38da637a8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7585ba126b5f47cdb0a12cb8b4ad4438%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/6.jpg saved to cache
2026-03-27 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f4f2df7a-bc2a-5c76-b690-06e38da637a8
2026-03-27 16:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b6b150>
2026-03-27 16:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4f2df7a-bc2a-5c76-b690-06e38da637a8/f4f2df7a-bc2a-5c76-b690-06e38da637a8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F7585ba126b5f47cdb0a12cb8b4ad4438%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/8.jpg saved to cache
2026-03-27 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f4f2df7a-bc2a-5c76-b690-06e38da637a8
2026-03-27 16:49:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4f2df7a-bc2a-5c76-b690-06e38da637a8, skipping ID generation
2026-03-27 16:49:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4f2df7a-bc2a-5c76-b690-06e38da637a8 with scrape type 1
2026-03-27 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f4f2df7a-bc2a-5c76-b690-06e38da637a8 sending to next pipeline
2026-03-27 16:49:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f4f2df7a-bc2a-5c76-b690-06e38da637a8, identifier: 1988376
2026-03-27 16:49:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f4f2df7a-bc2a-5c76-b690-06e38da637a8 with identifier: 1988376
2026-03-27 16:49:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f4f2df7a-bc2a-5c76-b690-06e38da637a8 with identifier: 1988376
2026-03-27 16:49:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f4f2df7a-bc2a-5c76-b690-06e38da637a8 with identifier: 1988376 to the API
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'f4f2df7a-bc2a-5c76-b690-06e38da637a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 126640,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4f2df7a-bc2a-5c76-b690-06e38da637a8/f4f2df7a-bc2a-5c76-b690-06e38da637a8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422270,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4f2df7a-bc2a-5c76-b690-06e38da637a8/f4f2df7a-bc2a-5c76-b690-06e38da637a8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422270,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4f2df7a-bc2a-5c76-b690-06e38da637a8/f4f2df7a-bc2a-5c76-b690-06e38da637a8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420905,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4f2df7a-bc2a-5c76-b690-06e38da637a8/f4f2df7a-bc2a-5c76-b690-06e38da637a8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4f2df7a-bc2a-5c76-b690-06e38da637a8/f4f2df7a-bc2a-5c76-b690-06e38da637a8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363020,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4f2df7a-bc2a-5c76-b690-06e38da637a8/f4f2df7a-bc2a-5c76-b690-06e38da637a8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393001,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4f2df7a-bc2a-5c76-b690-06e38da637a8/f4f2df7a-bc2a-5c76-b690-06e38da637a8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306910,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4f2df7a-bc2a-5c76-b690-06e38da637a8/f4f2df7a-bc2a-5c76-b690-06e38da637a8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354672,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/7585ba126b5f47cdb0a12cb8b4ad4438/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-26',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 130ch S&S GT Line 124g',
'transmission': 'manual',
'trim': '2008 1.2 PureTech 130ch S&S GT Line 124g',
'vin': None,
'year': 2020}
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988376%27 HTTP/1.1" 200 None
2026-03-27 16:49:41 [ayvens.fr] INFO: Saving data for 1988376: {'created_time': 1774630181.769194, 'last_price_update_time': 1774630181.76921, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988376') HTTP/1.1" 204 0
2026-03-27 16:49:41 [ayvens.fr] INFO: Found listing with ID: 1988378
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988378%27 HTTP/1.1" 200 None
2026-03-27 16:49:41 [ayvens.fr] INFO: Scrape type for 1988378: 1
2026-03-27 16:49:41 [ayvens.fr] INFO: Extracting data for car ID: 1988378
2026-03-27 16:49:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05662a22-f29c-5f06-8607-91cb85167d80 with identifier: 1988378
2026-03-27 16:49:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05662a22-f29c-5f06-8607-91cb85167d80 with scrape type 1
2026-03-27 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 05662a22-f29c-5f06-8607-91cb85167d80
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fb989531d5f474f32801baeb96794470f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/1.jpg not downloaded yet
2026-03-27 16:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fb989531d5f474f32801baeb96794470f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/2.jpg not downloaded yet
2026-03-27 16:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fb989531d5f474f32801baeb96794470f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/3.jpg not downloaded yet
2026-03-27 16:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fb989531d5f474f32801baeb96794470f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/4.jpg not downloaded yet
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fb989531d5f474f32801baeb96794470f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/5.jpg not downloaded yet
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fb989531d5f474f32801baeb96794470f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/6.jpg not downloaded yet
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fb989531d5f474f32801baeb96794470f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/7.jpg not downloaded yet
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fb989531d5f474f32801baeb96794470f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/8.jpg not downloaded yet
2026-03-27 16:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911a4510>
2026-03-27 16:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58300cea-14a2-535f-b69a-34d9bed04942/58300cea-14a2-535f-b69a-34d9bed04942_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdb98511fc0b44eec882f74eef77ee1e8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/1.jpg saved to cache
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58300cea-14a2-535f-b69a-34d9bed04942
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590daf250>
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58300cea-14a2-535f-b69a-34d9bed04942/58300cea-14a2-535f-b69a-34d9bed04942_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdb98511fc0b44eec882f74eef77ee1e8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/2.jpg saved to cache
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58300cea-14a2-535f-b69a-34d9bed04942
2026-03-27 16:49:42 [ayvens.fr] INFO: Found listing with ID: 1988379
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988379%27 HTTP/1.1" 200 None
2026-03-27 16:49:42 [ayvens.fr] INFO: Scrape type for 1988379: 1
2026-03-27 16:49:42 [ayvens.fr] INFO: Extracting data for car ID: 1988379
2026-03-27 16:49:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32f06e7a-3ee7-58fc-b1d1-578a538212e7 with identifier: 1988379
2026-03-27 16:49:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32f06e7a-3ee7-58fc-b1d1-578a538212e7 with scrape type 1
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 32f06e7a-3ee7-58fc-b1d1-578a538212e7
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fde7a2c5142e24f1ba08596ee1bcd6ccc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/1.jpg not downloaded yet
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d2310>
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58300cea-14a2-535f-b69a-34d9bed04942/58300cea-14a2-535f-b69a-34d9bed04942_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdb98511fc0b44eec882f74eef77ee1e8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/4.jpg saved to cache
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58300cea-14a2-535f-b69a-34d9bed04942
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592873090>
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58300cea-14a2-535f-b69a-34d9bed04942/58300cea-14a2-535f-b69a-34d9bed04942_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdb98511fc0b44eec882f74eef77ee1e8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/3.jpg saved to cache
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58300cea-14a2-535f-b69a-34d9bed04942
2026-03-27 16:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fde7a2c5142e24f1ba08596ee1bcd6ccc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/2.jpg not downloaded yet
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fde7a2c5142e24f1ba08596ee1bcd6ccc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/3.jpg not downloaded yet
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591432810>
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58300cea-14a2-535f-b69a-34d9bed04942/58300cea-14a2-535f-b69a-34d9bed04942_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdb98511fc0b44eec882f74eef77ee1e8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/5.jpg saved to cache
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58300cea-14a2-535f-b69a-34d9bed04942
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f11dd0>
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58300cea-14a2-535f-b69a-34d9bed04942/58300cea-14a2-535f-b69a-34d9bed04942_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdb98511fc0b44eec882f74eef77ee1e8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/6.jpg saved to cache
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58300cea-14a2-535f-b69a-34d9bed04942
2026-03-27 16:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fde7a2c5142e24f1ba08596ee1bcd6ccc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/4.jpg not downloaded yet
2026-03-27 16:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fde7a2c5142e24f1ba08596ee1bcd6ccc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/5.jpg not downloaded yet
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59317acd0>
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58300cea-14a2-535f-b69a-34d9bed04942/58300cea-14a2-535f-b69a-34d9bed04942_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdb98511fc0b44eec882f74eef77ee1e8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/8.jpg saved to cache
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58300cea-14a2-535f-b69a-34d9bed04942
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e7a50>
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58300cea-14a2-535f-b69a-34d9bed04942/58300cea-14a2-535f-b69a-34d9bed04942_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdb98511fc0b44eec882f74eef77ee1e8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/7.jpg saved to cache
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58300cea-14a2-535f-b69a-34d9bed04942
2026-03-27 16:49:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58300cea-14a2-535f-b69a-34d9bed04942, skipping ID generation
2026-03-27 16:49:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58300cea-14a2-535f-b69a-34d9bed04942 with scrape type 1
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58300cea-14a2-535f-b69a-34d9bed04942 sending to next pipeline
2026-03-27 16:49:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 58300cea-14a2-535f-b69a-34d9bed04942, identifier: 1988377
2026-03-27 16:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fde7a2c5142e24f1ba08596ee1bcd6ccc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/6.jpg not downloaded yet
2026-03-27 16:49:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 58300cea-14a2-535f-b69a-34d9bed04942 with identifier: 1988377
2026-03-27 16:49:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:49:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 58300cea-14a2-535f-b69a-34d9bed04942 with identifier: 1988377
2026-03-27 16:49:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 58300cea-14a2-535f-b69a-34d9bed04942 with identifier: 1988377 to the API
2026-03-27 16:49:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': 'LUNAR SILVER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '58300cea-14a2-535f-b69a-34d9bed04942',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'CEED',
'odometer': 110267,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58300cea-14a2-535f-b69a-34d9bed04942/58300cea-14a2-535f-b69a-34d9bed04942_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376050,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58300cea-14a2-535f-b69a-34d9bed04942/58300cea-14a2-535f-b69a-34d9bed04942_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376050,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58300cea-14a2-535f-b69a-34d9bed04942/58300cea-14a2-535f-b69a-34d9bed04942_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419127,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58300cea-14a2-535f-b69a-34d9bed04942/58300cea-14a2-535f-b69a-34d9bed04942_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433048,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58300cea-14a2-535f-b69a-34d9bed04942/58300cea-14a2-535f-b69a-34d9bed04942_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448806,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58300cea-14a2-535f-b69a-34d9bed04942/58300cea-14a2-535f-b69a-34d9bed04942_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355403,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58300cea-14a2-535f-b69a-34d9bed04942/58300cea-14a2-535f-b69a-34d9bed04942_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58300cea-14a2-535f-b69a-34d9bed04942/58300cea-14a2-535f-b69a-34d9bed04942_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313793,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/db98511fc0b44eec882f74eef77ee1e8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-12',
'seats_number': 5,
'seller_name': None,
'title': 'KIA CEED Ceed SW 1.5 T-GDI 160ch Active Business DCT7',
'transmission': 'automatic',
'trim': 'Ceed SW 1.5 T-GDI 160ch Active Business DCT7',
'vin': None,
'year': 2023}
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988377%27 HTTP/1.1" 200 None
2026-03-27 16:49:43 [ayvens.fr] INFO: Saving data for 1988377: {'created_time': 1774630183.139513, 'last_price_update_time': 1774630183.139525, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988377') HTTP/1.1" 204 0
2026-03-27 16:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fde7a2c5142e24f1ba08596ee1bcd6ccc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/7.jpg not downloaded yet
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e3110>
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05662a22-f29c-5f06-8607-91cb85167d80/05662a22-f29c-5f06-8607-91cb85167d80_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fb989531d5f474f32801baeb96794470f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/6.jpg saved to cache
2026-03-27 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05662a22-f29c-5f06-8607-91cb85167d80
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fc8350>
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05662a22-f29c-5f06-8607-91cb85167d80/05662a22-f29c-5f06-8607-91cb85167d80_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fb989531d5f474f32801baeb96794470f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/5.jpg saved to cache
2026-03-27 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05662a22-f29c-5f06-8607-91cb85167d80
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59067db10>
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05662a22-f29c-5f06-8607-91cb85167d80/05662a22-f29c-5f06-8607-91cb85167d80_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fb989531d5f474f32801baeb96794470f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/1.jpg saved to cache
2026-03-27 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05662a22-f29c-5f06-8607-91cb85167d80
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee2e10>
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05662a22-f29c-5f06-8607-91cb85167d80/05662a22-f29c-5f06-8607-91cb85167d80_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fb989531d5f474f32801baeb96794470f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/2.jpg saved to cache
2026-03-27 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05662a22-f29c-5f06-8607-91cb85167d80
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911c8210>
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05662a22-f29c-5f06-8607-91cb85167d80/05662a22-f29c-5f06-8607-91cb85167d80_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fb989531d5f474f32801baeb96794470f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/4.jpg saved to cache
2026-03-27 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05662a22-f29c-5f06-8607-91cb85167d80
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fcad10>
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05662a22-f29c-5f06-8607-91cb85167d80/05662a22-f29c-5f06-8607-91cb85167d80_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fb989531d5f474f32801baeb96794470f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/3.jpg saved to cache
2026-03-27 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05662a22-f29c-5f06-8607-91cb85167d80
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592872a10>
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05662a22-f29c-5f06-8607-91cb85167d80/05662a22-f29c-5f06-8607-91cb85167d80_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fb989531d5f474f32801baeb96794470f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/7.jpg saved to cache
2026-03-27 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05662a22-f29c-5f06-8607-91cb85167d80
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fde7a2c5142e24f1ba08596ee1bcd6ccc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/8.jpg not downloaded yet
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dba510>
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05662a22-f29c-5f06-8607-91cb85167d80/05662a22-f29c-5f06-8607-91cb85167d80_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fb989531d5f474f32801baeb96794470f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/8.jpg saved to cache
2026-03-27 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05662a22-f29c-5f06-8607-91cb85167d80
2026-03-27 16:49:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05662a22-f29c-5f06-8607-91cb85167d80, skipping ID generation
2026-03-27 16:49:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05662a22-f29c-5f06-8607-91cb85167d80 with scrape type 1
2026-03-27 16:49:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05662a22-f29c-5f06-8607-91cb85167d80 sending to next pipeline
2026-03-27 16:49:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 05662a22-f29c-5f06-8607-91cb85167d80, identifier: 1988378
2026-03-27 16:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:43 [ayvens.fr] INFO: Found listing with ID: 1988380
2026-03-27 16:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988380%27 HTTP/1.1" 200 None
2026-03-27 16:49:44 [ayvens.fr] INFO: Scrape type for 1988380: 1
2026-03-27 16:49:44 [ayvens.fr] INFO: Extracting data for car ID: 1988380
2026-03-27 16:49:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ea1805f-49ee-5a00-a13c-2634a16f7dd2 with identifier: 1988380
2026-03-27 16:49:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ea1805f-49ee-5a00-a13c-2634a16f7dd2 with scrape type 1
2026-03-27 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6ea1805f-49ee-5a00-a13c-2634a16f7dd2
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Feab76a9f48c646fea65aa6a1c9db72c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/1.jpg not downloaded yet
2026-03-27 16:49:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 05662a22-f29c-5f06-8607-91cb85167d80 with identifier: 1988378
2026-03-27 16:49:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 05662a22-f29c-5f06-8607-91cb85167d80 with identifier: 1988378
2026-03-27 16:49:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 05662a22-f29c-5f06-8607-91cb85167d80 with identifier: 1988378 to the API
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '05662a22-f29c-5f06-8607-91cb85167d80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 134578,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05662a22-f29c-5f06-8607-91cb85167d80/05662a22-f29c-5f06-8607-91cb85167d80_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460462,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05662a22-f29c-5f06-8607-91cb85167d80/05662a22-f29c-5f06-8607-91cb85167d80_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460462,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05662a22-f29c-5f06-8607-91cb85167d80/05662a22-f29c-5f06-8607-91cb85167d80_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 459960,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05662a22-f29c-5f06-8607-91cb85167d80/05662a22-f29c-5f06-8607-91cb85167d80_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 399162,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05662a22-f29c-5f06-8607-91cb85167d80/05662a22-f29c-5f06-8607-91cb85167d80_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327736,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05662a22-f29c-5f06-8607-91cb85167d80/05662a22-f29c-5f06-8607-91cb85167d80_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335067,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05662a22-f29c-5f06-8607-91cb85167d80/05662a22-f29c-5f06-8607-91cb85167d80_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309570,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05662a22-f29c-5f06-8607-91cb85167d80/05662a22-f29c-5f06-8607-91cb85167d80_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 427020,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/b989531d5f474f32801baeb96794470f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CAPTUR Captur 1.0 TCe 90ch Zen',
'transmission': 'manual',
'trim': 'Captur 1.0 TCe 90ch Zen',
'vin': None,
'year': 2022}
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988378%27 HTTP/1.1" 200 None
2026-03-27 16:49:44 [ayvens.fr] INFO: Saving data for 1988378: {'created_time': 1774630184.542892, 'last_price_update_time': 1774630184.542904, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988378') HTTP/1.1" 204 0
2026-03-27 16:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Feab76a9f48c646fea65aa6a1c9db72c8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/2.jpg not downloaded yet
2026-03-27 16:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b66650>
2026-03-27 16:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32f06e7a-3ee7-58fc-b1d1-578a538212e7/32f06e7a-3ee7-58fc-b1d1-578a538212e7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fde7a2c5142e24f1ba08596ee1bcd6ccc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/3.jpg saved to cache
2026-03-27 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 32f06e7a-3ee7-58fc-b1d1-578a538212e7
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Feab76a9f48c646fea65aa6a1c9db72c8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/3.jpg not downloaded yet
2026-03-27 16:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Feab76a9f48c646fea65aa6a1c9db72c8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/4.jpg not downloaded yet
2026-03-27 16:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a3f90>
2026-03-27 16:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32f06e7a-3ee7-58fc-b1d1-578a538212e7/32f06e7a-3ee7-58fc-b1d1-578a538212e7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fde7a2c5142e24f1ba08596ee1bcd6ccc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/1.jpg saved to cache
2026-03-27 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32f06e7a-3ee7-58fc-b1d1-578a538212e7
2026-03-27 16:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c3150>
2026-03-27 16:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32f06e7a-3ee7-58fc-b1d1-578a538212e7/32f06e7a-3ee7-58fc-b1d1-578a538212e7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fde7a2c5142e24f1ba08596ee1bcd6ccc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/2.jpg saved to cache
2026-03-27 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 32f06e7a-3ee7-58fc-b1d1-578a538212e7
2026-03-27 16:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d45410>
2026-03-27 16:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32f06e7a-3ee7-58fc-b1d1-578a538212e7/32f06e7a-3ee7-58fc-b1d1-578a538212e7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fde7a2c5142e24f1ba08596ee1bcd6ccc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/5.jpg saved to cache
2026-03-27 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 32f06e7a-3ee7-58fc-b1d1-578a538212e7
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Feab76a9f48c646fea65aa6a1c9db72c8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/5.jpg not downloaded yet
2026-03-27 16:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd1190>
2026-03-27 16:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32f06e7a-3ee7-58fc-b1d1-578a538212e7/32f06e7a-3ee7-58fc-b1d1-578a538212e7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fde7a2c5142e24f1ba08596ee1bcd6ccc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/4.jpg saved to cache
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 32f06e7a-3ee7-58fc-b1d1-578a538212e7
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591480990>
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32f06e7a-3ee7-58fc-b1d1-578a538212e7/32f06e7a-3ee7-58fc-b1d1-578a538212e7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fde7a2c5142e24f1ba08596ee1bcd6ccc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/6.jpg saved to cache
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 32f06e7a-3ee7-58fc-b1d1-578a538212e7
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Feab76a9f48c646fea65aa6a1c9db72c8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/6.jpg not downloaded yet
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d96ed0>
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32f06e7a-3ee7-58fc-b1d1-578a538212e7/32f06e7a-3ee7-58fc-b1d1-578a538212e7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fde7a2c5142e24f1ba08596ee1bcd6ccc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/7.jpg saved to cache
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 32f06e7a-3ee7-58fc-b1d1-578a538212e7
2026-03-27 16:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Feab76a9f48c646fea65aa6a1c9db72c8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/7.jpg not downloaded yet
2026-03-27 16:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Feab76a9f48c646fea65aa6a1c9db72c8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/8.jpg not downloaded yet
2026-03-27 16:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:45 [ayvens.fr] INFO: Found listing with ID: 1988381
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988381%27 HTTP/1.1" 200 None
2026-03-27 16:49:45 [ayvens.fr] INFO: Scrape type for 1988381: 1
2026-03-27 16:49:45 [ayvens.fr] INFO: Extracting data for car ID: 1988381
2026-03-27 16:49:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ab40023-0f61-50d3-9777-441f6c88c519 with identifier: 1988381
2026-03-27 16:49:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ab40023-0f61-50d3-9777-441f6c88c519 with scrape type 1
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ab40023-0f61-50d3-9777-441f6c88c519
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0330b249eeb64f5c94c8547d92301b8a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/1.jpg not downloaded yet
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0330b249eeb64f5c94c8547d92301b8a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/2.jpg not downloaded yet
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0330b249eeb64f5c94c8547d92301b8a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/3.jpg not downloaded yet
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0330b249eeb64f5c94c8547d92301b8a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/4.jpg not downloaded yet
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ed9610>
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea1805f-49ee-5a00-a13c-2634a16f7dd2/6ea1805f-49ee-5a00-a13c-2634a16f7dd2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Feab76a9f48c646fea65aa6a1c9db72c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/1.jpg saved to cache
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ea1805f-49ee-5a00-a13c-2634a16f7dd2
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0330b249eeb64f5c94c8547d92301b8a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/5.jpg not downloaded yet
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0330b249eeb64f5c94c8547d92301b8a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/6.jpg not downloaded yet
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d425d0>
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32f06e7a-3ee7-58fc-b1d1-578a538212e7/32f06e7a-3ee7-58fc-b1d1-578a538212e7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fde7a2c5142e24f1ba08596ee1bcd6ccc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/8.jpg saved to cache
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 32f06e7a-3ee7-58fc-b1d1-578a538212e7
2026-03-27 16:49:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32f06e7a-3ee7-58fc-b1d1-578a538212e7, skipping ID generation
2026-03-27 16:49:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32f06e7a-3ee7-58fc-b1d1-578a538212e7 with scrape type 1
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32f06e7a-3ee7-58fc-b1d1-578a538212e7 sending to next pipeline
2026-03-27 16:49:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 32f06e7a-3ee7-58fc-b1d1-578a538212e7, identifier: 1988379
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591105910>
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea1805f-49ee-5a00-a13c-2634a16f7dd2/6ea1805f-49ee-5a00-a13c-2634a16f7dd2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Feab76a9f48c646fea65aa6a1c9db72c8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/2.jpg saved to cache
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ea1805f-49ee-5a00-a13c-2634a16f7dd2
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903cf490>
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea1805f-49ee-5a00-a13c-2634a16f7dd2/6ea1805f-49ee-5a00-a13c-2634a16f7dd2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Feab76a9f48c646fea65aa6a1c9db72c8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/3.jpg saved to cache
2026-03-27 16:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ea1805f-49ee-5a00-a13c-2634a16f7dd2
2026-03-27 16:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 32f06e7a-3ee7-58fc-b1d1-578a538212e7 with identifier: 1988379
2026-03-27 16:49:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 32f06e7a-3ee7-58fc-b1d1-578a538212e7 with identifier: 1988379
2026-03-27 16:49:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 32f06e7a-3ee7-58fc-b1d1-578a538212e7 with identifier: 1988379 to the API
2026-03-27 16:49:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 87,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '32f06e7a-3ee7-58fc-b1d1-578a538212e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS HYBRID',
'odometer': 44591,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32f06e7a-3ee7-58fc-b1d1-578a538212e7/32f06e7a-3ee7-58fc-b1d1-578a538212e7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404596,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32f06e7a-3ee7-58fc-b1d1-578a538212e7/32f06e7a-3ee7-58fc-b1d1-578a538212e7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404596,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32f06e7a-3ee7-58fc-b1d1-578a538212e7/32f06e7a-3ee7-58fc-b1d1-578a538212e7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 390986,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32f06e7a-3ee7-58fc-b1d1-578a538212e7/32f06e7a-3ee7-58fc-b1d1-578a538212e7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352836,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32f06e7a-3ee7-58fc-b1d1-578a538212e7/32f06e7a-3ee7-58fc-b1d1-578a538212e7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32f06e7a-3ee7-58fc-b1d1-578a538212e7/32f06e7a-3ee7-58fc-b1d1-578a538212e7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321834,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32f06e7a-3ee7-58fc-b1d1-578a538212e7/32f06e7a-3ee7-58fc-b1d1-578a538212e7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370603,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32f06e7a-3ee7-58fc-b1d1-578a538212e7/32f06e7a-3ee7-58fc-b1d1-578a538212e7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 489054,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/de7a2c5142e24f1ba08596ee1bcd6ccc/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-16',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA YARIS HYBRID Yaris 116h France Business 5p + Stage Hybrid '
'Academy',
'transmission': 'automatic',
'trim': 'Yaris 116h France Business 5p + Stage Hybrid Academy',
'vin': None,
'year': 2021}
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988379%27 HTTP/1.1" 200 None
2026-03-27 16:49:46 [ayvens.fr] INFO: Saving data for 1988379: {'created_time': 1774630186.484415, 'last_price_update_time': 1774630186.484429, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988379') HTTP/1.1" 204 0
2026-03-27 16:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0330b249eeb64f5c94c8547d92301b8a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/7.jpg not downloaded yet
2026-03-27 16:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0330b249eeb64f5c94c8547d92301b8a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/8.jpg not downloaded yet
2026-03-27 16:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590617c10>
2026-03-27 16:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea1805f-49ee-5a00-a13c-2634a16f7dd2/6ea1805f-49ee-5a00-a13c-2634a16f7dd2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Feab76a9f48c646fea65aa6a1c9db72c8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/4.jpg saved to cache
2026-03-27 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ea1805f-49ee-5a00-a13c-2634a16f7dd2
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0330b249eeb64f5c94c8547d92301b8a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/9.jpg not downloaded yet
2026-03-27 16:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0330b249eeb64f5c94c8547d92301b8a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/10.jpg not downloaded yet
2026-03-27 16:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d32d0>
2026-03-27 16:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea1805f-49ee-5a00-a13c-2634a16f7dd2/6ea1805f-49ee-5a00-a13c-2634a16f7dd2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Feab76a9f48c646fea65aa6a1c9db72c8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/6.jpg saved to cache
2026-03-27 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ea1805f-49ee-5a00-a13c-2634a16f7dd2
2026-03-27 16:49:46 [ayvens.fr] INFO: Found listing with ID: 1988382
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988382%27 HTTP/1.1" 200 None
2026-03-27 16:49:46 [ayvens.fr] INFO: Scrape type for 1988382: 1
2026-03-27 16:49:46 [ayvens.fr] INFO: Extracting data for car ID: 1988382
2026-03-27 16:49:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c488e10c-cc5c-5073-ae2c-681203c7292a with identifier: 1988382
2026-03-27 16:49:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c488e10c-cc5c-5073-ae2c-681203c7292a with scrape type 1
2026-03-27 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c488e10c-cc5c-5073-ae2c-681203c7292a
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fbb39871871584050b0326bad96159627%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/1.jpg not downloaded yet
2026-03-27 16:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa9010>
2026-03-27 16:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea1805f-49ee-5a00-a13c-2634a16f7dd2/6ea1805f-49ee-5a00-a13c-2634a16f7dd2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Feab76a9f48c646fea65aa6a1c9db72c8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/5.jpg saved to cache
2026-03-27 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ea1805f-49ee-5a00-a13c-2634a16f7dd2
2026-03-27 16:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b49390>
2026-03-27 16:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea1805f-49ee-5a00-a13c-2634a16f7dd2/6ea1805f-49ee-5a00-a13c-2634a16f7dd2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Feab76a9f48c646fea65aa6a1c9db72c8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/8.jpg saved to cache
2026-03-27 16:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ea1805f-49ee-5a00-a13c-2634a16f7dd2
2026-03-27 16:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59062fd10>
2026-03-27 16:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ab40023-0f61-50d3-9777-441f6c88c519/0ab40023-0f61-50d3-9777-441f6c88c519_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0330b249eeb64f5c94c8547d92301b8a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/2.jpg saved to cache
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ab40023-0f61-50d3-9777-441f6c88c519
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fbb39871871584050b0326bad96159627%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/2.jpg not downloaded yet
2026-03-27 16:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b4b250>
2026-03-27 16:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea1805f-49ee-5a00-a13c-2634a16f7dd2/6ea1805f-49ee-5a00-a13c-2634a16f7dd2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Feab76a9f48c646fea65aa6a1c9db72c8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/7.jpg saved to cache
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ea1805f-49ee-5a00-a13c-2634a16f7dd2
2026-03-27 16:49:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ea1805f-49ee-5a00-a13c-2634a16f7dd2, skipping ID generation
2026-03-27 16:49:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ea1805f-49ee-5a00-a13c-2634a16f7dd2 with scrape type 1
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ea1805f-49ee-5a00-a13c-2634a16f7dd2 sending to next pipeline
2026-03-27 16:49:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6ea1805f-49ee-5a00-a13c-2634a16f7dd2, identifier: 1988380
2026-03-27 16:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590695350>
2026-03-27 16:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ab40023-0f61-50d3-9777-441f6c88c519/0ab40023-0f61-50d3-9777-441f6c88c519_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0330b249eeb64f5c94c8547d92301b8a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/3.jpg saved to cache
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ab40023-0f61-50d3-9777-441f6c88c519
2026-03-27 16:49:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6ea1805f-49ee-5a00-a13c-2634a16f7dd2 with identifier: 1988380
2026-03-27 16:49:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6ea1805f-49ee-5a00-a13c-2634a16f7dd2 with identifier: 1988380
2026-03-27 16:49:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6ea1805f-49ee-5a00-a13c-2634a16f7dd2 with identifier: 1988380 to the API
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 106,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '6ea1805f-49ee-5a00-a13c-2634a16f7dd2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 75323,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea1805f-49ee-5a00-a13c-2634a16f7dd2/6ea1805f-49ee-5a00-a13c-2634a16f7dd2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317886,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea1805f-49ee-5a00-a13c-2634a16f7dd2/6ea1805f-49ee-5a00-a13c-2634a16f7dd2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317886,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea1805f-49ee-5a00-a13c-2634a16f7dd2/6ea1805f-49ee-5a00-a13c-2634a16f7dd2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308896,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea1805f-49ee-5a00-a13c-2634a16f7dd2/6ea1805f-49ee-5a00-a13c-2634a16f7dd2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312628,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea1805f-49ee-5a00-a13c-2634a16f7dd2/6ea1805f-49ee-5a00-a13c-2634a16f7dd2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347778,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea1805f-49ee-5a00-a13c-2634a16f7dd2/6ea1805f-49ee-5a00-a13c-2634a16f7dd2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315032,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea1805f-49ee-5a00-a13c-2634a16f7dd2/6ea1805f-49ee-5a00-a13c-2634a16f7dd2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 267563,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea1805f-49ee-5a00-a13c-2634a16f7dd2/6ea1805f-49ee-5a00-a13c-2634a16f7dd2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330602,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/eab76a9f48c646fea65aa6a1c9db72c8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-18',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.5 BlueHDi 130ch E6.c Active Business S&S 111g',
'transmission': 'manual',
'trim': '3008 1.5 BlueHDi 130ch E6.c Active Business S&S 111g',
'vin': None,
'year': 2019}
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988380%27 HTTP/1.1" 200 None
2026-03-27 16:49:47 [ayvens.fr] INFO: Saving data for 1988380: {'created_time': 1774630187.648671, 'last_price_update_time': 1774630187.648683, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988380') HTTP/1.1" 204 0
2026-03-27 16:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df5b90>
2026-03-27 16:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ab40023-0f61-50d3-9777-441f6c88c519/0ab40023-0f61-50d3-9777-441f6c88c519_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0330b249eeb64f5c94c8547d92301b8a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/1.jpg saved to cache
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ab40023-0f61-50d3-9777-441f6c88c519
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fbb39871871584050b0326bad96159627%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/3.jpg not downloaded yet
2026-03-27 16:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fbb39871871584050b0326bad96159627%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/4.jpg not downloaded yet
2026-03-27 16:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fbb39871871584050b0326bad96159627%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/5.jpg not downloaded yet
2026-03-27 16:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fbb39871871584050b0326bad96159627%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/6.jpg not downloaded yet
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fbb39871871584050b0326bad96159627%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/7.jpg not downloaded yet
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fbb39871871584050b0326bad96159627%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/8.jpg not downloaded yet
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fbb39871871584050b0326bad96159627%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/9.jpg not downloaded yet
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fbb39871871584050b0326bad96159627%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/10.jpg not downloaded yet
2026-03-27 16:49:47 [ayvens.fr] INFO: Found listing with ID: 1988383
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988383%27 HTTP/1.1" 200 None
2026-03-27 16:49:47 [ayvens.fr] INFO: Scrape type for 1988383: 1
2026-03-27 16:49:47 [ayvens.fr] INFO: Extracting data for car ID: 1988383
2026-03-27 16:49:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 148ccc29-abec-55dd-9f99-fc6ffdec3ea7 with identifier: 1988383
2026-03-27 16:49:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 148ccc29-abec-55dd-9f99-fc6ffdec3ea7 with scrape type 1
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 148ccc29-abec-55dd-9f99-fc6ffdec3ea7
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F57092a85d9684942b8d6e760f2f6c7ea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/1.jpg not downloaded yet
2026-03-27 16:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066b010>
2026-03-27 16:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ab40023-0f61-50d3-9777-441f6c88c519/0ab40023-0f61-50d3-9777-441f6c88c519_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0330b249eeb64f5c94c8547d92301b8a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/6.jpg saved to cache
2026-03-27 16:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ab40023-0f61-50d3-9777-441f6c88c519
2026-03-27 16:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e4c10>
2026-03-27 16:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ab40023-0f61-50d3-9777-441f6c88c519/0ab40023-0f61-50d3-9777-441f6c88c519_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0330b249eeb64f5c94c8547d92301b8a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/8.jpg saved to cache
2026-03-27 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ab40023-0f61-50d3-9777-441f6c88c519
2026-03-27 16:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d8d8d0>
2026-03-27 16:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ab40023-0f61-50d3-9777-441f6c88c519/0ab40023-0f61-50d3-9777-441f6c88c519_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0330b249eeb64f5c94c8547d92301b8a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/7.jpg saved to cache
2026-03-27 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ab40023-0f61-50d3-9777-441f6c88c519
2026-03-27 16:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591482a50>
2026-03-27 16:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ab40023-0f61-50d3-9777-441f6c88c519/0ab40023-0f61-50d3-9777-441f6c88c519_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0330b249eeb64f5c94c8547d92301b8a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/9.jpg saved to cache
2026-03-27 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0ab40023-0f61-50d3-9777-441f6c88c519
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F57092a85d9684942b8d6e760f2f6c7ea%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/2.jpg not downloaded yet
2026-03-27 16:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c3ad0>
2026-03-27 16:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ab40023-0f61-50d3-9777-441f6c88c519/0ab40023-0f61-50d3-9777-441f6c88c519_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0330b249eeb64f5c94c8547d92301b8a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/5.jpg saved to cache
2026-03-27 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ab40023-0f61-50d3-9777-441f6c88c519
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F57092a85d9684942b8d6e760f2f6c7ea%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/3.jpg not downloaded yet
2026-03-27 16:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905b1810>
2026-03-27 16:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ab40023-0f61-50d3-9777-441f6c88c519/0ab40023-0f61-50d3-9777-441f6c88c519_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0330b249eeb64f5c94c8547d92301b8a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/4.jpg saved to cache
2026-03-27 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ab40023-0f61-50d3-9777-441f6c88c519
2026-03-27 16:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c1c50>
2026-03-27 16:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ab40023-0f61-50d3-9777-441f6c88c519/0ab40023-0f61-50d3-9777-441f6c88c519_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F0330b249eeb64f5c94c8547d92301b8a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/10.jpg saved to cache
2026-03-27 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0ab40023-0f61-50d3-9777-441f6c88c519
2026-03-27 16:49:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ab40023-0f61-50d3-9777-441f6c88c519, skipping ID generation
2026-03-27 16:49:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ab40023-0f61-50d3-9777-441f6c88c519 with scrape type 1
2026-03-27 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ab40023-0f61-50d3-9777-441f6c88c519 sending to next pipeline
2026-03-27 16:49:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0ab40023-0f61-50d3-9777-441f6c88c519, identifier: 1988381
2026-03-27 16:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F57092a85d9684942b8d6e760f2f6c7ea%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/4.jpg not downloaded yet
2026-03-27 16:49:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0ab40023-0f61-50d3-9777-441f6c88c519 with identifier: 1988381
2026-03-27 16:49:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0ab40023-0f61-50d3-9777-441f6c88c519 with identifier: 1988381
2026-03-27 16:49:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0ab40023-0f61-50d3-9777-441f6c88c519 with identifier: 1988381 to the API
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'NOIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid',
'id': '0ab40023-0f61-50d3-9777-441f6c88c519',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'ARKANA',
'odometer': 160516,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ab40023-0f61-50d3-9777-441f6c88c519/0ab40023-0f61-50d3-9777-441f6c88c519_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 522565,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ab40023-0f61-50d3-9777-441f6c88c519/0ab40023-0f61-50d3-9777-441f6c88c519_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369651,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ab40023-0f61-50d3-9777-441f6c88c519/0ab40023-0f61-50d3-9777-441f6c88c519_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364778,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ab40023-0f61-50d3-9777-441f6c88c519/0ab40023-0f61-50d3-9777-441f6c88c519_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 547775,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ab40023-0f61-50d3-9777-441f6c88c519/0ab40023-0f61-50d3-9777-441f6c88c519_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541191,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ab40023-0f61-50d3-9777-441f6c88c519/0ab40023-0f61-50d3-9777-441f6c88c519_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412873,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ab40023-0f61-50d3-9777-441f6c88c519/0ab40023-0f61-50d3-9777-441f6c88c519_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340784,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ab40023-0f61-50d3-9777-441f6c88c519/0ab40023-0f61-50d3-9777-441f6c88c519_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345706,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ab40023-0f61-50d3-9777-441f6c88c519/0ab40023-0f61-50d3-9777-441f6c88c519_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253870,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ab40023-0f61-50d3-9777-441f6c88c519/0ab40023-0f61-50d3-9777-441f6c88c519_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421595,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/0330b249eeb64f5c94c8547d92301b8a/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-08',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT ARKANA Arkana 1.6 E-Tech hybride 145ch Evolution',
'transmission': 'automatic',
'trim': 'Arkana 1.6 E-Tech hybride 145ch Evolution',
'vin': None,
'year': 2023}
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988381%27 HTTP/1.1" 200 None
2026-03-27 16:49:49 [ayvens.fr] INFO: Saving data for 1988381: {'created_time': 1774630189.071164, 'last_price_update_time': 1774630189.071177, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988381') HTTP/1.1" 204 0
2026-03-27 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F57092a85d9684942b8d6e760f2f6c7ea%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/5.jpg not downloaded yet
2026-03-27 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F57092a85d9684942b8d6e760f2f6c7ea%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/6.jpg not downloaded yet
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910c6b50>
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c488e10c-cc5c-5073-ae2c-681203c7292a/c488e10c-cc5c-5073-ae2c-681203c7292a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fbb39871871584050b0326bad96159627%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/3.jpg saved to cache
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c488e10c-cc5c-5073-ae2c-681203c7292a
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F57092a85d9684942b8d6e760f2f6c7ea%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/7.jpg not downloaded yet
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df7c10>
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c488e10c-cc5c-5073-ae2c-681203c7292a/c488e10c-cc5c-5073-ae2c-681203c7292a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fbb39871871584050b0326bad96159627%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/2.jpg saved to cache
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c488e10c-cc5c-5073-ae2c-681203c7292a
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a06d0>
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c488e10c-cc5c-5073-ae2c-681203c7292a/c488e10c-cc5c-5073-ae2c-681203c7292a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fbb39871871584050b0326bad96159627%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/1.jpg saved to cache
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c488e10c-cc5c-5073-ae2c-681203c7292a
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ab8390>
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c488e10c-cc5c-5073-ae2c-681203c7292a/c488e10c-cc5c-5073-ae2c-681203c7292a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fbb39871871584050b0326bad96159627%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/5.jpg saved to cache
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c488e10c-cc5c-5073-ae2c-681203c7292a
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590668850>
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c488e10c-cc5c-5073-ae2c-681203c7292a/c488e10c-cc5c-5073-ae2c-681203c7292a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fbb39871871584050b0326bad96159627%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/4.jpg saved to cache
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c488e10c-cc5c-5073-ae2c-681203c7292a
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F57092a85d9684942b8d6e760f2f6c7ea%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/8.jpg not downloaded yet
2026-03-27 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F57092a85d9684942b8d6e760f2f6c7ea%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/9.jpg not downloaded yet
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591209350>
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c488e10c-cc5c-5073-ae2c-681203c7292a/c488e10c-cc5c-5073-ae2c-681203c7292a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fbb39871871584050b0326bad96159627%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/6.jpg saved to cache
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c488e10c-cc5c-5073-ae2c-681203c7292a
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0f0d0>
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c488e10c-cc5c-5073-ae2c-681203c7292a/c488e10c-cc5c-5073-ae2c-681203c7292a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fbb39871871584050b0326bad96159627%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/7.jpg saved to cache
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c488e10c-cc5c-5073-ae2c-681203c7292a
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f127d0>
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c488e10c-cc5c-5073-ae2c-681203c7292a/c488e10c-cc5c-5073-ae2c-681203c7292a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fbb39871871584050b0326bad96159627%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/8.jpg saved to cache
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c488e10c-cc5c-5073-ae2c-681203c7292a
2026-03-27 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F57092a85d9684942b8d6e760f2f6c7ea%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/10.jpg not downloaded yet
2026-03-27 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:49 [ayvens.fr] INFO: Found listing with ID: 1988384
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988384%27 HTTP/1.1" 200 None
2026-03-27 16:49:49 [ayvens.fr] INFO: Scrape type for 1988384: 1
2026-03-27 16:49:49 [ayvens.fr] INFO: Extracting data for car ID: 1988384
2026-03-27 16:49:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb49aac3-f5dd-5f99-8155-e68a5ca08154 with identifier: 1988384
2026-03-27 16:49:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb49aac3-f5dd-5f99-8155-e68a5ca08154 with scrape type 1
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb49aac3-f5dd-5f99-8155-e68a5ca08154
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F394c261b652b4301a67778e323211ce4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/1.jpg not downloaded yet
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910da050>
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_148ccc29-abec-55dd-9f99-fc6ffdec3ea7/148ccc29-abec-55dd-9f99-fc6ffdec3ea7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F57092a85d9684942b8d6e760f2f6c7ea%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/3.jpg saved to cache
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 148ccc29-abec-55dd-9f99-fc6ffdec3ea7
2026-03-27 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F394c261b652b4301a67778e323211ce4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/2.jpg not downloaded yet
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F394c261b652b4301a67778e323211ce4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/3.jpg not downloaded yet
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6c8d0>
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_148ccc29-abec-55dd-9f99-fc6ffdec3ea7/148ccc29-abec-55dd-9f99-fc6ffdec3ea7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F57092a85d9684942b8d6e760f2f6c7ea%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/2.jpg saved to cache
2026-03-27 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 148ccc29-abec-55dd-9f99-fc6ffdec3ea7
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910c1610>
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_148ccc29-abec-55dd-9f99-fc6ffdec3ea7/148ccc29-abec-55dd-9f99-fc6ffdec3ea7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F57092a85d9684942b8d6e760f2f6c7ea%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/4.jpg saved to cache
2026-03-27 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 148ccc29-abec-55dd-9f99-fc6ffdec3ea7
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904fd1d0>
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_148ccc29-abec-55dd-9f99-fc6ffdec3ea7/148ccc29-abec-55dd-9f99-fc6ffdec3ea7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F57092a85d9684942b8d6e760f2f6c7ea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/1.jpg saved to cache
2026-03-27 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 148ccc29-abec-55dd-9f99-fc6ffdec3ea7
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dffc10>
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c488e10c-cc5c-5073-ae2c-681203c7292a/c488e10c-cc5c-5073-ae2c-681203c7292a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fbb39871871584050b0326bad96159627%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/10.jpg saved to cache
2026-03-27 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c488e10c-cc5c-5073-ae2c-681203c7292a
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b681d0>
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_148ccc29-abec-55dd-9f99-fc6ffdec3ea7/148ccc29-abec-55dd-9f99-fc6ffdec3ea7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F57092a85d9684942b8d6e760f2f6c7ea%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/5.jpg saved to cache
2026-03-27 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 148ccc29-abec-55dd-9f99-fc6ffdec3ea7
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F394c261b652b4301a67778e323211ce4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/4.jpg not downloaded yet
2026-03-27 16:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ec4510>
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c488e10c-cc5c-5073-ae2c-681203c7292a/c488e10c-cc5c-5073-ae2c-681203c7292a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fbb39871871584050b0326bad96159627%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/9.jpg saved to cache
2026-03-27 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c488e10c-cc5c-5073-ae2c-681203c7292a
2026-03-27 16:49:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c488e10c-cc5c-5073-ae2c-681203c7292a, skipping ID generation
2026-03-27 16:49:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c488e10c-cc5c-5073-ae2c-681203c7292a with scrape type 1
2026-03-27 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c488e10c-cc5c-5073-ae2c-681203c7292a sending to next pipeline
2026-03-27 16:49:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c488e10c-cc5c-5073-ae2c-681203c7292a, identifier: 1988382
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d6db50>
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_148ccc29-abec-55dd-9f99-fc6ffdec3ea7/148ccc29-abec-55dd-9f99-fc6ffdec3ea7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F57092a85d9684942b8d6e760f2f6c7ea%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/6.jpg saved to cache
2026-03-27 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 148ccc29-abec-55dd-9f99-fc6ffdec3ea7
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F394c261b652b4301a67778e323211ce4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/5.jpg not downloaded yet
2026-03-27 16:49:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c488e10c-cc5c-5073-ae2c-681203c7292a with identifier: 1988382
2026-03-27 16:49:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c488e10c-cc5c-5073-ae2c-681203c7292a with identifier: 1988382
2026-03-27 16:49:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c488e10c-cc5c-5073-ae2c-681203c7292a with identifier: 1988382 to the API
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIS',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'c488e10c-cc5c-5073-ae2c-681203c7292a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 82190,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c488e10c-cc5c-5073-ae2c-681203c7292a/c488e10c-cc5c-5073-ae2c-681203c7292a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 472226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c488e10c-cc5c-5073-ae2c-681203c7292a/c488e10c-cc5c-5073-ae2c-681203c7292a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 506965,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c488e10c-cc5c-5073-ae2c-681203c7292a/c488e10c-cc5c-5073-ae2c-681203c7292a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335385,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c488e10c-cc5c-5073-ae2c-681203c7292a/c488e10c-cc5c-5073-ae2c-681203c7292a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370439,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c488e10c-cc5c-5073-ae2c-681203c7292a/c488e10c-cc5c-5073-ae2c-681203c7292a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349732,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c488e10c-cc5c-5073-ae2c-681203c7292a/c488e10c-cc5c-5073-ae2c-681203c7292a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407277,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c488e10c-cc5c-5073-ae2c-681203c7292a/c488e10c-cc5c-5073-ae2c-681203c7292a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428098,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c488e10c-cc5c-5073-ae2c-681203c7292a/c488e10c-cc5c-5073-ae2c-681203c7292a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536243,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c488e10c-cc5c-5073-ae2c-681203c7292a/c488e10c-cc5c-5073-ae2c-681203c7292a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468301,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c488e10c-cc5c-5073-ae2c-681203c7292a/c488e10c-cc5c-5073-ae2c-681203c7292a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447960,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/bb39871871584050b0326bad96159627/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-17',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 1.2 PureTech 110ch S&S Shine',
'transmission': 'manual',
'trim': 'C3 1.2 PureTech 110ch S&S Shine',
'vin': None,
'year': 2023}
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988382%27 HTTP/1.1" 200 None
2026-03-27 16:49:50 [ayvens.fr] INFO: Saving data for 1988382: {'created_time': 1774630190.978409, 'last_price_update_time': 1774630190.978421, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988382') HTTP/1.1" 204 0
2026-03-27 16:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F394c261b652b4301a67778e323211ce4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/6.jpg not downloaded yet
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d47fd0>
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_148ccc29-abec-55dd-9f99-fc6ffdec3ea7/148ccc29-abec-55dd-9f99-fc6ffdec3ea7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F57092a85d9684942b8d6e760f2f6c7ea%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/7.jpg saved to cache
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 148ccc29-abec-55dd-9f99-fc6ffdec3ea7
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065c4d0>
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_148ccc29-abec-55dd-9f99-fc6ffdec3ea7/148ccc29-abec-55dd-9f99-fc6ffdec3ea7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F57092a85d9684942b8d6e760f2f6c7ea%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/8.jpg saved to cache
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 148ccc29-abec-55dd-9f99-fc6ffdec3ea7
2026-03-27 16:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F394c261b652b4301a67778e323211ce4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/7.jpg not downloaded yet
2026-03-27 16:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F394c261b652b4301a67778e323211ce4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/8.jpg not downloaded yet
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906542d0>
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_148ccc29-abec-55dd-9f99-fc6ffdec3ea7/148ccc29-abec-55dd-9f99-fc6ffdec3ea7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F57092a85d9684942b8d6e760f2f6c7ea%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/9.jpg saved to cache
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 148ccc29-abec-55dd-9f99-fc6ffdec3ea7
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F394c261b652b4301a67778e323211ce4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/9.jpg not downloaded yet
2026-03-27 16:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F394c261b652b4301a67778e323211ce4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/10.jpg not downloaded yet
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae1210>
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb49aac3-f5dd-5f99-8155-e68a5ca08154/bb49aac3-f5dd-5f99-8155-e68a5ca08154_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F394c261b652b4301a67778e323211ce4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/2.jpg saved to cache
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb49aac3-f5dd-5f99-8155-e68a5ca08154
2026-03-27 16:49:51 [ayvens.fr] INFO: Found listing with ID: 1988385
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988385%27 HTTP/1.1" 200 None
2026-03-27 16:49:51 [ayvens.fr] INFO: Scrape type for 1988385: 1
2026-03-27 16:49:51 [ayvens.fr] INFO: Extracting data for car ID: 1988385
2026-03-27 16:49:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a598d690-4a70-5d9c-a2cc-9a7ea021a91a with identifier: 1988385
2026-03-27 16:49:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a598d690-4a70-5d9c-a2cc-9a7ea021a91a with scrape type 1
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a598d690-4a70-5d9c-a2cc-9a7ea021a91a
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe0a8aff469a94217a6aa389ff2753636%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/1.jpg not downloaded yet
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b88450>
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_148ccc29-abec-55dd-9f99-fc6ffdec3ea7/148ccc29-abec-55dd-9f99-fc6ffdec3ea7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F57092a85d9684942b8d6e760f2f6c7ea%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/10.jpg saved to cache
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 148ccc29-abec-55dd-9f99-fc6ffdec3ea7
2026-03-27 16:49:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 148ccc29-abec-55dd-9f99-fc6ffdec3ea7, skipping ID generation
2026-03-27 16:49:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 148ccc29-abec-55dd-9f99-fc6ffdec3ea7 with scrape type 1
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 148ccc29-abec-55dd-9f99-fc6ffdec3ea7 sending to next pipeline
2026-03-27 16:49:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 148ccc29-abec-55dd-9f99-fc6ffdec3ea7, identifier: 1988383
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905b1450>
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb49aac3-f5dd-5f99-8155-e68a5ca08154/bb49aac3-f5dd-5f99-8155-e68a5ca08154_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F394c261b652b4301a67778e323211ce4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/1.jpg saved to cache
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb49aac3-f5dd-5f99-8155-e68a5ca08154
2026-03-27 16:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe0a8aff469a94217a6aa389ff2753636%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/2.jpg not downloaded yet
2026-03-27 16:49:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 148ccc29-abec-55dd-9f99-fc6ffdec3ea7 with identifier: 1988383
2026-03-27 16:49:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 148ccc29-abec-55dd-9f99-fc6ffdec3ea7 with identifier: 1988383
2026-03-27 16:49:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 148ccc29-abec-55dd-9f99-fc6ffdec3ea7 with identifier: 1988383 to the API
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'GRIS',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid',
'id': '148ccc29-abec-55dd-9f99-fc6ffdec3ea7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 69885,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_148ccc29-abec-55dd-9f99-fc6ffdec3ea7/148ccc29-abec-55dd-9f99-fc6ffdec3ea7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411843,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_148ccc29-abec-55dd-9f99-fc6ffdec3ea7/148ccc29-abec-55dd-9f99-fc6ffdec3ea7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401232,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_148ccc29-abec-55dd-9f99-fc6ffdec3ea7/148ccc29-abec-55dd-9f99-fc6ffdec3ea7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320161,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_148ccc29-abec-55dd-9f99-fc6ffdec3ea7/148ccc29-abec-55dd-9f99-fc6ffdec3ea7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299064,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_148ccc29-abec-55dd-9f99-fc6ffdec3ea7/148ccc29-abec-55dd-9f99-fc6ffdec3ea7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342327,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_148ccc29-abec-55dd-9f99-fc6ffdec3ea7/148ccc29-abec-55dd-9f99-fc6ffdec3ea7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291896,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_148ccc29-abec-55dd-9f99-fc6ffdec3ea7/148ccc29-abec-55dd-9f99-fc6ffdec3ea7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356470,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_148ccc29-abec-55dd-9f99-fc6ffdec3ea7/148ccc29-abec-55dd-9f99-fc6ffdec3ea7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299517,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_148ccc29-abec-55dd-9f99-fc6ffdec3ea7/148ccc29-abec-55dd-9f99-fc6ffdec3ea7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331621,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_148ccc29-abec-55dd-9f99-fc6ffdec3ea7/148ccc29-abec-55dd-9f99-fc6ffdec3ea7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474542,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/57092a85d9684942b8d6e760f2f6c7ea/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-20',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA YARIS Yaris 116h Design 5p',
'transmission': 'automatic',
'trim': 'Yaris 116h Design 5p',
'vin': None,
'year': 2023}
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988383%27 HTTP/1.1" 200 None
2026-03-27 16:49:52 [ayvens.fr] INFO: Saving data for 1988383: {'created_time': 1774630192.010785, 'last_price_update_time': 1774630192.010797, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988383') HTTP/1.1" 204 0
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe0a8aff469a94217a6aa389ff2753636%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/3.jpg not downloaded yet
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d46390>
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb49aac3-f5dd-5f99-8155-e68a5ca08154/bb49aac3-f5dd-5f99-8155-e68a5ca08154_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F394c261b652b4301a67778e323211ce4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/3.jpg saved to cache
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb49aac3-f5dd-5f99-8155-e68a5ca08154
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b4b850>
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb49aac3-f5dd-5f99-8155-e68a5ca08154/bb49aac3-f5dd-5f99-8155-e68a5ca08154_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F394c261b652b4301a67778e323211ce4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/4.jpg saved to cache
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb49aac3-f5dd-5f99-8155-e68a5ca08154
2026-03-27 16:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591483c10>
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb49aac3-f5dd-5f99-8155-e68a5ca08154/bb49aac3-f5dd-5f99-8155-e68a5ca08154_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F394c261b652b4301a67778e323211ce4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/5.jpg saved to cache
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb49aac3-f5dd-5f99-8155-e68a5ca08154
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe0a8aff469a94217a6aa389ff2753636%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/4.jpg not downloaded yet
2026-03-27 16:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe0a8aff469a94217a6aa389ff2753636%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/5.jpg not downloaded yet
2026-03-27 16:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe0a8aff469a94217a6aa389ff2753636%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/6.jpg not downloaded yet
2026-03-27 16:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe0a8aff469a94217a6aa389ff2753636%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/7.jpg not downloaded yet
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe0a8aff469a94217a6aa389ff2753636%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/8.jpg not downloaded yet
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065f410>
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb49aac3-f5dd-5f99-8155-e68a5ca08154/bb49aac3-f5dd-5f99-8155-e68a5ca08154_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F394c261b652b4301a67778e323211ce4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/6.jpg saved to cache
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb49aac3-f5dd-5f99-8155-e68a5ca08154
2026-03-27 16:49:52 [ayvens.fr] INFO: Found listing with ID: 1988386
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988386%27 HTTP/1.1" 200 None
2026-03-27 16:49:52 [ayvens.fr] INFO: Scrape type for 1988386: 1
2026-03-27 16:49:52 [ayvens.fr] INFO: Extracting data for car ID: 1988386
2026-03-27 16:49:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 675fc574-7dff-5126-a1f2-221ed290779d with identifier: 1988386
2026-03-27 16:49:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 675fc574-7dff-5126-a1f2-221ed290779d with scrape type 1
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 675fc574-7dff-5126-a1f2-221ed290779d
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe102e6854e9c4f11bf2ba2ba14b0f357%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/1.jpg not downloaded yet
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe102e6854e9c4f11bf2ba2ba14b0f357%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/2.jpg not downloaded yet
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591444290>
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb49aac3-f5dd-5f99-8155-e68a5ca08154/bb49aac3-f5dd-5f99-8155-e68a5ca08154_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F394c261b652b4301a67778e323211ce4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/7.jpg saved to cache
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb49aac3-f5dd-5f99-8155-e68a5ca08154
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd2b10>
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb49aac3-f5dd-5f99-8155-e68a5ca08154/bb49aac3-f5dd-5f99-8155-e68a5ca08154_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F394c261b652b4301a67778e323211ce4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/8.jpg saved to cache
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb49aac3-f5dd-5f99-8155-e68a5ca08154
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3e710>
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb49aac3-f5dd-5f99-8155-e68a5ca08154/bb49aac3-f5dd-5f99-8155-e68a5ca08154_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F394c261b652b4301a67778e323211ce4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/9.jpg saved to cache
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb49aac3-f5dd-5f99-8155-e68a5ca08154
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d78490>
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb49aac3-f5dd-5f99-8155-e68a5ca08154/bb49aac3-f5dd-5f99-8155-e68a5ca08154_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F394c261b652b4301a67778e323211ce4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/10.jpg saved to cache
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb49aac3-f5dd-5f99-8155-e68a5ca08154
2026-03-27 16:49:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb49aac3-f5dd-5f99-8155-e68a5ca08154, skipping ID generation
2026-03-27 16:49:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb49aac3-f5dd-5f99-8155-e68a5ca08154 with scrape type 1
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb49aac3-f5dd-5f99-8155-e68a5ca08154 sending to next pipeline
2026-03-27 16:49:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: bb49aac3-f5dd-5f99-8155-e68a5ca08154, identifier: 1988384
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59062e090>
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a598d690-4a70-5d9c-a2cc-9a7ea021a91a/a598d690-4a70-5d9c-a2cc-9a7ea021a91a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe0a8aff469a94217a6aa389ff2753636%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/1.jpg saved to cache
2026-03-27 16:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a598d690-4a70-5d9c-a2cc-9a7ea021a91a
2026-03-27 16:49:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: bb49aac3-f5dd-5f99-8155-e68a5ca08154 with identifier: 1988384
2026-03-27 16:49:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: bb49aac3-f5dd-5f99-8155-e68a5ca08154 with identifier: 1988384
2026-03-27 16:49:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: bb49aac3-f5dd-5f99-8155-e68a5ca08154 with identifier: 1988384 to the API
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLEU',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'bb49aac3-f5dd-5f99-8155-e68a5ca08154',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 40780,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb49aac3-f5dd-5f99-8155-e68a5ca08154/bb49aac3-f5dd-5f99-8155-e68a5ca08154_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536535,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb49aac3-f5dd-5f99-8155-e68a5ca08154/bb49aac3-f5dd-5f99-8155-e68a5ca08154_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 224883,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb49aac3-f5dd-5f99-8155-e68a5ca08154/bb49aac3-f5dd-5f99-8155-e68a5ca08154_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288418,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb49aac3-f5dd-5f99-8155-e68a5ca08154/bb49aac3-f5dd-5f99-8155-e68a5ca08154_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357475,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb49aac3-f5dd-5f99-8155-e68a5ca08154/bb49aac3-f5dd-5f99-8155-e68a5ca08154_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231549,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb49aac3-f5dd-5f99-8155-e68a5ca08154/bb49aac3-f5dd-5f99-8155-e68a5ca08154_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368056,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb49aac3-f5dd-5f99-8155-e68a5ca08154/bb49aac3-f5dd-5f99-8155-e68a5ca08154_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369810,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb49aac3-f5dd-5f99-8155-e68a5ca08154/bb49aac3-f5dd-5f99-8155-e68a5ca08154_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358824,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb49aac3-f5dd-5f99-8155-e68a5ca08154/bb49aac3-f5dd-5f99-8155-e68a5ca08154_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334799,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb49aac3-f5dd-5f99-8155-e68a5ca08154/bb49aac3-f5dd-5f99-8155-e68a5ca08154_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361857,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/394c261b652b4301a67778e323211ce4/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-01',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Active Pack',
'transmission': 'manual',
'trim': '5008 1.2 PureTech 130ch S&S Active Pack',
'vin': None,
'year': 2023}
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988384%27 HTTP/1.1" 200 None
2026-03-27 16:49:53 [ayvens.fr] INFO: Saving data for 1988384: {'created_time': 1774630193.36673, 'last_price_update_time': 1774630193.366741, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988384') HTTP/1.1" 204 0
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe102e6854e9c4f11bf2ba2ba14b0f357%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/3.jpg not downloaded yet
2026-03-27 16:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe102e6854e9c4f11bf2ba2ba14b0f357%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/4.jpg not downloaded yet
2026-03-27 16:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe102e6854e9c4f11bf2ba2ba14b0f357%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/5.jpg not downloaded yet
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe102e6854e9c4f11bf2ba2ba14b0f357%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/6.jpg not downloaded yet
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe102e6854e9c4f11bf2ba2ba14b0f357%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/7.jpg not downloaded yet
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe102e6854e9c4f11bf2ba2ba14b0f357%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/8.jpg not downloaded yet
2026-03-27 16:49:53 [ayvens.fr] INFO: Found listing with ID: 1988387
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988387%27 HTTP/1.1" 200 None
2026-03-27 16:49:53 [ayvens.fr] INFO: Scrape type for 1988387: 1
2026-03-27 16:49:53 [ayvens.fr] INFO: Extracting data for car ID: 1988387
2026-03-27 16:49:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3 with identifier: 1988387
2026-03-27 16:49:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3 with scrape type 1
2026-03-27 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc844ddb7b2044a31ba04d2088bb1d157%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/1.jpg not downloaded yet
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc844ddb7b2044a31ba04d2088bb1d157%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/2.jpg not downloaded yet
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc844ddb7b2044a31ba04d2088bb1d157%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/3.jpg not downloaded yet
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590518590>
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a598d690-4a70-5d9c-a2cc-9a7ea021a91a/a598d690-4a70-5d9c-a2cc-9a7ea021a91a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe0a8aff469a94217a6aa389ff2753636%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/3.jpg saved to cache
2026-03-27 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a598d690-4a70-5d9c-a2cc-9a7ea021a91a
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59102d990>
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a598d690-4a70-5d9c-a2cc-9a7ea021a91a/a598d690-4a70-5d9c-a2cc-9a7ea021a91a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe0a8aff469a94217a6aa389ff2753636%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/5.jpg saved to cache
2026-03-27 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a598d690-4a70-5d9c-a2cc-9a7ea021a91a
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591000e90>
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a598d690-4a70-5d9c-a2cc-9a7ea021a91a/a598d690-4a70-5d9c-a2cc-9a7ea021a91a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe0a8aff469a94217a6aa389ff2753636%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/8.jpg saved to cache
2026-03-27 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a598d690-4a70-5d9c-a2cc-9a7ea021a91a
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910021d0>
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a598d690-4a70-5d9c-a2cc-9a7ea021a91a/a598d690-4a70-5d9c-a2cc-9a7ea021a91a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe0a8aff469a94217a6aa389ff2753636%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/4.jpg saved to cache
2026-03-27 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a598d690-4a70-5d9c-a2cc-9a7ea021a91a
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a0a90>
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a598d690-4a70-5d9c-a2cc-9a7ea021a91a/a598d690-4a70-5d9c-a2cc-9a7ea021a91a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe0a8aff469a94217a6aa389ff2753636%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/7.jpg saved to cache
2026-03-27 16:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a598d690-4a70-5d9c-a2cc-9a7ea021a91a
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911b9e90>
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a598d690-4a70-5d9c-a2cc-9a7ea021a91a/a598d690-4a70-5d9c-a2cc-9a7ea021a91a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe0a8aff469a94217a6aa389ff2753636%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/2.jpg saved to cache
2026-03-27 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a598d690-4a70-5d9c-a2cc-9a7ea021a91a
2026-03-27 16:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591002790>
2026-03-27 16:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a598d690-4a70-5d9c-a2cc-9a7ea021a91a/a598d690-4a70-5d9c-a2cc-9a7ea021a91a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fe0a8aff469a94217a6aa389ff2753636%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/6.jpg saved to cache
2026-03-27 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a598d690-4a70-5d9c-a2cc-9a7ea021a91a
2026-03-27 16:49:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a598d690-4a70-5d9c-a2cc-9a7ea021a91a, skipping ID generation
2026-03-27 16:49:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a598d690-4a70-5d9c-a2cc-9a7ea021a91a with scrape type 1
2026-03-27 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a598d690-4a70-5d9c-a2cc-9a7ea021a91a sending to next pipeline
2026-03-27 16:49:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a598d690-4a70-5d9c-a2cc-9a7ea021a91a, identifier: 1988385
2026-03-27 16:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a598d690-4a70-5d9c-a2cc-9a7ea021a91a with identifier: 1988385
2026-03-27 16:49:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:49:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a598d690-4a70-5d9c-a2cc-9a7ea021a91a with identifier: 1988385
2026-03-27 16:49:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a598d690-4a70-5d9c-a2cc-9a7ea021a91a with identifier: 1988385 to the API
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'NOIR ONYX',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': 'a598d690-4a70-5d9c-a2cc-9a7ea021a91a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'C40',
'odometer': 141628,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a598d690-4a70-5d9c-a2cc-9a7ea021a91a/a598d690-4a70-5d9c-a2cc-9a7ea021a91a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418796,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a598d690-4a70-5d9c-a2cc-9a7ea021a91a/a598d690-4a70-5d9c-a2cc-9a7ea021a91a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418796,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a598d690-4a70-5d9c-a2cc-9a7ea021a91a/a598d690-4a70-5d9c-a2cc-9a7ea021a91a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402474,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a598d690-4a70-5d9c-a2cc-9a7ea021a91a/a598d690-4a70-5d9c-a2cc-9a7ea021a91a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401755,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a598d690-4a70-5d9c-a2cc-9a7ea021a91a/a598d690-4a70-5d9c-a2cc-9a7ea021a91a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346964,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a598d690-4a70-5d9c-a2cc-9a7ea021a91a/a598d690-4a70-5d9c-a2cc-9a7ea021a91a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283571,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a598d690-4a70-5d9c-a2cc-9a7ea021a91a/a598d690-4a70-5d9c-a2cc-9a7ea021a91a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253010,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a598d690-4a70-5d9c-a2cc-9a7ea021a91a/a598d690-4a70-5d9c-a2cc-9a7ea021a91a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 144062,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/e0a8aff469a94217a6aa389ff2753636/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-08',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO C40 C40 Recharge Extended Range 252ch Start',
'transmission': 'automatic',
'trim': 'C40 Recharge Extended Range 252ch Start',
'vin': None,
'year': 2023}
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988385%27 HTTP/1.1" 200 None
2026-03-27 16:49:54 [ayvens.fr] INFO: Saving data for 1988385: {'created_time': 1774630194.584983, 'last_price_update_time': 1774630194.584994, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988385') HTTP/1.1" 204 0
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc844ddb7b2044a31ba04d2088bb1d157%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/4.jpg not downloaded yet
2026-03-27 16:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc844ddb7b2044a31ba04d2088bb1d157%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/5.jpg not downloaded yet
2026-03-27 16:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068ec90>
2026-03-27 16:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_675fc574-7dff-5126-a1f2-221ed290779d/675fc574-7dff-5126-a1f2-221ed290779d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe102e6854e9c4f11bf2ba2ba14b0f357%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/5.jpg saved to cache
2026-03-27 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 675fc574-7dff-5126-a1f2-221ed290779d
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc844ddb7b2044a31ba04d2088bb1d157%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/6.jpg not downloaded yet
2026-03-27 16:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b2b710>
2026-03-27 16:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_675fc574-7dff-5126-a1f2-221ed290779d/675fc574-7dff-5126-a1f2-221ed290779d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe102e6854e9c4f11bf2ba2ba14b0f357%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/4.jpg saved to cache
2026-03-27 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 675fc574-7dff-5126-a1f2-221ed290779d
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc844ddb7b2044a31ba04d2088bb1d157%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/7.jpg not downloaded yet
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc844ddb7b2044a31ba04d2088bb1d157%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/8.jpg not downloaded yet
2026-03-27 16:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc7450>
2026-03-27 16:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_675fc574-7dff-5126-a1f2-221ed290779d/675fc574-7dff-5126-a1f2-221ed290779d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe102e6854e9c4f11bf2ba2ba14b0f357%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/1.jpg saved to cache
2026-03-27 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 675fc574-7dff-5126-a1f2-221ed290779d
2026-03-27 16:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910ec5d0>
2026-03-27 16:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_675fc574-7dff-5126-a1f2-221ed290779d/675fc574-7dff-5126-a1f2-221ed290779d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe102e6854e9c4f11bf2ba2ba14b0f357%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/7.jpg saved to cache
2026-03-27 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 675fc574-7dff-5126-a1f2-221ed290779d
2026-03-27 16:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5928704d0>
2026-03-27 16:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_675fc574-7dff-5126-a1f2-221ed290779d/675fc574-7dff-5126-a1f2-221ed290779d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe102e6854e9c4f11bf2ba2ba14b0f357%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/2.jpg saved to cache
2026-03-27 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 675fc574-7dff-5126-a1f2-221ed290779d
2026-03-27 16:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c3e50>
2026-03-27 16:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_675fc574-7dff-5126-a1f2-221ed290779d/675fc574-7dff-5126-a1f2-221ed290779d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe102e6854e9c4f11bf2ba2ba14b0f357%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/3.jpg saved to cache
2026-03-27 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 675fc574-7dff-5126-a1f2-221ed290779d
2026-03-27 16:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592871350>
2026-03-27 16:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_675fc574-7dff-5126-a1f2-221ed290779d/675fc574-7dff-5126-a1f2-221ed290779d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe102e6854e9c4f11bf2ba2ba14b0f357%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/6.jpg saved to cache
2026-03-27 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 675fc574-7dff-5126-a1f2-221ed290779d
2026-03-27 16:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f81a10>
2026-03-27 16:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_675fc574-7dff-5126-a1f2-221ed290779d/675fc574-7dff-5126-a1f2-221ed290779d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe102e6854e9c4f11bf2ba2ba14b0f357%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/8.jpg saved to cache
2026-03-27 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 675fc574-7dff-5126-a1f2-221ed290779d
2026-03-27 16:49:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 675fc574-7dff-5126-a1f2-221ed290779d, skipping ID generation
2026-03-27 16:49:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 675fc574-7dff-5126-a1f2-221ed290779d with scrape type 1
2026-03-27 16:49:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 675fc574-7dff-5126-a1f2-221ed290779d sending to next pipeline
2026-03-27 16:49:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 675fc574-7dff-5126-a1f2-221ed290779d, identifier: 1988386
2026-03-27 16:49:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 675fc574-7dff-5126-a1f2-221ed290779d with identifier: 1988386
2026-03-27 16:49:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 675fc574-7dff-5126-a1f2-221ed290779d with identifier: 1988386
2026-03-27 16:49:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 675fc574-7dff-5126-a1f2-221ed290779d with identifier: 1988386 to the API
2026-03-27 16:49:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'NOIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.5L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '675fc574-7dff-5126-a1f2-221ed290779d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'MODEL Y',
'odometer': 24906,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_675fc574-7dff-5126-a1f2-221ed290779d/675fc574-7dff-5126-a1f2-221ed290779d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481216,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_675fc574-7dff-5126-a1f2-221ed290779d/675fc574-7dff-5126-a1f2-221ed290779d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481216,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_675fc574-7dff-5126-a1f2-221ed290779d/675fc574-7dff-5126-a1f2-221ed290779d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364799,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_675fc574-7dff-5126-a1f2-221ed290779d/675fc574-7dff-5126-a1f2-221ed290779d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374779,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_675fc574-7dff-5126-a1f2-221ed290779d/675fc574-7dff-5126-a1f2-221ed290779d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258177,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_675fc574-7dff-5126-a1f2-221ed290779d/675fc574-7dff-5126-a1f2-221ed290779d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300473,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_675fc574-7dff-5126-a1f2-221ed290779d/675fc574-7dff-5126-a1f2-221ed290779d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181015,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_675fc574-7dff-5126-a1f2-221ed290779d/675fc574-7dff-5126-a1f2-221ed290779d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222761,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e102e6854e9c4f11bf2ba2ba14b0f357/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-22',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA MODEL Y Model Y Performance AWD',
'transmission': 'automatic',
'trim': 'Model Y Performance AWD',
'vin': None,
'year': 2022}
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988386%27 HTTP/1.1" 200 None
2026-03-27 16:49:56 [ayvens.fr] INFO: Saving data for 1988386: {'created_time': 1774630196.235952, 'last_price_update_time': 1774630196.235963, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988386') HTTP/1.1" 204 0
2026-03-27 16:49:56 [ayvens.fr] INFO: Found listing with ID: 1988388
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988388%27 HTTP/1.1" 200 None
2026-03-27 16:49:56 [ayvens.fr] INFO: Scrape type for 1988388: 1
2026-03-27 16:49:56 [ayvens.fr] INFO: Extracting data for car ID: 1988388
2026-03-27 16:49:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61ed795e-618b-5b0d-a6f6-9d098dbfe017 with identifier: 1988388
2026-03-27 16:49:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61ed795e-618b-5b0d-a6f6-9d098dbfe017 with scrape type 1
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 61ed795e-618b-5b0d-a6f6-9d098dbfe017
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9b5576afbb0e42d79977b28d93e07e1c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/1.jpg not downloaded yet
2026-03-27 16:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9b5576afbb0e42d79977b28d93e07e1c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/2.jpg not downloaded yet
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9b5576afbb0e42d79977b28d93e07e1c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/3.jpg not downloaded yet
2026-03-27 16:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9b5576afbb0e42d79977b28d93e07e1c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/4.jpg not downloaded yet
2026-03-27 16:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9b5576afbb0e42d79977b28d93e07e1c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/5.jpg not downloaded yet
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9b5576afbb0e42d79977b28d93e07e1c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/6.jpg not downloaded yet
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9b5576afbb0e42d79977b28d93e07e1c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/7.jpg not downloaded yet
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9b5576afbb0e42d79977b28d93e07e1c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/8.jpg not downloaded yet
2026-03-27 16:49:56 [ayvens.fr] INFO: Found listing with ID: 1988389
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988389%27 HTTP/1.1" 200 None
2026-03-27 16:49:56 [ayvens.fr] INFO: Scrape type for 1988389: 1
2026-03-27 16:49:56 [ayvens.fr] INFO: Extracting data for car ID: 1988389
2026-03-27 16:49:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f27f20a3-f846-5782-90b1-37820ab0d534 with identifier: 1988389
2026-03-27 16:49:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f27f20a3-f846-5782-90b1-37820ab0d534 with scrape type 1
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f27f20a3-f846-5782-90b1-37820ab0d534
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F532ff5adc7e84746b5f824666b71d678%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/1.jpg not downloaded yet
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F532ff5adc7e84746b5f824666b71d678%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/2.jpg not downloaded yet
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c0110>
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3/eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc844ddb7b2044a31ba04d2088bb1d157%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/1.jpg saved to cache
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3
2026-03-27 16:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F532ff5adc7e84746b5f824666b71d678%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/3.jpg not downloaded yet
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a2810>
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3/eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc844ddb7b2044a31ba04d2088bb1d157%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/4.jpg saved to cache
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c3d90>
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3/eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc844ddb7b2044a31ba04d2088bb1d157%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/6.jpg saved to cache
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d6edd0>
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3/eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc844ddb7b2044a31ba04d2088bb1d157%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/5.jpg saved to cache
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F532ff5adc7e84746b5f824666b71d678%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/4.jpg not downloaded yet
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59069f9d0>
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3/eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc844ddb7b2044a31ba04d2088bb1d157%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/2.jpg saved to cache
2026-03-27 16:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9d350>
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3/eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc844ddb7b2044a31ba04d2088bb1d157%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/3.jpg saved to cache
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904d75d0>
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3/eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc844ddb7b2044a31ba04d2088bb1d157%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/7.jpg saved to cache
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F532ff5adc7e84746b5f824666b71d678%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/5.jpg not downloaded yet
2026-03-27 16:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F532ff5adc7e84746b5f824666b71d678%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/6.jpg not downloaded yet
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F532ff5adc7e84746b5f824666b71d678%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/7.jpg not downloaded yet
2026-03-27 16:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F532ff5adc7e84746b5f824666b71d678%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/8.jpg not downloaded yet
2026-03-27 16:49:57 [ayvens.fr] INFO: Found listing with ID: 1988390
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988390%27 HTTP/1.1" 200 None
2026-03-27 16:49:57 [ayvens.fr] INFO: Scrape type for 1988390: 1
2026-03-27 16:49:57 [ayvens.fr] INFO: Extracting data for car ID: 1988390
2026-03-27 16:49:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b48ea10-6408-5102-8f5b-cfc7950d2d4c with identifier: 1988390
2026-03-27 16:49:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b48ea10-6408-5102-8f5b-cfc7950d2d4c with scrape type 1
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 2b48ea10-6408-5102-8f5b-cfc7950d2d4c
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fba2849364ae44abeb5be090283bc9a9d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/1.jpg not downloaded yet
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fba2849364ae44abeb5be090283bc9a9d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/2.jpg not downloaded yet
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fba2849364ae44abeb5be090283bc9a9d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/3.jpg not downloaded yet
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4fdd0>
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61ed795e-618b-5b0d-a6f6-9d098dbfe017/61ed795e-618b-5b0d-a6f6-9d098dbfe017_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9b5576afbb0e42d79977b28d93e07e1c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/1.jpg saved to cache
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61ed795e-618b-5b0d-a6f6-9d098dbfe017
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591052a50>
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61ed795e-618b-5b0d-a6f6-9d098dbfe017/61ed795e-618b-5b0d-a6f6-9d098dbfe017_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9b5576afbb0e42d79977b28d93e07e1c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/6.jpg saved to cache
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 61ed795e-618b-5b0d-a6f6-9d098dbfe017
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fba2849364ae44abeb5be090283bc9a9d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/4.jpg not downloaded yet
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b51e10>
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61ed795e-618b-5b0d-a6f6-9d098dbfe017/61ed795e-618b-5b0d-a6f6-9d098dbfe017_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9b5576afbb0e42d79977b28d93e07e1c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/5.jpg saved to cache
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 61ed795e-618b-5b0d-a6f6-9d098dbfe017
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d45610>
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61ed795e-618b-5b0d-a6f6-9d098dbfe017/61ed795e-618b-5b0d-a6f6-9d098dbfe017_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9b5576afbb0e42d79977b28d93e07e1c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/3.jpg saved to cache
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 61ed795e-618b-5b0d-a6f6-9d098dbfe017
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904cbe90>
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61ed795e-618b-5b0d-a6f6-9d098dbfe017/61ed795e-618b-5b0d-a6f6-9d098dbfe017_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9b5576afbb0e42d79977b28d93e07e1c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/4.jpg saved to cache
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 61ed795e-618b-5b0d-a6f6-9d098dbfe017
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ab8f90>
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3/eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fc844ddb7b2044a31ba04d2088bb1d157%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/8.jpg saved to cache
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3
2026-03-27 16:49:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3, skipping ID generation
2026-03-27 16:49:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3 with scrape type 1
2026-03-27 16:49:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3 sending to next pipeline
2026-03-27 16:49:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3, identifier: 1988387
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59287a890>
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61ed795e-618b-5b0d-a6f6-9d098dbfe017/61ed795e-618b-5b0d-a6f6-9d098dbfe017_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9b5576afbb0e42d79977b28d93e07e1c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/2.jpg saved to cache
2026-03-27 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61ed795e-618b-5b0d-a6f6-9d098dbfe017
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fba2849364ae44abeb5be090283bc9a9d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/5.jpg not downloaded yet
2026-03-27 16:49:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3 with identifier: 1988387
2026-03-27 16:49:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3 with identifier: 1988387
2026-03-27 16:49:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3 with identifier: 1988387 to the API
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 120772,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3/eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 519695,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3/eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 519695,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3/eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 520996,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3/eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337087,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3/eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405742,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3/eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426813,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3/eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272181,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3/eb8ae6ea-0669-568b-b3f4-b7a9555fb2c3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406287,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/c844ddb7b2044a31ba04d2088bb1d157/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-19',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch Active S&S EAT8',
'transmission': 'manual',
'trim': '3008 1.2 PureTech 130ch Active S&S EAT8',
'vin': None,
'year': 2019}
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988387%27 HTTP/1.1" 200 None
2026-03-27 16:49:58 [ayvens.fr] INFO: Saving data for 1988387: {'created_time': 1774630198.542653, 'last_price_update_time': 1774630198.542666, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988387') HTTP/1.1" 204 0
2026-03-27 16:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fba2849364ae44abeb5be090283bc9a9d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/6.jpg not downloaded yet
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe0990>
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61ed795e-618b-5b0d-a6f6-9d098dbfe017/61ed795e-618b-5b0d-a6f6-9d098dbfe017_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9b5576afbb0e42d79977b28d93e07e1c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/7.jpg saved to cache
2026-03-27 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 61ed795e-618b-5b0d-a6f6-9d098dbfe017
2026-03-27 16:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fba2849364ae44abeb5be090283bc9a9d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/7.jpg not downloaded yet
2026-03-27 16:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fba2849364ae44abeb5be090283bc9a9d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/8.jpg not downloaded yet
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911b8290>
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f27f20a3-f846-5782-90b1-37820ab0d534/f27f20a3-f846-5782-90b1-37820ab0d534_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F532ff5adc7e84746b5f824666b71d678%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/1.jpg saved to cache
2026-03-27 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f27f20a3-f846-5782-90b1-37820ab0d534
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dbad50>
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f27f20a3-f846-5782-90b1-37820ab0d534/f27f20a3-f846-5782-90b1-37820ab0d534_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F532ff5adc7e84746b5f824666b71d678%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/4.jpg saved to cache
2026-03-27 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f27f20a3-f846-5782-90b1-37820ab0d534
2026-03-27 16:49:58 [ayvens.fr] INFO: Found listing with ID: 1988391
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988391%27 HTTP/1.1" 200 None
2026-03-27 16:49:58 [ayvens.fr] INFO: Scrape type for 1988391: 1
2026-03-27 16:49:58 [ayvens.fr] INFO: Extracting data for car ID: 1988391
2026-03-27 16:49:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb4407c0-9d54-5f96-8ebe-a22d467af268 with identifier: 1988391
2026-03-27 16:49:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb4407c0-9d54-5f96-8ebe-a22d467af268 with scrape type 1
2026-03-27 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item fb4407c0-9d54-5f96-8ebe-a22d467af268
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9dada9353f4c4c89b9f63c374b3460e3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/1.jpg not downloaded yet
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9dada9353f4c4c89b9f63c374b3460e3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/2.jpg not downloaded yet
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b34310>
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f27f20a3-f846-5782-90b1-37820ab0d534/f27f20a3-f846-5782-90b1-37820ab0d534_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F532ff5adc7e84746b5f824666b71d678%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/7.jpg saved to cache
2026-03-27 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f27f20a3-f846-5782-90b1-37820ab0d534
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e6610>
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f27f20a3-f846-5782-90b1-37820ab0d534/f27f20a3-f846-5782-90b1-37820ab0d534_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F532ff5adc7e84746b5f824666b71d678%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/2.jpg saved to cache
2026-03-27 16:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f27f20a3-f846-5782-90b1-37820ab0d534
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b88290>
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61ed795e-618b-5b0d-a6f6-9d098dbfe017/61ed795e-618b-5b0d-a6f6-9d098dbfe017_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9b5576afbb0e42d79977b28d93e07e1c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/8.jpg saved to cache
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 61ed795e-618b-5b0d-a6f6-9d098dbfe017
2026-03-27 16:49:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61ed795e-618b-5b0d-a6f6-9d098dbfe017, skipping ID generation
2026-03-27 16:49:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61ed795e-618b-5b0d-a6f6-9d098dbfe017 with scrape type 1
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61ed795e-618b-5b0d-a6f6-9d098dbfe017 sending to next pipeline
2026-03-27 16:49:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 61ed795e-618b-5b0d-a6f6-9d098dbfe017, identifier: 1988388
2026-03-27 16:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d6f550>
2026-03-27 16:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f27f20a3-f846-5782-90b1-37820ab0d534/f27f20a3-f846-5782-90b1-37820ab0d534_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F532ff5adc7e84746b5f824666b71d678%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/3.jpg saved to cache
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f27f20a3-f846-5782-90b1-37820ab0d534
2026-03-27 16:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b34050>
2026-03-27 16:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f27f20a3-f846-5782-90b1-37820ab0d534/f27f20a3-f846-5782-90b1-37820ab0d534_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F532ff5adc7e84746b5f824666b71d678%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/5.jpg saved to cache
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f27f20a3-f846-5782-90b1-37820ab0d534
2026-03-27 16:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590af3f10>
2026-03-27 16:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f27f20a3-f846-5782-90b1-37820ab0d534/f27f20a3-f846-5782-90b1-37820ab0d534_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F532ff5adc7e84746b5f824666b71d678%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/6.jpg saved to cache
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f27f20a3-f846-5782-90b1-37820ab0d534
2026-03-27 16:49:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 61ed795e-618b-5b0d-a6f6-9d098dbfe017 with identifier: 1988388
2026-03-27 16:49:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 61ed795e-618b-5b0d-a6f6-9d098dbfe017 with identifier: 1988388
2026-03-27 16:49:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 61ed795e-618b-5b0d-a6f6-9d098dbfe017 with identifier: 1988388 to the API
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:49:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '61ed795e-618b-5b0d-a6f6-9d098dbfe017',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KADJAR',
'odometer': 68174,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61ed795e-618b-5b0d-a6f6-9d098dbfe017/61ed795e-618b-5b0d-a6f6-9d098dbfe017_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405568,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61ed795e-618b-5b0d-a6f6-9d098dbfe017/61ed795e-618b-5b0d-a6f6-9d098dbfe017_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405568,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61ed795e-618b-5b0d-a6f6-9d098dbfe017/61ed795e-618b-5b0d-a6f6-9d098dbfe017_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408749,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61ed795e-618b-5b0d-a6f6-9d098dbfe017/61ed795e-618b-5b0d-a6f6-9d098dbfe017_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433517,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61ed795e-618b-5b0d-a6f6-9d098dbfe017/61ed795e-618b-5b0d-a6f6-9d098dbfe017_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415880,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61ed795e-618b-5b0d-a6f6-9d098dbfe017/61ed795e-618b-5b0d-a6f6-9d098dbfe017_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361014,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61ed795e-618b-5b0d-a6f6-9d098dbfe017/61ed795e-618b-5b0d-a6f6-9d098dbfe017_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343404,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61ed795e-618b-5b0d-a6f6-9d098dbfe017/61ed795e-618b-5b0d-a6f6-9d098dbfe017_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/9b5576afbb0e42d79977b28d93e07e1c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-25',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT KADJAR Kadjar 1.3 TCe 140ch FAP Evolution EDC',
'transmission': 'automatic',
'trim': 'Kadjar 1.3 TCe 140ch FAP Evolution EDC',
'vin': None,
'year': 2022}
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988388%27 HTTP/1.1" 200 None
2026-03-27 16:49:59 [ayvens.fr] INFO: Saving data for 1988388: {'created_time': 1774630199.650658, 'last_price_update_time': 1774630199.65067, 'auction_closing_time': 1774969200.0}
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988388') HTTP/1.1" 204 0
2026-03-27 16:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9dada9353f4c4c89b9f63c374b3460e3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/3.jpg not downloaded yet
2026-03-27 16:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9dada9353f4c4c89b9f63c374b3460e3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/4.jpg not downloaded yet
2026-03-27 16:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9dada9353f4c4c89b9f63c374b3460e3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/5.jpg not downloaded yet
2026-03-27 16:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9dada9353f4c4c89b9f63c374b3460e3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/6.jpg not downloaded yet
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9dada9353f4c4c89b9f63c374b3460e3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/7.jpg not downloaded yet
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9dada9353f4c4c89b9f63c374b3460e3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/8.jpg not downloaded yet
2026-03-27 16:49:59 [ayvens.fr] INFO: Found listing with ID: 1988392
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988392%27 HTTP/1.1" 200 None
2026-03-27 16:49:59 [ayvens.fr] INFO: Scrape type for 1988392: 1
2026-03-27 16:49:59 [ayvens.fr] INFO: Extracting data for car ID: 1988392
2026-03-27 16:49:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9974f90f-e324-5fa4-87d9-81a9392aca61 with identifier: 1988392
2026-03-27 16:49:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9974f90f-e324-5fa4-87d9-81a9392aca61 with scrape type 1
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 9974f90f-e324-5fa4-87d9-81a9392aca61
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F09a522532b904846b2bb8b6a90c447ea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/1.jpg not downloaded yet
2026-03-27 16:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0fad0>
2026-03-27 16:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f27f20a3-f846-5782-90b1-37820ab0d534/f27f20a3-f846-5782-90b1-37820ab0d534_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F532ff5adc7e84746b5f824666b71d678%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/8.jpg saved to cache
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f27f20a3-f846-5782-90b1-37820ab0d534
2026-03-27 16:49:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f27f20a3-f846-5782-90b1-37820ab0d534, skipping ID generation
2026-03-27 16:49:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f27f20a3-f846-5782-90b1-37820ab0d534 with scrape type 1
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f27f20a3-f846-5782-90b1-37820ab0d534 sending to next pipeline
2026-03-27 16:49:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f27f20a3-f846-5782-90b1-37820ab0d534, identifier: 1988389
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F09a522532b904846b2bb8b6a90c447ea%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/2.jpg not downloaded yet
2026-03-27 16:50:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f27f20a3-f846-5782-90b1-37820ab0d534 with identifier: 1988389
2026-03-27 16:50:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f27f20a3-f846-5782-90b1-37820ab0d534 with identifier: 1988389
2026-03-27 16:50:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f27f20a3-f846-5782-90b1-37820ab0d534 with identifier: 1988389 to the API
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'NOIR METAL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'f27f20a3-f846-5782-90b1-37820ab0d534',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'CEED',
'odometer': 70971,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27f20a3-f846-5782-90b1-37820ab0d534/f27f20a3-f846-5782-90b1-37820ab0d534_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365171,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27f20a3-f846-5782-90b1-37820ab0d534/f27f20a3-f846-5782-90b1-37820ab0d534_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365171,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27f20a3-f846-5782-90b1-37820ab0d534/f27f20a3-f846-5782-90b1-37820ab0d534_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347437,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27f20a3-f846-5782-90b1-37820ab0d534/f27f20a3-f846-5782-90b1-37820ab0d534_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294090,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27f20a3-f846-5782-90b1-37820ab0d534/f27f20a3-f846-5782-90b1-37820ab0d534_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362170,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27f20a3-f846-5782-90b1-37820ab0d534/f27f20a3-f846-5782-90b1-37820ab0d534_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282927,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27f20a3-f846-5782-90b1-37820ab0d534/f27f20a3-f846-5782-90b1-37820ab0d534_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214370,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27f20a3-f846-5782-90b1-37820ab0d534/f27f20a3-f846-5782-90b1-37820ab0d534_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227211,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/532ff5adc7e84746b5f824666b71d678/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-07',
'seats_number': 5,
'seller_name': None,
'title': 'KIA CEED Ceed 1.0 T-GDI 120ch GT Line Premium',
'transmission': 'manual',
'trim': 'Ceed 1.0 T-GDI 120ch GT Line Premium',
'vin': None,
'year': 2023}
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988389%27 HTTP/1.1" 200 None
2026-03-27 16:50:00 [ayvens.fr] INFO: Saving data for 1988389: {'created_time': 1774630200.405933, 'last_price_update_time': 1774630200.405944, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988389') HTTP/1.1" 204 0
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ec7590>
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b48ea10-6408-5102-8f5b-cfc7950d2d4c/2b48ea10-6408-5102-8f5b-cfc7950d2d4c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fba2849364ae44abeb5be090283bc9a9d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/5.jpg saved to cache
2026-03-27 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b48ea10-6408-5102-8f5b-cfc7950d2d4c
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911ee210>
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b48ea10-6408-5102-8f5b-cfc7950d2d4c/2b48ea10-6408-5102-8f5b-cfc7950d2d4c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fba2849364ae44abeb5be090283bc9a9d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/4.jpg saved to cache
2026-03-27 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b48ea10-6408-5102-8f5b-cfc7950d2d4c
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910d2d10>
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b48ea10-6408-5102-8f5b-cfc7950d2d4c/2b48ea10-6408-5102-8f5b-cfc7950d2d4c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fba2849364ae44abeb5be090283bc9a9d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/2.jpg saved to cache
2026-03-27 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b48ea10-6408-5102-8f5b-cfc7950d2d4c
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906144d0>
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b48ea10-6408-5102-8f5b-cfc7950d2d4c/2b48ea10-6408-5102-8f5b-cfc7950d2d4c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fba2849364ae44abeb5be090283bc9a9d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/6.jpg saved to cache
2026-03-27 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2b48ea10-6408-5102-8f5b-cfc7950d2d4c
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910d0350>
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b48ea10-6408-5102-8f5b-cfc7950d2d4c/2b48ea10-6408-5102-8f5b-cfc7950d2d4c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fba2849364ae44abeb5be090283bc9a9d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/3.jpg saved to cache
2026-03-27 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b48ea10-6408-5102-8f5b-cfc7950d2d4c
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905aa9d0>
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b48ea10-6408-5102-8f5b-cfc7950d2d4c/2b48ea10-6408-5102-8f5b-cfc7950d2d4c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fba2849364ae44abeb5be090283bc9a9d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/1.jpg saved to cache
2026-03-27 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b48ea10-6408-5102-8f5b-cfc7950d2d4c
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910d07d0>
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b48ea10-6408-5102-8f5b-cfc7950d2d4c/2b48ea10-6408-5102-8f5b-cfc7950d2d4c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fba2849364ae44abeb5be090283bc9a9d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/7.jpg saved to cache
2026-03-27 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2b48ea10-6408-5102-8f5b-cfc7950d2d4c
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F09a522532b904846b2bb8b6a90c447ea%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/3.jpg not downloaded yet
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F09a522532b904846b2bb8b6a90c447ea%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/4.jpg not downloaded yet
2026-03-27 16:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F09a522532b904846b2bb8b6a90c447ea%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/5.jpg not downloaded yet
2026-03-27 16:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F09a522532b904846b2bb8b6a90c447ea%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/6.jpg not downloaded yet
2026-03-27 16:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F09a522532b904846b2bb8b6a90c447ea%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/7.jpg not downloaded yet
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F09a522532b904846b2bb8b6a90c447ea%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/8.jpg not downloaded yet
2026-03-27 16:50:01 [ayvens.fr] INFO: Found listing with ID: 1988393
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988393%27 HTTP/1.1" 200 None
2026-03-27 16:50:01 [ayvens.fr] INFO: Scrape type for 1988393: 1
2026-03-27 16:50:01 [ayvens.fr] INFO: Extracting data for car ID: 1988393
2026-03-27 16:50:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5806eaf6-7187-547b-a6f4-7d6dba8ab3ee with identifier: 1988393
2026-03-27 16:50:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5806eaf6-7187-547b-a6f4-7d6dba8ab3ee with scrape type 1
2026-03-27 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5806eaf6-7187-547b-a6f4-7d6dba8ab3ee
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F77618f8729dc4781b42c24158f05c53d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/1.jpg not downloaded yet
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F77618f8729dc4781b42c24158f05c53d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/2.jpg not downloaded yet
2026-03-27 16:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f338d0>
2026-03-27 16:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4407c0-9d54-5f96-8ebe-a22d467af268/fb4407c0-9d54-5f96-8ebe-a22d467af268_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9dada9353f4c4c89b9f63c374b3460e3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/5.jpg saved to cache
2026-03-27 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb4407c0-9d54-5f96-8ebe-a22d467af268
2026-03-27 16:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e166d0>
2026-03-27 16:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4407c0-9d54-5f96-8ebe-a22d467af268/fb4407c0-9d54-5f96-8ebe-a22d467af268_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9dada9353f4c4c89b9f63c374b3460e3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/7.jpg saved to cache
2026-03-27 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb4407c0-9d54-5f96-8ebe-a22d467af268
2026-03-27 16:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910d1a50>
2026-03-27 16:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b48ea10-6408-5102-8f5b-cfc7950d2d4c/2b48ea10-6408-5102-8f5b-cfc7950d2d4c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fba2849364ae44abeb5be090283bc9a9d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/8.jpg saved to cache
2026-03-27 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2b48ea10-6408-5102-8f5b-cfc7950d2d4c
2026-03-27 16:50:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b48ea10-6408-5102-8f5b-cfc7950d2d4c, skipping ID generation
2026-03-27 16:50:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b48ea10-6408-5102-8f5b-cfc7950d2d4c with scrape type 1
2026-03-27 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b48ea10-6408-5102-8f5b-cfc7950d2d4c sending to next pipeline
2026-03-27 16:50:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 2b48ea10-6408-5102-8f5b-cfc7950d2d4c, identifier: 1988390
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F77618f8729dc4781b42c24158f05c53d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/3.jpg not downloaded yet
2026-03-27 16:50:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 2b48ea10-6408-5102-8f5b-cfc7950d2d4c with identifier: 1988390
2026-03-27 16:50:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 2b48ea10-6408-5102-8f5b-cfc7950d2d4c with identifier: 1988390
2026-03-27 16:50:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 2b48ea10-6408-5102-8f5b-cfc7950d2d4c with identifier: 1988390 to the API
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '2b48ea10-6408-5102-8f5b-cfc7950d2d4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'CORSA',
'odometer': 58682,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b48ea10-6408-5102-8f5b-cfc7950d2d4c/2b48ea10-6408-5102-8f5b-cfc7950d2d4c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389505,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b48ea10-6408-5102-8f5b-cfc7950d2d4c/2b48ea10-6408-5102-8f5b-cfc7950d2d4c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389505,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b48ea10-6408-5102-8f5b-cfc7950d2d4c/2b48ea10-6408-5102-8f5b-cfc7950d2d4c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404645,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b48ea10-6408-5102-8f5b-cfc7950d2d4c/2b48ea10-6408-5102-8f5b-cfc7950d2d4c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355407,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b48ea10-6408-5102-8f5b-cfc7950d2d4c/2b48ea10-6408-5102-8f5b-cfc7950d2d4c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321198,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b48ea10-6408-5102-8f5b-cfc7950d2d4c/2b48ea10-6408-5102-8f5b-cfc7950d2d4c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b48ea10-6408-5102-8f5b-cfc7950d2d4c/2b48ea10-6408-5102-8f5b-cfc7950d2d4c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430303,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b48ea10-6408-5102-8f5b-cfc7950d2d4c/2b48ea10-6408-5102-8f5b-cfc7950d2d4c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 455881,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/ba2849364ae44abeb5be090283bc9a9d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL CORSA Corsa 1.4 90ch Enjoy Start/Stop 5p',
'transmission': 'manual',
'trim': 'Corsa 1.4 90ch Enjoy Start/Stop 5p',
'vin': None,
'year': 2019}
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988390%27 HTTP/1.1" 200 None
2026-03-27 16:50:01 [ayvens.fr] INFO: Saving data for 1988390: {'created_time': 1774630201.969208, 'last_price_update_time': 1774630201.969222, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988390') HTTP/1.1" 204 0
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910d8990>
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4407c0-9d54-5f96-8ebe-a22d467af268/fb4407c0-9d54-5f96-8ebe-a22d467af268_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9dada9353f4c4c89b9f63c374b3460e3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/1.jpg saved to cache
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb4407c0-9d54-5f96-8ebe-a22d467af268
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59062e3d0>
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4407c0-9d54-5f96-8ebe-a22d467af268/fb4407c0-9d54-5f96-8ebe-a22d467af268_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9dada9353f4c4c89b9f63c374b3460e3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/6.jpg saved to cache
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb4407c0-9d54-5f96-8ebe-a22d467af268
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590654450>
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4407c0-9d54-5f96-8ebe-a22d467af268/fb4407c0-9d54-5f96-8ebe-a22d467af268_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9dada9353f4c4c89b9f63c374b3460e3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/4.jpg saved to cache
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb4407c0-9d54-5f96-8ebe-a22d467af268
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4fdd0>
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4407c0-9d54-5f96-8ebe-a22d467af268/fb4407c0-9d54-5f96-8ebe-a22d467af268_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9dada9353f4c4c89b9f63c374b3460e3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/2.jpg saved to cache
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb4407c0-9d54-5f96-8ebe-a22d467af268
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F77618f8729dc4781b42c24158f05c53d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/4.jpg not downloaded yet
2026-03-27 16:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F77618f8729dc4781b42c24158f05c53d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/5.jpg not downloaded yet
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d39f10>
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4407c0-9d54-5f96-8ebe-a22d467af268/fb4407c0-9d54-5f96-8ebe-a22d467af268_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9dada9353f4c4c89b9f63c374b3460e3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/3.jpg saved to cache
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb4407c0-9d54-5f96-8ebe-a22d467af268
2026-03-27 16:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F77618f8729dc4781b42c24158f05c53d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/6.jpg not downloaded yet
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F77618f8729dc4781b42c24158f05c53d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/7.jpg not downloaded yet
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b3f10>
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9974f90f-e324-5fa4-87d9-81a9392aca61/9974f90f-e324-5fa4-87d9-81a9392aca61_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F09a522532b904846b2bb8b6a90c447ea%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/4.jpg saved to cache
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9974f90f-e324-5fa4-87d9-81a9392aca61
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F77618f8729dc4781b42c24158f05c53d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/8.jpg not downloaded yet
2026-03-27 16:50:02 [ayvens.fr] INFO: Found listing with ID: 1988394
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988394%27 HTTP/1.1" 200 None
2026-03-27 16:50:02 [ayvens.fr] INFO: Scrape type for 1988394: 1
2026-03-27 16:50:02 [ayvens.fr] INFO: Extracting data for car ID: 1988394
2026-03-27 16:50:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3ec4147-a6b3-570e-8e9e-55b05fb926be with identifier: 1988394
2026-03-27 16:50:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3ec4147-a6b3-570e-8e9e-55b05fb926be with scrape type 1
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d3ec4147-a6b3-570e-8e9e-55b05fb926be
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F89a6d60cd9ac4be68f07e85f1d11db97%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/1.jpg not downloaded yet
2026-03-27 16:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F89a6d60cd9ac4be68f07e85f1d11db97%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/2.jpg not downloaded yet
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd00d0>
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9974f90f-e324-5fa4-87d9-81a9392aca61/9974f90f-e324-5fa4-87d9-81a9392aca61_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F09a522532b904846b2bb8b6a90c447ea%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/2.jpg saved to cache
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9974f90f-e324-5fa4-87d9-81a9392aca61
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d580d0>
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9974f90f-e324-5fa4-87d9-81a9392aca61/9974f90f-e324-5fa4-87d9-81a9392aca61_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F09a522532b904846b2bb8b6a90c447ea%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/6.jpg saved to cache
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9974f90f-e324-5fa4-87d9-81a9392aca61
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911a5910>
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9974f90f-e324-5fa4-87d9-81a9392aca61/9974f90f-e324-5fa4-87d9-81a9392aca61_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F09a522532b904846b2bb8b6a90c447ea%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/7.jpg saved to cache
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9974f90f-e324-5fa4-87d9-81a9392aca61
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ed8bd0>
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4407c0-9d54-5f96-8ebe-a22d467af268/fb4407c0-9d54-5f96-8ebe-a22d467af268_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F9dada9353f4c4c89b9f63c374b3460e3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/8.jpg saved to cache
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb4407c0-9d54-5f96-8ebe-a22d467af268
2026-03-27 16:50:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb4407c0-9d54-5f96-8ebe-a22d467af268, skipping ID generation
2026-03-27 16:50:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb4407c0-9d54-5f96-8ebe-a22d467af268 with scrape type 1
2026-03-27 16:50:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb4407c0-9d54-5f96-8ebe-a22d467af268 sending to next pipeline
2026-03-27 16:50:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: fb4407c0-9d54-5f96-8ebe-a22d467af268, identifier: 1988391
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590656d50>
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9974f90f-e324-5fa4-87d9-81a9392aca61/9974f90f-e324-5fa4-87d9-81a9392aca61_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F09a522532b904846b2bb8b6a90c447ea%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/3.jpg saved to cache
2026-03-27 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9974f90f-e324-5fa4-87d9-81a9392aca61
2026-03-27 16:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dafcd0>
2026-03-27 16:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9974f90f-e324-5fa4-87d9-81a9392aca61/9974f90f-e324-5fa4-87d9-81a9392aca61_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F09a522532b904846b2bb8b6a90c447ea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/1.jpg saved to cache
2026-03-27 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9974f90f-e324-5fa4-87d9-81a9392aca61
2026-03-27 16:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590674950>
2026-03-27 16:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9974f90f-e324-5fa4-87d9-81a9392aca61/9974f90f-e324-5fa4-87d9-81a9392aca61_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F09a522532b904846b2bb8b6a90c447ea%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/5.jpg saved to cache
2026-03-27 16:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9974f90f-e324-5fa4-87d9-81a9392aca61
2026-03-27 16:50:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: fb4407c0-9d54-5f96-8ebe-a22d467af268 with identifier: 1988391
2026-03-27 16:50:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: fb4407c0-9d54-5f96-8ebe-a22d467af268 with identifier: 1988391
2026-03-27 16:50:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: fb4407c0-9d54-5f96-8ebe-a22d467af268 with identifier: 1988391 to the API
2026-03-27 16:50:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 30,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'fb4407c0-9d54-5f96-8ebe-a22d467af268',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 103226,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4407c0-9d54-5f96-8ebe-a22d467af268/fb4407c0-9d54-5f96-8ebe-a22d467af268_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 511519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4407c0-9d54-5f96-8ebe-a22d467af268/fb4407c0-9d54-5f96-8ebe-a22d467af268_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 511519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4407c0-9d54-5f96-8ebe-a22d467af268/fb4407c0-9d54-5f96-8ebe-a22d467af268_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 526013,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4407c0-9d54-5f96-8ebe-a22d467af268/fb4407c0-9d54-5f96-8ebe-a22d467af268_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 445908,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4407c0-9d54-5f96-8ebe-a22d467af268/fb4407c0-9d54-5f96-8ebe-a22d467af268_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350935,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4407c0-9d54-5f96-8ebe-a22d467af268/fb4407c0-9d54-5f96-8ebe-a22d467af268_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404807,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4407c0-9d54-5f96-8ebe-a22d467af268/fb4407c0-9d54-5f96-8ebe-a22d467af268_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319542,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4407c0-9d54-5f96-8ebe-a22d467af268/fb4407c0-9d54-5f96-8ebe-a22d467af268_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 449117,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/9dada9353f4c4c89b9f63c374b3460e3/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-25',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CAPTUR Captur 1.6 E-Tech hybride rechargeable 160ch Intens',
'transmission': 'automatic',
'trim': 'Captur 1.6 E-Tech hybride rechargeable 160ch Intens',
'vin': None,
'year': 2021}
2026-03-27 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988391%27 HTTP/1.1" 200 None
2026-03-27 16:50:03 [ayvens.fr] INFO: Saving data for 1988391: {'created_time': 1774630203.970757, 'last_price_update_time': 1774630203.970773, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988391') HTTP/1.1" 204 0
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F89a6d60cd9ac4be68f07e85f1d11db97%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/3.jpg not downloaded yet
2026-03-27 16:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F89a6d60cd9ac4be68f07e85f1d11db97%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/4.jpg not downloaded yet
2026-03-27 16:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906213d0>
2026-03-27 16:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9974f90f-e324-5fa4-87d9-81a9392aca61/9974f90f-e324-5fa4-87d9-81a9392aca61_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F09a522532b904846b2bb8b6a90c447ea%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/8.jpg saved to cache
2026-03-27 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9974f90f-e324-5fa4-87d9-81a9392aca61
2026-03-27 16:50:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9974f90f-e324-5fa4-87d9-81a9392aca61, skipping ID generation
2026-03-27 16:50:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9974f90f-e324-5fa4-87d9-81a9392aca61 with scrape type 1
2026-03-27 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9974f90f-e324-5fa4-87d9-81a9392aca61 sending to next pipeline
2026-03-27 16:50:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9974f90f-e324-5fa4-87d9-81a9392aca61, identifier: 1988392
2026-03-27 16:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F89a6d60cd9ac4be68f07e85f1d11db97%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/5.jpg not downloaded yet
2026-03-27 16:50:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9974f90f-e324-5fa4-87d9-81a9392aca61 with identifier: 1988392
2026-03-27 16:50:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9974f90f-e324-5fa4-87d9-81a9392aca61 with identifier: 1988392
2026-03-27 16:50:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9974f90f-e324-5fa4-87d9-81a9392aca61 with identifier: 1988392 to the API
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'NOIR INTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '9974f90f-e324-5fa4-87d9-81a9392aca61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 57384,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9974f90f-e324-5fa4-87d9-81a9392aca61/9974f90f-e324-5fa4-87d9-81a9392aca61_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382219,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9974f90f-e324-5fa4-87d9-81a9392aca61/9974f90f-e324-5fa4-87d9-81a9392aca61_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382219,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9974f90f-e324-5fa4-87d9-81a9392aca61/9974f90f-e324-5fa4-87d9-81a9392aca61_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373991,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9974f90f-e324-5fa4-87d9-81a9392aca61/9974f90f-e324-5fa4-87d9-81a9392aca61_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349416,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9974f90f-e324-5fa4-87d9-81a9392aca61/9974f90f-e324-5fa4-87d9-81a9392aca61_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332879,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9974f90f-e324-5fa4-87d9-81a9392aca61/9974f90f-e324-5fa4-87d9-81a9392aca61_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304932,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9974f90f-e324-5fa4-87d9-81a9392aca61/9974f90f-e324-5fa4-87d9-81a9392aca61_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302731,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9974f90f-e324-5fa4-87d9-81a9392aca61/9974f90f-e324-5fa4-87d9-81a9392aca61_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 224823,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/09a522532b904846b2bb8b6a90c447ea/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN POLO Polo 1.0 TSI 95ch Style',
'transmission': 'manual',
'trim': 'Polo 1.0 TSI 95ch Style',
'vin': None,
'year': 2023}
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988392%27 HTTP/1.1" 200 None
2026-03-27 16:50:04 [ayvens.fr] INFO: Saving data for 1988392: {'created_time': 1774630204.671258, 'last_price_update_time': 1774630204.671276, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988392') HTTP/1.1" 204 0
2026-03-27 16:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F89a6d60cd9ac4be68f07e85f1d11db97%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/6.jpg not downloaded yet
2026-03-27 16:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c9c10>
2026-03-27 16:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5806eaf6-7187-547b-a6f4-7d6dba8ab3ee/5806eaf6-7187-547b-a6f4-7d6dba8ab3ee_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F77618f8729dc4781b42c24158f05c53d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/2.jpg saved to cache
2026-03-27 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5806eaf6-7187-547b-a6f4-7d6dba8ab3ee
2026-03-27 16:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59120bf90>
2026-03-27 16:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5806eaf6-7187-547b-a6f4-7d6dba8ab3ee/5806eaf6-7187-547b-a6f4-7d6dba8ab3ee_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F77618f8729dc4781b42c24158f05c53d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/4.jpg saved to cache
2026-03-27 16:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5806eaf6-7187-547b-a6f4-7d6dba8ab3ee
2026-03-27 16:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f63110>
2026-03-27 16:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5806eaf6-7187-547b-a6f4-7d6dba8ab3ee/5806eaf6-7187-547b-a6f4-7d6dba8ab3ee_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F77618f8729dc4781b42c24158f05c53d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/5.jpg saved to cache
2026-03-27 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5806eaf6-7187-547b-a6f4-7d6dba8ab3ee
2026-03-27 16:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590daf550>
2026-03-27 16:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5806eaf6-7187-547b-a6f4-7d6dba8ab3ee/5806eaf6-7187-547b-a6f4-7d6dba8ab3ee_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F77618f8729dc4781b42c24158f05c53d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/3.jpg saved to cache
2026-03-27 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5806eaf6-7187-547b-a6f4-7d6dba8ab3ee
2026-03-27 16:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591051a10>
2026-03-27 16:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5806eaf6-7187-547b-a6f4-7d6dba8ab3ee/5806eaf6-7187-547b-a6f4-7d6dba8ab3ee_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F77618f8729dc4781b42c24158f05c53d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/6.jpg saved to cache
2026-03-27 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5806eaf6-7187-547b-a6f4-7d6dba8ab3ee
2026-03-27 16:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590512d50>
2026-03-27 16:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5806eaf6-7187-547b-a6f4-7d6dba8ab3ee/5806eaf6-7187-547b-a6f4-7d6dba8ab3ee_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F77618f8729dc4781b42c24158f05c53d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/7.jpg saved to cache
2026-03-27 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5806eaf6-7187-547b-a6f4-7d6dba8ab3ee
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F89a6d60cd9ac4be68f07e85f1d11db97%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/7.jpg not downloaded yet
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F89a6d60cd9ac4be68f07e85f1d11db97%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/8.jpg not downloaded yet
2026-03-27 16:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591180d50>
2026-03-27 16:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5806eaf6-7187-547b-a6f4-7d6dba8ab3ee/5806eaf6-7187-547b-a6f4-7d6dba8ab3ee_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F77618f8729dc4781b42c24158f05c53d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/1.jpg saved to cache
2026-03-27 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5806eaf6-7187-547b-a6f4-7d6dba8ab3ee
2026-03-27 16:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d58890>
2026-03-27 16:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5806eaf6-7187-547b-a6f4-7d6dba8ab3ee/5806eaf6-7187-547b-a6f4-7d6dba8ab3ee_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F77618f8729dc4781b42c24158f05c53d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/8.jpg saved to cache
2026-03-27 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5806eaf6-7187-547b-a6f4-7d6dba8ab3ee
2026-03-27 16:50:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5806eaf6-7187-547b-a6f4-7d6dba8ab3ee, skipping ID generation
2026-03-27 16:50:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5806eaf6-7187-547b-a6f4-7d6dba8ab3ee with scrape type 1
2026-03-27 16:50:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5806eaf6-7187-547b-a6f4-7d6dba8ab3ee sending to next pipeline
2026-03-27 16:50:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5806eaf6-7187-547b-a6f4-7d6dba8ab3ee, identifier: 1988393
2026-03-27 16:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5806eaf6-7187-547b-a6f4-7d6dba8ab3ee with identifier: 1988393
2026-03-27 16:50:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5806eaf6-7187-547b-a6f4-7d6dba8ab3ee with identifier: 1988393
2026-03-27 16:50:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5806eaf6-7187-547b-a6f4-7d6dba8ab3ee with identifier: 1988393 to the API
2026-03-27 16:50:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '5806eaf6-7187-547b-a6f4-7d6dba8ab3ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 42758,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5806eaf6-7187-547b-a6f4-7d6dba8ab3ee/5806eaf6-7187-547b-a6f4-7d6dba8ab3ee_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343614,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5806eaf6-7187-547b-a6f4-7d6dba8ab3ee/5806eaf6-7187-547b-a6f4-7d6dba8ab3ee_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343614,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5806eaf6-7187-547b-a6f4-7d6dba8ab3ee/5806eaf6-7187-547b-a6f4-7d6dba8ab3ee_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321774,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5806eaf6-7187-547b-a6f4-7d6dba8ab3ee/5806eaf6-7187-547b-a6f4-7d6dba8ab3ee_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275857,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5806eaf6-7187-547b-a6f4-7d6dba8ab3ee/5806eaf6-7187-547b-a6f4-7d6dba8ab3ee_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357669,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5806eaf6-7187-547b-a6f4-7d6dba8ab3ee/5806eaf6-7187-547b-a6f4-7d6dba8ab3ee_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294240,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5806eaf6-7187-547b-a6f4-7d6dba8ab3ee/5806eaf6-7187-547b-a6f4-7d6dba8ab3ee_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294944,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5806eaf6-7187-547b-a6f4-7d6dba8ab3ee/5806eaf6-7187-547b-a6f4-7d6dba8ab3ee_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279507,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/77618f8729dc4781b42c24158f05c53d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-24',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 100ch S&S Active Pack',
'transmission': 'manual',
'trim': '2008 1.2 PureTech 100ch S&S Active Pack',
'vin': None,
'year': 2022}
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988393%27 HTTP/1.1" 200 None
2026-03-27 16:50:06 [ayvens.fr] INFO: Saving data for 1988393: {'created_time': 1774630206.348635, 'last_price_update_time': 1774630206.348649, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988393') HTTP/1.1" 204 0
2026-03-27 16:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:06 [ayvens.fr] INFO: Found listing with ID: 1988395
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988395%27 HTTP/1.1" 200 None
2026-03-27 16:50:06 [ayvens.fr] INFO: Scrape type for 1988395: 1
2026-03-27 16:50:06 [ayvens.fr] INFO: Extracting data for car ID: 1988395
2026-03-27 16:50:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d797b69e-3077-5b1e-88cd-e6bd15baf375 with identifier: 1988395
2026-03-27 16:50:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d797b69e-3077-5b1e-88cd-e6bd15baf375 with scrape type 1
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d797b69e-3077-5b1e-88cd-e6bd15baf375
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fej-%252Fc4271303a4c74a20b8ae2903c6ad98cf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/1.jpg not downloaded yet
2026-03-27 16:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fej-%252Fc4271303a4c74a20b8ae2903c6ad98cf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/2.jpg not downloaded yet
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59063cd10>
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ec4147-a6b3-570e-8e9e-55b05fb926be/d3ec4147-a6b3-570e-8e9e-55b05fb926be_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F89a6d60cd9ac4be68f07e85f1d11db97%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/1.jpg saved to cache
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3ec4147-a6b3-570e-8e9e-55b05fb926be
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fej-%252Fc4271303a4c74a20b8ae2903c6ad98cf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/3.jpg not downloaded yet
2026-03-27 16:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:06 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 3 pages/min), scraped 196 items (at 43 items/min)
2026-03-27 16:50:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fej-%252Fc4271303a4c74a20b8ae2903c6ad98cf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/4.jpg not downloaded yet
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b36e90>
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ec4147-a6b3-570e-8e9e-55b05fb926be/d3ec4147-a6b3-570e-8e9e-55b05fb926be_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F89a6d60cd9ac4be68f07e85f1d11db97%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/2.jpg saved to cache
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3ec4147-a6b3-570e-8e9e-55b05fb926be
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4c310>
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ec4147-a6b3-570e-8e9e-55b05fb926be/d3ec4147-a6b3-570e-8e9e-55b05fb926be_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F89a6d60cd9ac4be68f07e85f1d11db97%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/4.jpg saved to cache
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3ec4147-a6b3-570e-8e9e-55b05fb926be
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d45b50>
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ec4147-a6b3-570e-8e9e-55b05fb926be/d3ec4147-a6b3-570e-8e9e-55b05fb926be_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F89a6d60cd9ac4be68f07e85f1d11db97%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/3.jpg saved to cache
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3ec4147-a6b3-570e-8e9e-55b05fb926be
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fej-%252Fc4271303a4c74a20b8ae2903c6ad98cf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/5.jpg not downloaded yet
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fej-%252Fc4271303a4c74a20b8ae2903c6ad98cf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/6.jpg not downloaded yet
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4e510>
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ec4147-a6b3-570e-8e9e-55b05fb926be/d3ec4147-a6b3-570e-8e9e-55b05fb926be_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F89a6d60cd9ac4be68f07e85f1d11db97%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/5.jpg saved to cache
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3ec4147-a6b3-570e-8e9e-55b05fb926be
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b59450>
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ec4147-a6b3-570e-8e9e-55b05fb926be/d3ec4147-a6b3-570e-8e9e-55b05fb926be_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F89a6d60cd9ac4be68f07e85f1d11db97%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/6.jpg saved to cache
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3ec4147-a6b3-570e-8e9e-55b05fb926be
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fej-%252Fc4271303a4c74a20b8ae2903c6ad98cf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/7.jpg not downloaded yet
2026-03-27 16:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fej-%252Fc4271303a4c74a20b8ae2903c6ad98cf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/8.jpg not downloaded yet
2026-03-27 16:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:06 [ayvens.fr] INFO: Found listing with ID: 1988396
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988396%27 HTTP/1.1" 200 None
2026-03-27 16:50:06 [ayvens.fr] INFO: Scrape type for 1988396: 1
2026-03-27 16:50:06 [ayvens.fr] INFO: Extracting data for car ID: 1988396
2026-03-27 16:50:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9561d77-dcb7-5509-9c57-ec7e32fbc31e with identifier: 1988396
2026-03-27 16:50:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9561d77-dcb7-5509-9c57-ec7e32fbc31e with scrape type 1
2026-03-27 16:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f9561d77-dcb7-5509-9c57-ec7e32fbc31e
2026-03-27 16:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fb5ec7e53503d4cb4acff483f7b0923b9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/1.jpg not downloaded yet
2026-03-27 16:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fb5ec7e53503d4cb4acff483f7b0923b9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/2.jpg not downloaded yet
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fb5ec7e53503d4cb4acff483f7b0923b9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/3.jpg not downloaded yet
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fb5ec7e53503d4cb4acff483f7b0923b9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/4.jpg not downloaded yet
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d40610>
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d797b69e-3077-5b1e-88cd-e6bd15baf375/d797b69e-3077-5b1e-88cd-e6bd15baf375_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fej-%252Fc4271303a4c74a20b8ae2903c6ad98cf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/2.jpg saved to cache
2026-03-27 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d797b69e-3077-5b1e-88cd-e6bd15baf375
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591181750>
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d797b69e-3077-5b1e-88cd-e6bd15baf375/d797b69e-3077-5b1e-88cd-e6bd15baf375_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fej-%252Fc4271303a4c74a20b8ae2903c6ad98cf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/1.jpg saved to cache
2026-03-27 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d797b69e-3077-5b1e-88cd-e6bd15baf375
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fb5ec7e53503d4cb4acff483f7b0923b9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/5.jpg not downloaded yet
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b61550>
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ec4147-a6b3-570e-8e9e-55b05fb926be/d3ec4147-a6b3-570e-8e9e-55b05fb926be_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F89a6d60cd9ac4be68f07e85f1d11db97%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/8.jpg saved to cache
2026-03-27 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3ec4147-a6b3-570e-8e9e-55b05fb926be
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590afc0d0>
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ec4147-a6b3-570e-8e9e-55b05fb926be/d3ec4147-a6b3-570e-8e9e-55b05fb926be_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F89a6d60cd9ac4be68f07e85f1d11db97%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/7.jpg saved to cache
2026-03-27 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3ec4147-a6b3-570e-8e9e-55b05fb926be
2026-03-27 16:50:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3ec4147-a6b3-570e-8e9e-55b05fb926be, skipping ID generation
2026-03-27 16:50:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3ec4147-a6b3-570e-8e9e-55b05fb926be with scrape type 1
2026-03-27 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3ec4147-a6b3-570e-8e9e-55b05fb926be sending to next pipeline
2026-03-27 16:50:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d3ec4147-a6b3-570e-8e9e-55b05fb926be, identifier: 1988394
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fb5ec7e53503d4cb4acff483f7b0923b9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/6.jpg not downloaded yet
2026-03-27 16:50:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d3ec4147-a6b3-570e-8e9e-55b05fb926be with identifier: 1988394
2026-03-27 16:50:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d3ec4147-a6b3-570e-8e9e-55b05fb926be with identifier: 1988394
2026-03-27 16:50:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d3ec4147-a6b3-570e-8e9e-55b05fb926be with identifier: 1988394 to the API
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'd3ec4147-a6b3-570e-8e9e-55b05fb926be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KADJAR',
'odometer': 70519,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ec4147-a6b3-570e-8e9e-55b05fb926be/d3ec4147-a6b3-570e-8e9e-55b05fb926be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424229,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ec4147-a6b3-570e-8e9e-55b05fb926be/d3ec4147-a6b3-570e-8e9e-55b05fb926be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424229,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ec4147-a6b3-570e-8e9e-55b05fb926be/d3ec4147-a6b3-570e-8e9e-55b05fb926be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383203,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ec4147-a6b3-570e-8e9e-55b05fb926be/d3ec4147-a6b3-570e-8e9e-55b05fb926be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367054,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ec4147-a6b3-570e-8e9e-55b05fb926be/d3ec4147-a6b3-570e-8e9e-55b05fb926be_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353139,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ec4147-a6b3-570e-8e9e-55b05fb926be/d3ec4147-a6b3-570e-8e9e-55b05fb926be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362110,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ec4147-a6b3-570e-8e9e-55b05fb926be/d3ec4147-a6b3-570e-8e9e-55b05fb926be_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319422,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ec4147-a6b3-570e-8e9e-55b05fb926be/d3ec4147-a6b3-570e-8e9e-55b05fb926be_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402183,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/89a6d60cd9ac4be68f07e85f1d11db97/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-03',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT KADJAR Kadjar 1.3 TCe 140ch FAP Business 130g',
'transmission': 'manual',
'trim': 'Kadjar 1.3 TCe 140ch FAP Business 130g',
'vin': None,
'year': 2019}
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988394%27 HTTP/1.1" 200 None
2026-03-27 16:50:07 [ayvens.fr] INFO: Saving data for 1988394: {'created_time': 1774630207.89564, 'last_price_update_time': 1774630207.895652, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988394') HTTP/1.1" 204 0
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fb5ec7e53503d4cb4acff483f7b0923b9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/7.jpg not downloaded yet
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d2810>
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d797b69e-3077-5b1e-88cd-e6bd15baf375/d797b69e-3077-5b1e-88cd-e6bd15baf375_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fej-%252Fc4271303a4c74a20b8ae2903c6ad98cf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/3.jpg saved to cache
2026-03-27 16:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d797b69e-3077-5b1e-88cd-e6bd15baf375
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d58290>
2026-03-27 16:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d797b69e-3077-5b1e-88cd-e6bd15baf375/d797b69e-3077-5b1e-88cd-e6bd15baf375_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fej-%252Fc4271303a4c74a20b8ae2903c6ad98cf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/4.jpg saved to cache
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d797b69e-3077-5b1e-88cd-e6bd15baf375
2026-03-27 16:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fb5ec7e53503d4cb4acff483f7b0923b9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/8.jpg not downloaded yet
2026-03-27 16:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:08 [ayvens.fr] INFO: Found listing with ID: 1988397
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988397%27 HTTP/1.1" 200 None
2026-03-27 16:50:08 [ayvens.fr] INFO: Scrape type for 1988397: 1
2026-03-27 16:50:08 [ayvens.fr] INFO: Extracting data for car ID: 1988397
2026-03-27 16:50:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a8ce85b-e195-56d6-a431-1cef7bd0fe85 with identifier: 1988397
2026-03-27 16:50:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a8ce85b-e195-56d6-a431-1cef7bd0fe85 with scrape type 1
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0a8ce85b-e195-56d6-a431-1cef7bd0fe85
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F87b148a7f8384aa2a74552f12c57a07d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/1.jpg not downloaded yet
2026-03-27 16:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F87b148a7f8384aa2a74552f12c57a07d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/2.jpg not downloaded yet
2026-03-27 16:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F87b148a7f8384aa2a74552f12c57a07d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/3.jpg not downloaded yet
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ac4710>
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d797b69e-3077-5b1e-88cd-e6bd15baf375/d797b69e-3077-5b1e-88cd-e6bd15baf375_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fej-%252Fc4271303a4c74a20b8ae2903c6ad98cf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/7.jpg saved to cache
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d797b69e-3077-5b1e-88cd-e6bd15baf375
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0e2d0>
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d797b69e-3077-5b1e-88cd-e6bd15baf375/d797b69e-3077-5b1e-88cd-e6bd15baf375_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fej-%252Fc4271303a4c74a20b8ae2903c6ad98cf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/6.jpg saved to cache
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d797b69e-3077-5b1e-88cd-e6bd15baf375
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e8ced0>
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d797b69e-3077-5b1e-88cd-e6bd15baf375/d797b69e-3077-5b1e-88cd-e6bd15baf375_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fej-%252Fc4271303a4c74a20b8ae2903c6ad98cf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/5.jpg saved to cache
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d797b69e-3077-5b1e-88cd-e6bd15baf375
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dbba50>
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d797b69e-3077-5b1e-88cd-e6bd15baf375/d797b69e-3077-5b1e-88cd-e6bd15baf375_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fej-%252Fc4271303a4c74a20b8ae2903c6ad98cf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/8.jpg saved to cache
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d797b69e-3077-5b1e-88cd-e6bd15baf375
2026-03-27 16:50:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d797b69e-3077-5b1e-88cd-e6bd15baf375, skipping ID generation
2026-03-27 16:50:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d797b69e-3077-5b1e-88cd-e6bd15baf375 with scrape type 1
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d797b69e-3077-5b1e-88cd-e6bd15baf375 sending to next pipeline
2026-03-27 16:50:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d797b69e-3077-5b1e-88cd-e6bd15baf375, identifier: 1988395
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4c0d0>
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9561d77-dcb7-5509-9c57-ec7e32fbc31e/f9561d77-dcb7-5509-9c57-ec7e32fbc31e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fb5ec7e53503d4cb4acff483f7b0923b9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/1.jpg saved to cache
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9561d77-dcb7-5509-9c57-ec7e32fbc31e
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d423d0>
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9561d77-dcb7-5509-9c57-ec7e32fbc31e/f9561d77-dcb7-5509-9c57-ec7e32fbc31e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fb5ec7e53503d4cb4acff483f7b0923b9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/2.jpg saved to cache
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f9561d77-dcb7-5509-9c57-ec7e32fbc31e
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F87b148a7f8384aa2a74552f12c57a07d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/4.jpg not downloaded yet
2026-03-27 16:50:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d797b69e-3077-5b1e-88cd-e6bd15baf375 with identifier: 1988395
2026-03-27 16:50:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d797b69e-3077-5b1e-88cd-e6bd15baf375 with identifier: 1988395
2026-03-27 16:50:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d797b69e-3077-5b1e-88cd-e6bd15baf375 with identifier: 1988395 to the API
2026-03-27 16:50:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 79,
'color': 'NOIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'd797b69e-3077-5b1e-88cd-e6bd15baf375',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 46071,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d797b69e-3077-5b1e-88cd-e6bd15baf375/d797b69e-3077-5b1e-88cd-e6bd15baf375_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d797b69e-3077-5b1e-88cd-e6bd15baf375/d797b69e-3077-5b1e-88cd-e6bd15baf375_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d797b69e-3077-5b1e-88cd-e6bd15baf375/d797b69e-3077-5b1e-88cd-e6bd15baf375_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d797b69e-3077-5b1e-88cd-e6bd15baf375/d797b69e-3077-5b1e-88cd-e6bd15baf375_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353135,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d797b69e-3077-5b1e-88cd-e6bd15baf375/d797b69e-3077-5b1e-88cd-e6bd15baf375_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349060,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d797b69e-3077-5b1e-88cd-e6bd15baf375/d797b69e-3077-5b1e-88cd-e6bd15baf375_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298191,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d797b69e-3077-5b1e-88cd-e6bd15baf375/d797b69e-3077-5b1e-88cd-e6bd15baf375_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283192,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d797b69e-3077-5b1e-88cd-e6bd15baf375/d797b69e-3077-5b1e-88cd-e6bd15baf375_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348743,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ej-/c4271303a4c74a20b8ae2903c6ad98cf/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-08',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.6 BlueHDi 100ch Allure Business S&S 5p',
'transmission': 'manual',
'trim': '208 1.6 BlueHDi 100ch Allure Business S&S 5p',
'vin': None,
'year': 2017}
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988395%27 HTTP/1.1" 200 None
2026-03-27 16:50:09 [ayvens.fr] INFO: Saving data for 1988395: {'created_time': 1774630209.372791, 'last_price_update_time': 1774630209.372805, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988395') HTTP/1.1" 204 0
2026-03-27 16:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dbbc90>
2026-03-27 16:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9561d77-dcb7-5509-9c57-ec7e32fbc31e/f9561d77-dcb7-5509-9c57-ec7e32fbc31e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fb5ec7e53503d4cb4acff483f7b0923b9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/3.jpg saved to cache
2026-03-27 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f9561d77-dcb7-5509-9c57-ec7e32fbc31e
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F87b148a7f8384aa2a74552f12c57a07d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/5.jpg not downloaded yet
2026-03-27 16:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590518450>
2026-03-27 16:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9561d77-dcb7-5509-9c57-ec7e32fbc31e/f9561d77-dcb7-5509-9c57-ec7e32fbc31e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fb5ec7e53503d4cb4acff483f7b0923b9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/4.jpg saved to cache
2026-03-27 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f9561d77-dcb7-5509-9c57-ec7e32fbc31e
2026-03-27 16:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F87b148a7f8384aa2a74552f12c57a07d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/6.jpg not downloaded yet
2026-03-27 16:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F87b148a7f8384aa2a74552f12c57a07d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/7.jpg not downloaded yet
2026-03-27 16:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F87b148a7f8384aa2a74552f12c57a07d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/8.jpg not downloaded yet
2026-03-27 16:50:09 [ayvens.fr] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 200
2026-03-27 16:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 16:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906578d0>
2026-03-27 16:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9561d77-dcb7-5509-9c57-ec7e32fbc31e/f9561d77-dcb7-5509-9c57-ec7e32fbc31e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fb5ec7e53503d4cb4acff483f7b0923b9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/5.jpg saved to cache
2026-03-27 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f9561d77-dcb7-5509-9c57-ec7e32fbc31e
2026-03-27 16:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592870b10>
2026-03-27 16:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9561d77-dcb7-5509-9c57-ec7e32fbc31e/f9561d77-dcb7-5509-9c57-ec7e32fbc31e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fb5ec7e53503d4cb4acff483f7b0923b9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/6.jpg saved to cache
2026-03-27 16:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f9561d77-dcb7-5509-9c57-ec7e32fbc31e
2026-03-27 16:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d62fd0>
2026-03-27 16:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9561d77-dcb7-5509-9c57-ec7e32fbc31e/f9561d77-dcb7-5509-9c57-ec7e32fbc31e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fb5ec7e53503d4cb4acff483f7b0923b9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/7.jpg saved to cache
2026-03-27 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f9561d77-dcb7-5509-9c57-ec7e32fbc31e
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59102cc10>
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9561d77-dcb7-5509-9c57-ec7e32fbc31e/f9561d77-dcb7-5509-9c57-ec7e32fbc31e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fb5ec7e53503d4cb4acff483f7b0923b9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/8.jpg saved to cache
2026-03-27 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f9561d77-dcb7-5509-9c57-ec7e32fbc31e
2026-03-27 16:50:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9561d77-dcb7-5509-9c57-ec7e32fbc31e, skipping ID generation
2026-03-27 16:50:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9561d77-dcb7-5509-9c57-ec7e32fbc31e with scrape type 1
2026-03-27 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9561d77-dcb7-5509-9c57-ec7e32fbc31e sending to next pipeline
2026-03-27 16:50:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f9561d77-dcb7-5509-9c57-ec7e32fbc31e, identifier: 1988396
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f61b10>
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a8ce85b-e195-56d6-a431-1cef7bd0fe85/0a8ce85b-e195-56d6-a431-1cef7bd0fe85_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F87b148a7f8384aa2a74552f12c57a07d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/1.jpg saved to cache
2026-03-27 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a8ce85b-e195-56d6-a431-1cef7bd0fe85
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b6be50>
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a8ce85b-e195-56d6-a431-1cef7bd0fe85/0a8ce85b-e195-56d6-a431-1cef7bd0fe85_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F87b148a7f8384aa2a74552f12c57a07d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/2.jpg saved to cache
2026-03-27 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0a8ce85b-e195-56d6-a431-1cef7bd0fe85
2026-03-27 16:50:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f9561d77-dcb7-5509-9c57-ec7e32fbc31e with identifier: 1988396
2026-03-27 16:50:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:50:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f9561d77-dcb7-5509-9c57-ec7e32fbc31e with identifier: 1988396
2026-03-27 16:50:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f9561d77-dcb7-5509-9c57-ec7e32fbc31e with identifier: 1988396 to the API
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'NOIR PERLA NERA NACRE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': 'f9561d77-dcb7-5509-9c57-ec7e32fbc31e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'E-BERLINGO',
'odometer': 40311,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9561d77-dcb7-5509-9c57-ec7e32fbc31e/f9561d77-dcb7-5509-9c57-ec7e32fbc31e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403164,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9561d77-dcb7-5509-9c57-ec7e32fbc31e/f9561d77-dcb7-5509-9c57-ec7e32fbc31e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403164,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9561d77-dcb7-5509-9c57-ec7e32fbc31e/f9561d77-dcb7-5509-9c57-ec7e32fbc31e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510786,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9561d77-dcb7-5509-9c57-ec7e32fbc31e/f9561d77-dcb7-5509-9c57-ec7e32fbc31e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444969,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9561d77-dcb7-5509-9c57-ec7e32fbc31e/f9561d77-dcb7-5509-9c57-ec7e32fbc31e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422270,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9561d77-dcb7-5509-9c57-ec7e32fbc31e/f9561d77-dcb7-5509-9c57-ec7e32fbc31e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332977,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9561d77-dcb7-5509-9c57-ec7e32fbc31e/f9561d77-dcb7-5509-9c57-ec7e32fbc31e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274628,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9561d77-dcb7-5509-9c57-ec7e32fbc31e/f9561d77-dcb7-5509-9c57-ec7e32fbc31e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 466149,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/b5ec7e53503d4cb4acff483f7b0923b9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN E-BERLINGO Berlingo M Moteur Electrique 136ch (100 kW) '
'Shine Automatique',
'transmission': 'automatic',
'trim': 'Berlingo M Moteur Electrique 136ch (100 kW) Shine Automatique',
'vin': None,
'year': 2023}
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988396%27 HTTP/1.1" 200 None
2026-03-27 16:50:10 [ayvens.fr] INFO: Saving data for 1988396: {'created_time': 1774630210.662604, 'last_price_update_time': 1774630210.662615, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988396') HTTP/1.1" 204 0
2026-03-27 16:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae8e10>
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a8ce85b-e195-56d6-a431-1cef7bd0fe85/0a8ce85b-e195-56d6-a431-1cef7bd0fe85_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F87b148a7f8384aa2a74552f12c57a07d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/3.jpg saved to cache
2026-03-27 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0a8ce85b-e195-56d6-a431-1cef7bd0fe85
2026-03-27 16:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59103c5d0>
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a8ce85b-e195-56d6-a431-1cef7bd0fe85/0a8ce85b-e195-56d6-a431-1cef7bd0fe85_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F87b148a7f8384aa2a74552f12c57a07d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/4.jpg saved to cache
2026-03-27 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0a8ce85b-e195-56d6-a431-1cef7bd0fe85
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591052490>
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a8ce85b-e195-56d6-a431-1cef7bd0fe85/0a8ce85b-e195-56d6-a431-1cef7bd0fe85_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F87b148a7f8384aa2a74552f12c57a07d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/8.jpg saved to cache
2026-03-27 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0a8ce85b-e195-56d6-a431-1cef7bd0fe85
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c2a50>
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a8ce85b-e195-56d6-a431-1cef7bd0fe85/0a8ce85b-e195-56d6-a431-1cef7bd0fe85_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F87b148a7f8384aa2a74552f12c57a07d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/7.jpg saved to cache
2026-03-27 16:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0a8ce85b-e195-56d6-a431-1cef7bd0fe85
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904fc050>
2026-03-27 16:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a8ce85b-e195-56d6-a431-1cef7bd0fe85/0a8ce85b-e195-56d6-a431-1cef7bd0fe85_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F87b148a7f8384aa2a74552f12c57a07d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/6.jpg saved to cache
2026-03-27 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0a8ce85b-e195-56d6-a431-1cef7bd0fe85
2026-03-27 16:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591208310>
2026-03-27 16:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a8ce85b-e195-56d6-a431-1cef7bd0fe85/0a8ce85b-e195-56d6-a431-1cef7bd0fe85_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F87b148a7f8384aa2a74552f12c57a07d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/5.jpg saved to cache
2026-03-27 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0a8ce85b-e195-56d6-a431-1cef7bd0fe85
2026-03-27 16:50:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a8ce85b-e195-56d6-a431-1cef7bd0fe85, skipping ID generation
2026-03-27 16:50:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a8ce85b-e195-56d6-a431-1cef7bd0fe85 with scrape type 1
2026-03-27 16:50:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a8ce85b-e195-56d6-a431-1cef7bd0fe85 sending to next pipeline
2026-03-27 16:50:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0a8ce85b-e195-56d6-a431-1cef7bd0fe85, identifier: 1988397
2026-03-27 16:50:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0a8ce85b-e195-56d6-a431-1cef7bd0fe85 with identifier: 1988397
2026-03-27 16:50:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0a8ce85b-e195-56d6-a431-1cef7bd0fe85 with identifier: 1988397
2026-03-27 16:50:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0a8ce85b-e195-56d6-a431-1cef7bd0fe85 with identifier: 1988397 to the API
2026-03-27 16:50:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/diesel',
'id': '0a8ce85b-e195-56d6-a431-1cef7bd0fe85',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'TUCSON',
'odometer': 118497,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a8ce85b-e195-56d6-a431-1cef7bd0fe85/0a8ce85b-e195-56d6-a431-1cef7bd0fe85_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 503274,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a8ce85b-e195-56d6-a431-1cef7bd0fe85/0a8ce85b-e195-56d6-a431-1cef7bd0fe85_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 503274,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a8ce85b-e195-56d6-a431-1cef7bd0fe85/0a8ce85b-e195-56d6-a431-1cef7bd0fe85_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371955,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a8ce85b-e195-56d6-a431-1cef7bd0fe85/0a8ce85b-e195-56d6-a431-1cef7bd0fe85_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384511,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a8ce85b-e195-56d6-a431-1cef7bd0fe85/0a8ce85b-e195-56d6-a431-1cef7bd0fe85_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404656,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a8ce85b-e195-56d6-a431-1cef7bd0fe85/0a8ce85b-e195-56d6-a431-1cef7bd0fe85_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328517,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a8ce85b-e195-56d6-a431-1cef7bd0fe85/0a8ce85b-e195-56d6-a431-1cef7bd0fe85_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364728,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a8ce85b-e195-56d6-a431-1cef7bd0fe85/0a8ce85b-e195-56d6-a431-1cef7bd0fe85_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372378,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/87b148a7f8384aa2a74552f12c57a07d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-20',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI TUCSON Tucson 1.6 CRDI 136ch Hybrid 48V Business DCT7',
'transmission': 'automatic',
'trim': 'Tucson 1.6 CRDI 136ch Hybrid 48V Business DCT7',
'vin': None,
'year': 2023}
2026-03-27 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988397%27 HTTP/1.1" 200 None
2026-03-27 16:50:11 [ayvens.fr] INFO: Saving data for 1988397: {'created_time': 1774630211.524055, 'last_price_update_time': 1774630211.524067, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988397') HTTP/1.1" 204 0
2026-03-27 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 16:50:12 [ayvens.fr] INFO: Found listing with ID: 1988398
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988398%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [ayvens.fr] INFO: Scrape type for 1988398: 1
2026-03-27 16:50:12 [ayvens.fr] INFO: Extracting data for car ID: 1988398
2026-03-27 16:50:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f654ceda-166d-52a2-9d46-b5ae3c8cbc58 with identifier: 1988398
2026-03-27 16:50:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f654ceda-166d-52a2-9d46-b5ae3c8cbc58 with scrape type 1
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f654ceda-166d-52a2-9d46-b5ae3c8cbc58
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fcd86f1e641d94ca1a555167f748632e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/1.jpg not downloaded yet
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fcd86f1e641d94ca1a555167f748632e7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/2.jpg not downloaded yet
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fcd86f1e641d94ca1a555167f748632e7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/3.jpg not downloaded yet
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fcd86f1e641d94ca1a555167f748632e7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/4.jpg not downloaded yet
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fcd86f1e641d94ca1a555167f748632e7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/5.jpg not downloaded yet
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fcd86f1e641d94ca1a555167f748632e7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/6.jpg not downloaded yet
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fcd86f1e641d94ca1a555167f748632e7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/7.jpg not downloaded yet
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fcd86f1e641d94ca1a555167f748632e7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/8.jpg not downloaded yet
2026-03-27 16:50:12 [ayvens.fr] INFO: Found listing with ID: 1988399
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988399%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [ayvens.fr] INFO: Scrape type for 1988399: 1
2026-03-27 16:50:12 [ayvens.fr] INFO: Extracting data for car ID: 1988399
2026-03-27 16:50:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b17c1f3-d2ad-5384-86d8-d803ad584b52 with identifier: 1988399
2026-03-27 16:50:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b17c1f3-d2ad-5384-86d8-d803ad584b52 with scrape type 1
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6b17c1f3-d2ad-5384-86d8-d803ad584b52
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd1a0e987cbd43cf84198c7cb8d2e674%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/1.jpg not downloaded yet
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd1a0e987cbd43cf84198c7cb8d2e674%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/2.jpg not downloaded yet
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd1a0e987cbd43cf84198c7cb8d2e674%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/3.jpg not downloaded yet
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd1a0e987cbd43cf84198c7cb8d2e674%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/4.jpg not downloaded yet
2026-03-27 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd1a0e987cbd43cf84198c7cb8d2e674%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/5.jpg not downloaded yet
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd1a0e987cbd43cf84198c7cb8d2e674%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/6.jpg not downloaded yet
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd1a0e987cbd43cf84198c7cb8d2e674%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/7.jpg not downloaded yet
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd1a0e987cbd43cf84198c7cb8d2e674%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/8.jpg not downloaded yet
2026-03-27 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:12 [ayvens.fr] INFO: Found listing with ID: 1988400
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988400%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [ayvens.fr] INFO: Scrape type for 1988400: 1
2026-03-27 16:50:12 [ayvens.fr] INFO: Extracting data for car ID: 1988400
2026-03-27 16:50:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5a6c87b-c3e1-5bee-a30f-ca56b8a83351 with identifier: 1988400
2026-03-27 16:50:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5a6c87b-c3e1-5bee-a30f-ca56b8a83351 with scrape type 1
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f5a6c87b-c3e1-5bee-a30f-ca56b8a83351
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Facd968d806894227b045c8e0855369aa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/1.jpg not downloaded yet
2026-03-27 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Facd968d806894227b045c8e0855369aa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/2.jpg not downloaded yet
2026-03-27 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dff810>
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f654ceda-166d-52a2-9d46-b5ae3c8cbc58/f654ceda-166d-52a2-9d46-b5ae3c8cbc58_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fcd86f1e641d94ca1a555167f748632e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/1.jpg saved to cache
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f654ceda-166d-52a2-9d46-b5ae3c8cbc58
2026-03-27 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Facd968d806894227b045c8e0855369aa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/3.jpg not downloaded yet
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Facd968d806894227b045c8e0855369aa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/4.jpg not downloaded yet
2026-03-27 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Facd968d806894227b045c8e0855369aa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/5.jpg not downloaded yet
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b280d0>
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f654ceda-166d-52a2-9d46-b5ae3c8cbc58/f654ceda-166d-52a2-9d46-b5ae3c8cbc58_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fcd86f1e641d94ca1a555167f748632e7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/2.jpg saved to cache
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f654ceda-166d-52a2-9d46-b5ae3c8cbc58
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d53c90>
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f654ceda-166d-52a2-9d46-b5ae3c8cbc58/f654ceda-166d-52a2-9d46-b5ae3c8cbc58_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fcd86f1e641d94ca1a555167f748632e7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/5.jpg saved to cache
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f654ceda-166d-52a2-9d46-b5ae3c8cbc58
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c9c50>
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f654ceda-166d-52a2-9d46-b5ae3c8cbc58/f654ceda-166d-52a2-9d46-b5ae3c8cbc58_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fcd86f1e641d94ca1a555167f748632e7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/4.jpg saved to cache
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f654ceda-166d-52a2-9d46-b5ae3c8cbc58
2026-03-27 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Facd968d806894227b045c8e0855369aa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/6.jpg not downloaded yet
2026-03-27 16:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Facd968d806894227b045c8e0855369aa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/7.jpg not downloaded yet
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910ed410>
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f654ceda-166d-52a2-9d46-b5ae3c8cbc58/f654ceda-166d-52a2-9d46-b5ae3c8cbc58_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fcd86f1e641d94ca1a555167f748632e7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/3.jpg saved to cache
2026-03-27 16:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f654ceda-166d-52a2-9d46-b5ae3c8cbc58
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ab8650>
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f654ceda-166d-52a2-9d46-b5ae3c8cbc58/f654ceda-166d-52a2-9d46-b5ae3c8cbc58_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fcd86f1e641d94ca1a555167f748632e7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/6.jpg saved to cache
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f654ceda-166d-52a2-9d46-b5ae3c8cbc58
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e8dbd0>
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f654ceda-166d-52a2-9d46-b5ae3c8cbc58/f654ceda-166d-52a2-9d46-b5ae3c8cbc58_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fcd86f1e641d94ca1a555167f748632e7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/7.jpg saved to cache
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f654ceda-166d-52a2-9d46-b5ae3c8cbc58
2026-03-27 16:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Facd968d806894227b045c8e0855369aa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/8.jpg not downloaded yet
2026-03-27 16:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:13 [ayvens.fr] INFO: Found listing with ID: 1988401
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988401%27 HTTP/1.1" 200 None
2026-03-27 16:50:13 [ayvens.fr] INFO: Scrape type for 1988401: 1
2026-03-27 16:50:13 [ayvens.fr] INFO: Extracting data for car ID: 1988401
2026-03-27 16:50:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 173f7bbe-56d8-5428-84ee-bf2afacdbd01 with identifier: 1988401
2026-03-27 16:50:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 173f7bbe-56d8-5428-84ee-bf2afacdbd01 with scrape type 1
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 173f7bbe-56d8-5428-84ee-bf2afacdbd01
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F983f34156b10418d8584034439b6d577%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/1.jpg not downloaded yet
2026-03-27 16:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F983f34156b10418d8584034439b6d577%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/2.jpg not downloaded yet
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abac90>
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b17c1f3-d2ad-5384-86d8-d803ad584b52/6b17c1f3-d2ad-5384-86d8-d803ad584b52_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd1a0e987cbd43cf84198c7cb8d2e674%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/2.jpg saved to cache
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b17c1f3-d2ad-5384-86d8-d803ad584b52
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c9f90>
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b17c1f3-d2ad-5384-86d8-d803ad584b52/6b17c1f3-d2ad-5384-86d8-d803ad584b52_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd1a0e987cbd43cf84198c7cb8d2e674%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/3.jpg saved to cache
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b17c1f3-d2ad-5384-86d8-d803ad584b52
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590622190>
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b17c1f3-d2ad-5384-86d8-d803ad584b52/6b17c1f3-d2ad-5384-86d8-d803ad584b52_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd1a0e987cbd43cf84198c7cb8d2e674%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/1.jpg saved to cache
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b17c1f3-d2ad-5384-86d8-d803ad584b52
2026-03-27 16:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F983f34156b10418d8584034439b6d577%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/3.jpg not downloaded yet
2026-03-27 16:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F983f34156b10418d8584034439b6d577%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/4.jpg not downloaded yet
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fc87d0>
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b17c1f3-d2ad-5384-86d8-d803ad584b52/6b17c1f3-d2ad-5384-86d8-d803ad584b52_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd1a0e987cbd43cf84198c7cb8d2e674%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/4.jpg saved to cache
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b17c1f3-d2ad-5384-86d8-d803ad584b52
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903cc190>
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b17c1f3-d2ad-5384-86d8-d803ad584b52/6b17c1f3-d2ad-5384-86d8-d803ad584b52_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd1a0e987cbd43cf84198c7cb8d2e674%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/5.jpg saved to cache
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b17c1f3-d2ad-5384-86d8-d803ad584b52
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c1790>
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f654ceda-166d-52a2-9d46-b5ae3c8cbc58/f654ceda-166d-52a2-9d46-b5ae3c8cbc58_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fcd86f1e641d94ca1a555167f748632e7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/8.jpg saved to cache
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f654ceda-166d-52a2-9d46-b5ae3c8cbc58
2026-03-27 16:50:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f654ceda-166d-52a2-9d46-b5ae3c8cbc58, skipping ID generation
2026-03-27 16:50:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f654ceda-166d-52a2-9d46-b5ae3c8cbc58 with scrape type 1
2026-03-27 16:50:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f654ceda-166d-52a2-9d46-b5ae3c8cbc58 sending to next pipeline
2026-03-27 16:50:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f654ceda-166d-52a2-9d46-b5ae3c8cbc58, identifier: 1988398
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F983f34156b10418d8584034439b6d577%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/5.jpg not downloaded yet
2026-03-27 16:50:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f654ceda-166d-52a2-9d46-b5ae3c8cbc58 with identifier: 1988398
2026-03-27 16:50:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:50:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f654ceda-166d-52a2-9d46-b5ae3c8cbc58 with identifier: 1988398
2026-03-27 16:50:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f654ceda-166d-52a2-9d46-b5ae3c8cbc58 with identifier: 1988398 to the API
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 172,
'color': 'GRIS TITANE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'f654ceda-166d-52a2-9d46-b5ae3c8cbc58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'LEXUS',
'model': 'NX',
'odometer': 143555,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f654ceda-166d-52a2-9d46-b5ae3c8cbc58/f654ceda-166d-52a2-9d46-b5ae3c8cbc58_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428082,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f654ceda-166d-52a2-9d46-b5ae3c8cbc58/f654ceda-166d-52a2-9d46-b5ae3c8cbc58_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428082,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f654ceda-166d-52a2-9d46-b5ae3c8cbc58/f654ceda-166d-52a2-9d46-b5ae3c8cbc58_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432973,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f654ceda-166d-52a2-9d46-b5ae3c8cbc58/f654ceda-166d-52a2-9d46-b5ae3c8cbc58_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417191,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f654ceda-166d-52a2-9d46-b5ae3c8cbc58/f654ceda-166d-52a2-9d46-b5ae3c8cbc58_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357448,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f654ceda-166d-52a2-9d46-b5ae3c8cbc58/f654ceda-166d-52a2-9d46-b5ae3c8cbc58_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364445,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f654ceda-166d-52a2-9d46-b5ae3c8cbc58/f654ceda-166d-52a2-9d46-b5ae3c8cbc58_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297573,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f654ceda-166d-52a2-9d46-b5ae3c8cbc58/f654ceda-166d-52a2-9d46-b5ae3c8cbc58_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559132,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/cd86f1e641d94ca1a555167f748632e7/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-18',
'seats_number': 5,
'seller_name': None,
'title': 'LEXUS NX NX 300h 4WD Executive Innovation',
'transmission': 'automatic',
'trim': 'NX 300h 4WD Executive Innovation',
'vin': None,
'year': 2020}
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988398%27 HTTP/1.1" 200 None
2026-03-27 16:50:14 [ayvens.fr] INFO: Saving data for 1988398: {'created_time': 1774630214.4493, 'last_price_update_time': 1774630214.44931, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988398') HTTP/1.1" 204 0
2026-03-27 16:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F983f34156b10418d8584034439b6d577%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/6.jpg not downloaded yet
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F983f34156b10418d8584034439b6d577%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/7.jpg not downloaded yet
2026-03-27 16:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905198d0>
2026-03-27 16:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b17c1f3-d2ad-5384-86d8-d803ad584b52/6b17c1f3-d2ad-5384-86d8-d803ad584b52_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd1a0e987cbd43cf84198c7cb8d2e674%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/6.jpg saved to cache
2026-03-27 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b17c1f3-d2ad-5384-86d8-d803ad584b52
2026-03-27 16:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050c450>
2026-03-27 16:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b17c1f3-d2ad-5384-86d8-d803ad584b52/6b17c1f3-d2ad-5384-86d8-d803ad584b52_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd1a0e987cbd43cf84198c7cb8d2e674%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/8.jpg saved to cache
2026-03-27 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b17c1f3-d2ad-5384-86d8-d803ad584b52
2026-03-27 16:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a3d90>
2026-03-27 16:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5a6c87b-c3e1-5bee-a30f-ca56b8a83351/f5a6c87b-c3e1-5bee-a30f-ca56b8a83351_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Facd968d806894227b045c8e0855369aa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/2.jpg saved to cache
2026-03-27 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5a6c87b-c3e1-5bee-a30f-ca56b8a83351
2026-03-27 16:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068fdd0>
2026-03-27 16:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5a6c87b-c3e1-5bee-a30f-ca56b8a83351/f5a6c87b-c3e1-5bee-a30f-ca56b8a83351_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Facd968d806894227b045c8e0855369aa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/1.jpg saved to cache
2026-03-27 16:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5a6c87b-c3e1-5bee-a30f-ca56b8a83351
2026-03-27 16:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b23350>
2026-03-27 16:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b17c1f3-d2ad-5384-86d8-d803ad584b52/6b17c1f3-d2ad-5384-86d8-d803ad584b52_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd1a0e987cbd43cf84198c7cb8d2e674%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/7.jpg saved to cache
2026-03-27 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b17c1f3-d2ad-5384-86d8-d803ad584b52
2026-03-27 16:50:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b17c1f3-d2ad-5384-86d8-d803ad584b52, skipping ID generation
2026-03-27 16:50:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b17c1f3-d2ad-5384-86d8-d803ad584b52 with scrape type 1
2026-03-27 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b17c1f3-d2ad-5384-86d8-d803ad584b52 sending to next pipeline
2026-03-27 16:50:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6b17c1f3-d2ad-5384-86d8-d803ad584b52, identifier: 1988399
2026-03-27 16:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6b17c1f3-d2ad-5384-86d8-d803ad584b52 with identifier: 1988399
2026-03-27 16:50:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:50:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6b17c1f3-d2ad-5384-86d8-d803ad584b52 with identifier: 1988399
2026-03-27 16:50:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6b17c1f3-d2ad-5384-86d8-d803ad584b52 with identifier: 1988399 to the API
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'GRIS GALET',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '6b17c1f3-d2ad-5384-86d8-d803ad584b52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'Q4 E-TRON',
'odometer': 79212,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b17c1f3-d2ad-5384-86d8-d803ad584b52/6b17c1f3-d2ad-5384-86d8-d803ad584b52_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298985,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b17c1f3-d2ad-5384-86d8-d803ad584b52/6b17c1f3-d2ad-5384-86d8-d803ad584b52_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298985,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b17c1f3-d2ad-5384-86d8-d803ad584b52/6b17c1f3-d2ad-5384-86d8-d803ad584b52_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330093,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b17c1f3-d2ad-5384-86d8-d803ad584b52/6b17c1f3-d2ad-5384-86d8-d803ad584b52_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324997,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b17c1f3-d2ad-5384-86d8-d803ad584b52/6b17c1f3-d2ad-5384-86d8-d803ad584b52_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359583,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b17c1f3-d2ad-5384-86d8-d803ad584b52/6b17c1f3-d2ad-5384-86d8-d803ad584b52_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300648,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b17c1f3-d2ad-5384-86d8-d803ad584b52/6b17c1f3-d2ad-5384-86d8-d803ad584b52_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286544,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b17c1f3-d2ad-5384-86d8-d803ad584b52/6b17c1f3-d2ad-5384-86d8-d803ad584b52_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 445526,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/fd1a0e987cbd43cf84198c7cb8d2e674/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-13',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI Q4 E-TRON Q4 e-tron 40 e-tron 204ch Executive',
'transmission': 'automatic',
'trim': 'Q4 e-tron 40 e-tron 204ch Executive',
'vin': None,
'year': 2022}
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988399%27 HTTP/1.1" 200 None
2026-03-27 16:50:15 [ayvens.fr] INFO: Saving data for 1988399: {'created_time': 1774630215.423036, 'last_price_update_time': 1774630215.423047, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988399') HTTP/1.1" 204 0
2026-03-27 16:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F983f34156b10418d8584034439b6d577%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/8.jpg not downloaded yet
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905b0fd0>
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5a6c87b-c3e1-5bee-a30f-ca56b8a83351/f5a6c87b-c3e1-5bee-a30f-ca56b8a83351_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Facd968d806894227b045c8e0855369aa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/4.jpg saved to cache
2026-03-27 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5a6c87b-c3e1-5bee-a30f-ca56b8a83351
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590654990>
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5a6c87b-c3e1-5bee-a30f-ca56b8a83351/f5a6c87b-c3e1-5bee-a30f-ca56b8a83351_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Facd968d806894227b045c8e0855369aa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/3.jpg saved to cache
2026-03-27 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5a6c87b-c3e1-5bee-a30f-ca56b8a83351
2026-03-27 16:50:15 [ayvens.fr] INFO: Found listing with ID: 1988402
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988402%27 HTTP/1.1" 200 None
2026-03-27 16:50:15 [ayvens.fr] INFO: Scrape type for 1988402: 1
2026-03-27 16:50:15 [ayvens.fr] INFO: Extracting data for car ID: 1988402
2026-03-27 16:50:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8663fa68-930f-5f88-aede-77b87224d653 with identifier: 1988402
2026-03-27 16:50:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8663fa68-930f-5f88-aede-77b87224d653 with scrape type 1
2026-03-27 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 8663fa68-930f-5f88-aede-77b87224d653
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd7a8e4a04bd74613952af60dafc3c86b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/1.jpg not downloaded yet
2026-03-27 16:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d407d0>
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5a6c87b-c3e1-5bee-a30f-ca56b8a83351/f5a6c87b-c3e1-5bee-a30f-ca56b8a83351_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Facd968d806894227b045c8e0855369aa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/5.jpg saved to cache
2026-03-27 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5a6c87b-c3e1-5bee-a30f-ca56b8a83351
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59f04da50>
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5a6c87b-c3e1-5bee-a30f-ca56b8a83351/f5a6c87b-c3e1-5bee-a30f-ca56b8a83351_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Facd968d806894227b045c8e0855369aa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/8.jpg saved to cache
2026-03-27 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5a6c87b-c3e1-5bee-a30f-ca56b8a83351
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe19d0>
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5a6c87b-c3e1-5bee-a30f-ca56b8a83351/f5a6c87b-c3e1-5bee-a30f-ca56b8a83351_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Facd968d806894227b045c8e0855369aa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/6.jpg saved to cache
2026-03-27 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5a6c87b-c3e1-5bee-a30f-ca56b8a83351
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b2b5d0>
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5a6c87b-c3e1-5bee-a30f-ca56b8a83351/f5a6c87b-c3e1-5bee-a30f-ca56b8a83351_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Facd968d806894227b045c8e0855369aa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/7.jpg saved to cache
2026-03-27 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5a6c87b-c3e1-5bee-a30f-ca56b8a83351
2026-03-27 16:50:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5a6c87b-c3e1-5bee-a30f-ca56b8a83351, skipping ID generation
2026-03-27 16:50:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5a6c87b-c3e1-5bee-a30f-ca56b8a83351 with scrape type 1
2026-03-27 16:50:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5a6c87b-c3e1-5bee-a30f-ca56b8a83351 sending to next pipeline
2026-03-27 16:50:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f5a6c87b-c3e1-5bee-a30f-ca56b8a83351, identifier: 1988400
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd7a8e4a04bd74613952af60dafc3c86b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/2.jpg not downloaded yet
2026-03-27 16:50:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f5a6c87b-c3e1-5bee-a30f-ca56b8a83351 with identifier: 1988400
2026-03-27 16:50:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f5a6c87b-c3e1-5bee-a30f-ca56b8a83351 with identifier: 1988400
2026-03-27 16:50:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f5a6c87b-c3e1-5bee-a30f-ca56b8a83351 with identifier: 1988400 to the API
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 128,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'f5a6c87b-c3e1-5bee-a30f-ca56b8a83351',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'RAV4 HSD',
'odometer': 49846,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5a6c87b-c3e1-5bee-a30f-ca56b8a83351/f5a6c87b-c3e1-5bee-a30f-ca56b8a83351_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409244,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5a6c87b-c3e1-5bee-a30f-ca56b8a83351/f5a6c87b-c3e1-5bee-a30f-ca56b8a83351_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409244,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5a6c87b-c3e1-5bee-a30f-ca56b8a83351/f5a6c87b-c3e1-5bee-a30f-ca56b8a83351_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411980,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5a6c87b-c3e1-5bee-a30f-ca56b8a83351/f5a6c87b-c3e1-5bee-a30f-ca56b8a83351_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382122,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5a6c87b-c3e1-5bee-a30f-ca56b8a83351/f5a6c87b-c3e1-5bee-a30f-ca56b8a83351_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312670,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5a6c87b-c3e1-5bee-a30f-ca56b8a83351/f5a6c87b-c3e1-5bee-a30f-ca56b8a83351_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319909,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5a6c87b-c3e1-5bee-a30f-ca56b8a83351/f5a6c87b-c3e1-5bee-a30f-ca56b8a83351_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295813,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5a6c87b-c3e1-5bee-a30f-ca56b8a83351/f5a6c87b-c3e1-5bee-a30f-ca56b8a83351_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294644,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/acd968d806894227b045c8e0855369aa/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-27',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA RAV4 HSD RAV4 2.5 Hybride 222ch Dynamic Business AWD-i + '
'Programme Beyond Zero Academy',
'transmission': 'automatic',
'trim': 'RAV4 2.5 Hybride 222ch Dynamic Business AWD-i + Programme Beyond '
'Zero Academy',
'vin': None,
'year': 2022}
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988400%27 HTTP/1.1" 200 None
2026-03-27 16:50:16 [ayvens.fr] INFO: Saving data for 1988400: {'created_time': 1774630216.390537, 'last_price_update_time': 1774630216.390549, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988400') HTTP/1.1" 204 0
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590aff690>
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_173f7bbe-56d8-5428-84ee-bf2afacdbd01/173f7bbe-56d8-5428-84ee-bf2afacdbd01_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F983f34156b10418d8584034439b6d577%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/1.jpg saved to cache
2026-03-27 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 173f7bbe-56d8-5428-84ee-bf2afacdbd01
2026-03-27 16:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd7a8e4a04bd74613952af60dafc3c86b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/3.jpg not downloaded yet
2026-03-27 16:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f63010>
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_173f7bbe-56d8-5428-84ee-bf2afacdbd01/173f7bbe-56d8-5428-84ee-bf2afacdbd01_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F983f34156b10418d8584034439b6d577%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/3.jpg saved to cache
2026-03-27 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 173f7bbe-56d8-5428-84ee-bf2afacdbd01
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd7a8e4a04bd74613952af60dafc3c86b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/4.jpg not downloaded yet
2026-03-27 16:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd7a8e4a04bd74613952af60dafc3c86b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/5.jpg not downloaded yet
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b2b50>
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_173f7bbe-56d8-5428-84ee-bf2afacdbd01/173f7bbe-56d8-5428-84ee-bf2afacdbd01_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F983f34156b10418d8584034439b6d577%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/4.jpg saved to cache
2026-03-27 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 173f7bbe-56d8-5428-84ee-bf2afacdbd01
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59062e1d0>
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_173f7bbe-56d8-5428-84ee-bf2afacdbd01/173f7bbe-56d8-5428-84ee-bf2afacdbd01_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F983f34156b10418d8584034439b6d577%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/2.jpg saved to cache
2026-03-27 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 173f7bbe-56d8-5428-84ee-bf2afacdbd01
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a03d0>
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_173f7bbe-56d8-5428-84ee-bf2afacdbd01/173f7bbe-56d8-5428-84ee-bf2afacdbd01_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F983f34156b10418d8584034439b6d577%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/6.jpg saved to cache
2026-03-27 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 173f7bbe-56d8-5428-84ee-bf2afacdbd01
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d40390>
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_173f7bbe-56d8-5428-84ee-bf2afacdbd01/173f7bbe-56d8-5428-84ee-bf2afacdbd01_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F983f34156b10418d8584034439b6d577%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/5.jpg saved to cache
2026-03-27 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 173f7bbe-56d8-5428-84ee-bf2afacdbd01
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd7a8e4a04bd74613952af60dafc3c86b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/6.jpg not downloaded yet
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd7a8e4a04bd74613952af60dafc3c86b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/7.jpg not downloaded yet
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b048d0>
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_173f7bbe-56d8-5428-84ee-bf2afacdbd01/173f7bbe-56d8-5428-84ee-bf2afacdbd01_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F983f34156b10418d8584034439b6d577%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/7.jpg saved to cache
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 173f7bbe-56d8-5428-84ee-bf2afacdbd01
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3cc10>
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_173f7bbe-56d8-5428-84ee-bf2afacdbd01/173f7bbe-56d8-5428-84ee-bf2afacdbd01_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F983f34156b10418d8584034439b6d577%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/8.jpg saved to cache
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 173f7bbe-56d8-5428-84ee-bf2afacdbd01
2026-03-27 16:50:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 173f7bbe-56d8-5428-84ee-bf2afacdbd01, skipping ID generation
2026-03-27 16:50:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 173f7bbe-56d8-5428-84ee-bf2afacdbd01 with scrape type 1
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 173f7bbe-56d8-5428-84ee-bf2afacdbd01 sending to next pipeline
2026-03-27 16:50:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 173f7bbe-56d8-5428-84ee-bf2afacdbd01, identifier: 1988401
2026-03-27 16:50:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 173f7bbe-56d8-5428-84ee-bf2afacdbd01 with identifier: 1988401
2026-03-27 16:50:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 173f7bbe-56d8-5428-84ee-bf2afacdbd01 with identifier: 1988401
2026-03-27 16:50:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 173f7bbe-56d8-5428-84ee-bf2afacdbd01 with identifier: 1988401 to the API
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 47,
'color': 'NOIR ONYX',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '173f7bbe-56d8-5428-84ee-bf2afacdbd01',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC40',
'odometer': 107864,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_173f7bbe-56d8-5428-84ee-bf2afacdbd01/173f7bbe-56d8-5428-84ee-bf2afacdbd01_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365306,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_173f7bbe-56d8-5428-84ee-bf2afacdbd01/173f7bbe-56d8-5428-84ee-bf2afacdbd01_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365306,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_173f7bbe-56d8-5428-84ee-bf2afacdbd01/173f7bbe-56d8-5428-84ee-bf2afacdbd01_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319234,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_173f7bbe-56d8-5428-84ee-bf2afacdbd01/173f7bbe-56d8-5428-84ee-bf2afacdbd01_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343992,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_173f7bbe-56d8-5428-84ee-bf2afacdbd01/173f7bbe-56d8-5428-84ee-bf2afacdbd01_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306602,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_173f7bbe-56d8-5428-84ee-bf2afacdbd01/173f7bbe-56d8-5428-84ee-bf2afacdbd01_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245879,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_173f7bbe-56d8-5428-84ee-bf2afacdbd01/173f7bbe-56d8-5428-84ee-bf2afacdbd01_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273963,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_173f7bbe-56d8-5428-84ee-bf2afacdbd01/173f7bbe-56d8-5428-84ee-bf2afacdbd01_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296328,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/983f34156b10418d8584034439b6d577/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-09',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC40 XC40 T4 Recharge 129 + 82ch Start DCT 7',
'transmission': 'automatic',
'trim': 'XC40 T4 Recharge 129 + 82ch Start DCT 7',
'vin': None,
'year': 2023}
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988401%27 HTTP/1.1" 200 None
2026-03-27 16:50:17 [ayvens.fr] INFO: Saving data for 1988401: {'created_time': 1774630217.46474, 'last_price_update_time': 1774630217.464753, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988401') HTTP/1.1" 204 0
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd7a8e4a04bd74613952af60dafc3c86b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/8.jpg not downloaded yet
2026-03-27 16:50:17 [ayvens.fr] INFO: Found listing with ID: 1988403
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988403%27 HTTP/1.1" 200 None
2026-03-27 16:50:17 [ayvens.fr] INFO: Scrape type for 1988403: 1
2026-03-27 16:50:17 [ayvens.fr] INFO: Extracting data for car ID: 1988403
2026-03-27 16:50:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30bcf61c-87e1-5b18-9afb-63cabcd70d2d with identifier: 1988403
2026-03-27 16:50:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30bcf61c-87e1-5b18-9afb-63cabcd70d2d with scrape type 1
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 30bcf61c-87e1-5b18-9afb-63cabcd70d2d
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fbfab41d8fa1e409abd721a91d20724b7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/1.jpg not downloaded yet
2026-03-27 16:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fbfab41d8fa1e409abd721a91d20724b7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/2.jpg not downloaded yet
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fbfab41d8fa1e409abd721a91d20724b7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/3.jpg not downloaded yet
2026-03-27 16:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fbfab41d8fa1e409abd721a91d20724b7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/4.jpg not downloaded yet
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fbfab41d8fa1e409abd721a91d20724b7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/5.jpg not downloaded yet
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fbfab41d8fa1e409abd721a91d20724b7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/6.jpg not downloaded yet
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fbfab41d8fa1e409abd721a91d20724b7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/7.jpg not downloaded yet
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fbfab41d8fa1e409abd721a91d20724b7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/8.jpg not downloaded yet
2026-03-27 16:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:17 [ayvens.fr] INFO: Found listing with ID: 1988404
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988404%27 HTTP/1.1" 200 None
2026-03-27 16:50:17 [ayvens.fr] INFO: Scrape type for 1988404: 1
2026-03-27 16:50:17 [ayvens.fr] INFO: Extracting data for car ID: 1988404
2026-03-27 16:50:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdfc30fd-37dc-52af-8f60-bb177bf34bcd with identifier: 1988404
2026-03-27 16:50:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdfc30fd-37dc-52af-8f60-bb177bf34bcd with scrape type 1
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item bdfc30fd-37dc-52af-8f60-bb177bf34bcd
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F8dc416108b444ee3a18f2ad1d87187a5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/1.jpg not downloaded yet
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b8b0d0>
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8663fa68-930f-5f88-aede-77b87224d653/8663fa68-930f-5f88-aede-77b87224d653_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd7a8e4a04bd74613952af60dafc3c86b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/1.jpg saved to cache
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8663fa68-930f-5f88-aede-77b87224d653
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068f550>
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8663fa68-930f-5f88-aede-77b87224d653/8663fa68-930f-5f88-aede-77b87224d653_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd7a8e4a04bd74613952af60dafc3c86b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/3.jpg saved to cache
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8663fa68-930f-5f88-aede-77b87224d653
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b8bed0>
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8663fa68-930f-5f88-aede-77b87224d653/8663fa68-930f-5f88-aede-77b87224d653_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd7a8e4a04bd74613952af60dafc3c86b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/2.jpg saved to cache
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8663fa68-930f-5f88-aede-77b87224d653
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F8dc416108b444ee3a18f2ad1d87187a5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/2.jpg not downloaded yet
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910c6450>
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8663fa68-930f-5f88-aede-77b87224d653/8663fa68-930f-5f88-aede-77b87224d653_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd7a8e4a04bd74613952af60dafc3c86b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/5.jpg saved to cache
2026-03-27 16:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8663fa68-930f-5f88-aede-77b87224d653
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590511910>
2026-03-27 16:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8663fa68-930f-5f88-aede-77b87224d653/8663fa68-930f-5f88-aede-77b87224d653_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd7a8e4a04bd74613952af60dafc3c86b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/4.jpg saved to cache
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8663fa68-930f-5f88-aede-77b87224d653
2026-03-27 16:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F8dc416108b444ee3a18f2ad1d87187a5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/3.jpg not downloaded yet
2026-03-27 16:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F8dc416108b444ee3a18f2ad1d87187a5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/4.jpg not downloaded yet
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd2d50>
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8663fa68-930f-5f88-aede-77b87224d653/8663fa68-930f-5f88-aede-77b87224d653_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd7a8e4a04bd74613952af60dafc3c86b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/6.jpg saved to cache
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8663fa68-930f-5f88-aede-77b87224d653
2026-03-27 16:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F8dc416108b444ee3a18f2ad1d87187a5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/5.jpg not downloaded yet
2026-03-27 16:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F8dc416108b444ee3a18f2ad1d87187a5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/6.jpg not downloaded yet
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905908d0>
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8663fa68-930f-5f88-aede-77b87224d653/8663fa68-930f-5f88-aede-77b87224d653_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd7a8e4a04bd74613952af60dafc3c86b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/8.jpg saved to cache
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8663fa68-930f-5f88-aede-77b87224d653
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d83790>
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30bcf61c-87e1-5b18-9afb-63cabcd70d2d/30bcf61c-87e1-5b18-9afb-63cabcd70d2d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fbfab41d8fa1e409abd721a91d20724b7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/2.jpg saved to cache
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30bcf61c-87e1-5b18-9afb-63cabcd70d2d
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F8dc416108b444ee3a18f2ad1d87187a5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/7.jpg not downloaded yet
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F8dc416108b444ee3a18f2ad1d87187a5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/8.jpg not downloaded yet
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b75fd0>
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8663fa68-930f-5f88-aede-77b87224d653/8663fa68-930f-5f88-aede-77b87224d653_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252Fd7a8e4a04bd74613952af60dafc3c86b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/7.jpg saved to cache
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8663fa68-930f-5f88-aede-77b87224d653
2026-03-27 16:50:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8663fa68-930f-5f88-aede-77b87224d653, skipping ID generation
2026-03-27 16:50:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8663fa68-930f-5f88-aede-77b87224d653 with scrape type 1
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8663fa68-930f-5f88-aede-77b87224d653 sending to next pipeline
2026-03-27 16:50:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8663fa68-930f-5f88-aede-77b87224d653, identifier: 1988402
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b05150>
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30bcf61c-87e1-5b18-9afb-63cabcd70d2d/30bcf61c-87e1-5b18-9afb-63cabcd70d2d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fbfab41d8fa1e409abd721a91d20724b7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/1.jpg saved to cache
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30bcf61c-87e1-5b18-9afb-63cabcd70d2d
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910c6490>
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30bcf61c-87e1-5b18-9afb-63cabcd70d2d/30bcf61c-87e1-5b18-9afb-63cabcd70d2d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fbfab41d8fa1e409abd721a91d20724b7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/3.jpg saved to cache
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30bcf61c-87e1-5b18-9afb-63cabcd70d2d
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df79d0>
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30bcf61c-87e1-5b18-9afb-63cabcd70d2d/30bcf61c-87e1-5b18-9afb-63cabcd70d2d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fbfab41d8fa1e409abd721a91d20724b7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/4.jpg saved to cache
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30bcf61c-87e1-5b18-9afb-63cabcd70d2d
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4add0>
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30bcf61c-87e1-5b18-9afb-63cabcd70d2d/30bcf61c-87e1-5b18-9afb-63cabcd70d2d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fbfab41d8fa1e409abd721a91d20724b7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/5.jpg saved to cache
2026-03-27 16:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30bcf61c-87e1-5b18-9afb-63cabcd70d2d
2026-03-27 16:50:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8663fa68-930f-5f88-aede-77b87224d653 with identifier: 1988402
2026-03-27 16:50:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8663fa68-930f-5f88-aede-77b87224d653 with identifier: 1988402
2026-03-27 16:50:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8663fa68-930f-5f88-aede-77b87224d653 with identifier: 1988402 to the API
2026-03-27 16:50:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 144,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '8663fa68-930f-5f88-aede-77b87224d653',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 54373,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8663fa68-930f-5f88-aede-77b87224d653/8663fa68-930f-5f88-aede-77b87224d653_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481173,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8663fa68-930f-5f88-aede-77b87224d653/8663fa68-930f-5f88-aede-77b87224d653_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481173,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8663fa68-930f-5f88-aede-77b87224d653/8663fa68-930f-5f88-aede-77b87224d653_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 511164,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8663fa68-930f-5f88-aede-77b87224d653/8663fa68-930f-5f88-aede-77b87224d653_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457348,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8663fa68-930f-5f88-aede-77b87224d653/8663fa68-930f-5f88-aede-77b87224d653_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 462611,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8663fa68-930f-5f88-aede-77b87224d653/8663fa68-930f-5f88-aede-77b87224d653_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 413897,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8663fa68-930f-5f88-aede-77b87224d653/8663fa68-930f-5f88-aede-77b87224d653_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322043,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8663fa68-930f-5f88-aede-77b87224d653/8663fa68-930f-5f88-aede-77b87224d653_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238697,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/d7a8e4a04bd74613952af60dafc3c86b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN QASHQAI Qashqai 1.3 Mild Hybrid 158ch N-Connecta Xtronic',
'transmission': 'automatic',
'trim': 'Qashqai 1.3 Mild Hybrid 158ch N-Connecta Xtronic',
'vin': None,
'year': 2023}
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988402%27 HTTP/1.1" 200 None
2026-03-27 16:50:19 [ayvens.fr] INFO: Saving data for 1988402: {'created_time': 1774630219.237354, 'last_price_update_time': 1774630219.237366, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988402') HTTP/1.1" 204 0
2026-03-27 16:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:19 [ayvens.fr] INFO: Found listing with ID: 1988405
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988405%27 HTTP/1.1" 200 None
2026-03-27 16:50:19 [ayvens.fr] INFO: Scrape type for 1988405: 1
2026-03-27 16:50:19 [ayvens.fr] INFO: Extracting data for car ID: 1988405
2026-03-27 16:50:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a37efdb0-edd9-588f-90ab-9e08a7bef0e3 with identifier: 1988405
2026-03-27 16:50:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a37efdb0-edd9-588f-90ab-9e08a7bef0e3 with scrape type 1
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a37efdb0-edd9-588f-90ab-9e08a7bef0e3
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fc63883490f65417383186bf8483a0d07%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/1.jpg not downloaded yet
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59064d810>
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30bcf61c-87e1-5b18-9afb-63cabcd70d2d/30bcf61c-87e1-5b18-9afb-63cabcd70d2d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fbfab41d8fa1e409abd721a91d20724b7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/6.jpg saved to cache
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30bcf61c-87e1-5b18-9afb-63cabcd70d2d
2026-03-27 16:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fc63883490f65417383186bf8483a0d07%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/2.jpg not downloaded yet
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e083d0>
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30bcf61c-87e1-5b18-9afb-63cabcd70d2d/30bcf61c-87e1-5b18-9afb-63cabcd70d2d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fbfab41d8fa1e409abd721a91d20724b7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/8.jpg saved to cache
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30bcf61c-87e1-5b18-9afb-63cabcd70d2d
2026-03-27 16:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fc63883490f65417383186bf8483a0d07%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/3.jpg not downloaded yet
2026-03-27 16:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fc63883490f65417383186bf8483a0d07%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/4.jpg not downloaded yet
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fc63883490f65417383186bf8483a0d07%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/5.jpg not downloaded yet
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fc63883490f65417383186bf8483a0d07%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/6.jpg not downloaded yet
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59102d7d0>
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdfc30fd-37dc-52af-8f60-bb177bf34bcd/bdfc30fd-37dc-52af-8f60-bb177bf34bcd_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F8dc416108b444ee3a18f2ad1d87187a5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/2.jpg saved to cache
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bdfc30fd-37dc-52af-8f60-bb177bf34bcd
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fc63883490f65417383186bf8483a0d07%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/7.jpg not downloaded yet
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fc63883490f65417383186bf8483a0d07%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/8.jpg not downloaded yet
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590669410>
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdfc30fd-37dc-52af-8f60-bb177bf34bcd/bdfc30fd-37dc-52af-8f60-bb177bf34bcd_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F8dc416108b444ee3a18f2ad1d87187a5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/3.jpg saved to cache
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bdfc30fd-37dc-52af-8f60-bb177bf34bcd
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c1950>
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdfc30fd-37dc-52af-8f60-bb177bf34bcd/bdfc30fd-37dc-52af-8f60-bb177bf34bcd_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F8dc416108b444ee3a18f2ad1d87187a5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/4.jpg saved to cache
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bdfc30fd-37dc-52af-8f60-bb177bf34bcd
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906204d0>
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdfc30fd-37dc-52af-8f60-bb177bf34bcd/bdfc30fd-37dc-52af-8f60-bb177bf34bcd_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F8dc416108b444ee3a18f2ad1d87187a5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/6.jpg saved to cache
2026-03-27 16:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bdfc30fd-37dc-52af-8f60-bb177bf34bcd
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590af0a10>
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdfc30fd-37dc-52af-8f60-bb177bf34bcd/bdfc30fd-37dc-52af-8f60-bb177bf34bcd_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F8dc416108b444ee3a18f2ad1d87187a5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/5.jpg saved to cache
2026-03-27 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bdfc30fd-37dc-52af-8f60-bb177bf34bcd
2026-03-27 16:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068f650>
2026-03-27 16:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30bcf61c-87e1-5b18-9afb-63cabcd70d2d/30bcf61c-87e1-5b18-9afb-63cabcd70d2d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fbfab41d8fa1e409abd721a91d20724b7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/7.jpg saved to cache
2026-03-27 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30bcf61c-87e1-5b18-9afb-63cabcd70d2d
2026-03-27 16:50:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30bcf61c-87e1-5b18-9afb-63cabcd70d2d, skipping ID generation
2026-03-27 16:50:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30bcf61c-87e1-5b18-9afb-63cabcd70d2d with scrape type 1
2026-03-27 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30bcf61c-87e1-5b18-9afb-63cabcd70d2d sending to next pipeline
2026-03-27 16:50:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 30bcf61c-87e1-5b18-9afb-63cabcd70d2d, identifier: 1988403
2026-03-27 16:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590affa90>
2026-03-27 16:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdfc30fd-37dc-52af-8f60-bb177bf34bcd/bdfc30fd-37dc-52af-8f60-bb177bf34bcd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F8dc416108b444ee3a18f2ad1d87187a5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/1.jpg saved to cache
2026-03-27 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bdfc30fd-37dc-52af-8f60-bb177bf34bcd
2026-03-27 16:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 30bcf61c-87e1-5b18-9afb-63cabcd70d2d with identifier: 1988403
2026-03-27 16:50:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 30bcf61c-87e1-5b18-9afb-63cabcd70d2d with identifier: 1988403
2026-03-27 16:50:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 30bcf61c-87e1-5b18-9afb-63cabcd70d2d with identifier: 1988403 to the API
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 106,
'color': 'GRIS ELECTROCLASH',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '30bcf61c-87e1-5b18-9afb-63cabcd70d2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 43366,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30bcf61c-87e1-5b18-9afb-63cabcd70d2d/30bcf61c-87e1-5b18-9afb-63cabcd70d2d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302556,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30bcf61c-87e1-5b18-9afb-63cabcd70d2d/30bcf61c-87e1-5b18-9afb-63cabcd70d2d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302556,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30bcf61c-87e1-5b18-9afb-63cabcd70d2d/30bcf61c-87e1-5b18-9afb-63cabcd70d2d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296054,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30bcf61c-87e1-5b18-9afb-63cabcd70d2d/30bcf61c-87e1-5b18-9afb-63cabcd70d2d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331970,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30bcf61c-87e1-5b18-9afb-63cabcd70d2d/30bcf61c-87e1-5b18-9afb-63cabcd70d2d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355376,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30bcf61c-87e1-5b18-9afb-63cabcd70d2d/30bcf61c-87e1-5b18-9afb-63cabcd70d2d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312636,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30bcf61c-87e1-5b18-9afb-63cabcd70d2d/30bcf61c-87e1-5b18-9afb-63cabcd70d2d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384956,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30bcf61c-87e1-5b18-9afb-63cabcd70d2d/30bcf61c-87e1-5b18-9afb-63cabcd70d2d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 219993,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/bfab41d8fa1e409abd721a91d20724b7/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-06',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 1.0 70ch BSG S&S Cult',
'transmission': 'manual',
'trim': '500 1.0 70ch BSG S&S Cult',
'vin': None,
'year': 2021}
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988403%27 HTTP/1.1" 200 None
2026-03-27 16:50:20 [ayvens.fr] INFO: Saving data for 1988403: {'created_time': 1774630220.679867, 'last_price_update_time': 1774630220.679878, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988403') HTTP/1.1" 204 0
2026-03-27 16:50:20 [ayvens.fr] INFO: Found listing with ID: 1988406
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988406%27 HTTP/1.1" 200 None
2026-03-27 16:50:20 [ayvens.fr] INFO: Scrape type for 1988406: 1
2026-03-27 16:50:20 [ayvens.fr] INFO: Extracting data for car ID: 1988406
2026-03-27 16:50:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6db8d8b7-223e-576c-9813-2cc5d6ecacd7 with identifier: 1988406
2026-03-27 16:50:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6db8d8b7-223e-576c-9813-2cc5d6ecacd7 with scrape type 1
2026-03-27 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6db8d8b7-223e-576c-9813-2cc5d6ecacd7
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F50ddc1d62a7d48b4af50cf56478ea807%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/1.jpg not downloaded yet
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F50ddc1d62a7d48b4af50cf56478ea807%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/2.jpg not downloaded yet
2026-03-27 16:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590565050>
2026-03-27 16:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdfc30fd-37dc-52af-8f60-bb177bf34bcd/bdfc30fd-37dc-52af-8f60-bb177bf34bcd_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F8dc416108b444ee3a18f2ad1d87187a5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/7.jpg saved to cache
2026-03-27 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bdfc30fd-37dc-52af-8f60-bb177bf34bcd
2026-03-27 16:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd9a90>
2026-03-27 16:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdfc30fd-37dc-52af-8f60-bb177bf34bcd/bdfc30fd-37dc-52af-8f60-bb177bf34bcd_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F8dc416108b444ee3a18f2ad1d87187a5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/8.jpg saved to cache
2026-03-27 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bdfc30fd-37dc-52af-8f60-bb177bf34bcd
2026-03-27 16:50:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bdfc30fd-37dc-52af-8f60-bb177bf34bcd, skipping ID generation
2026-03-27 16:50:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdfc30fd-37dc-52af-8f60-bb177bf34bcd with scrape type 1
2026-03-27 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bdfc30fd-37dc-52af-8f60-bb177bf34bcd sending to next pipeline
2026-03-27 16:50:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: bdfc30fd-37dc-52af-8f60-bb177bf34bcd, identifier: 1988404
2026-03-27 16:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F50ddc1d62a7d48b4af50cf56478ea807%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/3.jpg not downloaded yet
2026-03-27 16:50:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: bdfc30fd-37dc-52af-8f60-bb177bf34bcd with identifier: 1988404
2026-03-27 16:50:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:50:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: bdfc30fd-37dc-52af-8f60-bb177bf34bcd with identifier: 1988404
2026-03-27 16:50:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: bdfc30fd-37dc-52af-8f60-bb177bf34bcd with identifier: 1988404 to the API
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 94,
'color': 'GRIS LUNAIRE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'bdfc30fd-37dc-52af-8f60-bb177bf34bcd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FIESTA',
'odometer': 64720,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdfc30fd-37dc-52af-8f60-bb177bf34bcd/bdfc30fd-37dc-52af-8f60-bb177bf34bcd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357820,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdfc30fd-37dc-52af-8f60-bb177bf34bcd/bdfc30fd-37dc-52af-8f60-bb177bf34bcd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357820,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdfc30fd-37dc-52af-8f60-bb177bf34bcd/bdfc30fd-37dc-52af-8f60-bb177bf34bcd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343640,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdfc30fd-37dc-52af-8f60-bb177bf34bcd/bdfc30fd-37dc-52af-8f60-bb177bf34bcd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273292,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdfc30fd-37dc-52af-8f60-bb177bf34bcd/bdfc30fd-37dc-52af-8f60-bb177bf34bcd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 270659,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdfc30fd-37dc-52af-8f60-bb177bf34bcd/bdfc30fd-37dc-52af-8f60-bb177bf34bcd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 270192,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdfc30fd-37dc-52af-8f60-bb177bf34bcd/bdfc30fd-37dc-52af-8f60-bb177bf34bcd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269331,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdfc30fd-37dc-52af-8f60-bb177bf34bcd/bdfc30fd-37dc-52af-8f60-bb177bf34bcd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245245,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/8dc416108b444ee3a18f2ad1d87187a5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-04',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FIESTA Fiesta 1.0 EcoBoost 95ch Titanium 5p',
'transmission': 'manual',
'trim': 'Fiesta 1.0 EcoBoost 95ch Titanium 5p',
'vin': None,
'year': 2019}
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988404%27 HTTP/1.1" 200 None
2026-03-27 16:50:21 [ayvens.fr] INFO: Saving data for 1988404: {'created_time': 1774630221.335353, 'last_price_update_time': 1774630221.335365, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988404') HTTP/1.1" 204 0
2026-03-27 16:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F50ddc1d62a7d48b4af50cf56478ea807%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/4.jpg not downloaded yet
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590592a10>
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a37efdb0-edd9-588f-90ab-9e08a7bef0e3/a37efdb0-edd9-588f-90ab-9e08a7bef0e3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fc63883490f65417383186bf8483a0d07%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/2.jpg saved to cache
2026-03-27 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a37efdb0-edd9-588f-90ab-9e08a7bef0e3
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b36d0>
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a37efdb0-edd9-588f-90ab-9e08a7bef0e3/a37efdb0-edd9-588f-90ab-9e08a7bef0e3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fc63883490f65417383186bf8483a0d07%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/3.jpg saved to cache
2026-03-27 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a37efdb0-edd9-588f-90ab-9e08a7bef0e3
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066d910>
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a37efdb0-edd9-588f-90ab-9e08a7bef0e3/a37efdb0-edd9-588f-90ab-9e08a7bef0e3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fc63883490f65417383186bf8483a0d07%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/1.jpg saved to cache
2026-03-27 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a37efdb0-edd9-588f-90ab-9e08a7bef0e3
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904fced0>
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a37efdb0-edd9-588f-90ab-9e08a7bef0e3/a37efdb0-edd9-588f-90ab-9e08a7bef0e3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fc63883490f65417383186bf8483a0d07%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/5.jpg saved to cache
2026-03-27 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a37efdb0-edd9-588f-90ab-9e08a7bef0e3
2026-03-27 16:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F50ddc1d62a7d48b4af50cf56478ea807%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/5.jpg not downloaded yet
2026-03-27 16:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F50ddc1d62a7d48b4af50cf56478ea807%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/6.jpg not downloaded yet
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc5bd0>
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a37efdb0-edd9-588f-90ab-9e08a7bef0e3/a37efdb0-edd9-588f-90ab-9e08a7bef0e3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fc63883490f65417383186bf8483a0d07%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/4.jpg saved to cache
2026-03-27 16:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a37efdb0-edd9-588f-90ab-9e08a7bef0e3
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910c7d90>
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a37efdb0-edd9-588f-90ab-9e08a7bef0e3/a37efdb0-edd9-588f-90ab-9e08a7bef0e3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fc63883490f65417383186bf8483a0d07%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/6.jpg saved to cache
2026-03-27 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a37efdb0-edd9-588f-90ab-9e08a7bef0e3
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F50ddc1d62a7d48b4af50cf56478ea807%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/7.jpg not downloaded yet
2026-03-27 16:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c0990>
2026-03-27 16:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a37efdb0-edd9-588f-90ab-9e08a7bef0e3/a37efdb0-edd9-588f-90ab-9e08a7bef0e3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fc63883490f65417383186bf8483a0d07%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/8.jpg saved to cache
2026-03-27 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a37efdb0-edd9-588f-90ab-9e08a7bef0e3
2026-03-27 16:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591433850>
2026-03-27 16:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a37efdb0-edd9-588f-90ab-9e08a7bef0e3/a37efdb0-edd9-588f-90ab-9e08a7bef0e3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fc63883490f65417383186bf8483a0d07%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/7.jpg saved to cache
2026-03-27 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a37efdb0-edd9-588f-90ab-9e08a7bef0e3
2026-03-27 16:50:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a37efdb0-edd9-588f-90ab-9e08a7bef0e3, skipping ID generation
2026-03-27 16:50:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a37efdb0-edd9-588f-90ab-9e08a7bef0e3 with scrape type 1
2026-03-27 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a37efdb0-edd9-588f-90ab-9e08a7bef0e3 sending to next pipeline
2026-03-27 16:50:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a37efdb0-edd9-588f-90ab-9e08a7bef0e3, identifier: 1988405
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F50ddc1d62a7d48b4af50cf56478ea807%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/8.jpg not downloaded yet
2026-03-27 16:50:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a37efdb0-edd9-588f-90ab-9e08a7bef0e3 with identifier: 1988405
2026-03-27 16:50:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a37efdb0-edd9-588f-90ab-9e08a7bef0e3 with identifier: 1988405
2026-03-27 16:50:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a37efdb0-edd9-588f-90ab-9e08a7bef0e3 with identifier: 1988405 to the API
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 152,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'a37efdb0-edd9-588f-90ab-9e08a7bef0e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'TIGUAN ALLSPACE',
'odometer': 96345,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a37efdb0-edd9-588f-90ab-9e08a7bef0e3/a37efdb0-edd9-588f-90ab-9e08a7bef0e3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344073,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a37efdb0-edd9-588f-90ab-9e08a7bef0e3/a37efdb0-edd9-588f-90ab-9e08a7bef0e3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344073,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a37efdb0-edd9-588f-90ab-9e08a7bef0e3/a37efdb0-edd9-588f-90ab-9e08a7bef0e3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365591,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a37efdb0-edd9-588f-90ab-9e08a7bef0e3/a37efdb0-edd9-588f-90ab-9e08a7bef0e3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372108,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a37efdb0-edd9-588f-90ab-9e08a7bef0e3/a37efdb0-edd9-588f-90ab-9e08a7bef0e3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318146,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a37efdb0-edd9-588f-90ab-9e08a7bef0e3/a37efdb0-edd9-588f-90ab-9e08a7bef0e3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340494,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a37efdb0-edd9-588f-90ab-9e08a7bef0e3/a37efdb0-edd9-588f-90ab-9e08a7bef0e3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316955,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a37efdb0-edd9-588f-90ab-9e08a7bef0e3/a37efdb0-edd9-588f-90ab-9e08a7bef0e3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252386,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/c63883490f65417383186bf8483a0d07/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-07',
'seats_number': 7,
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN ALLSPACE Tiguan Allspace 2.0 TDI 150ch Carat '
'Exclusive DSG7',
'transmission': 'automatic',
'trim': 'Tiguan Allspace 2.0 TDI 150ch Carat Exclusive DSG7',
'vin': None,
'year': 2021}
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988405%27 HTTP/1.1" 200 None
2026-03-27 16:50:22 [ayvens.fr] INFO: Saving data for 1988405: {'created_time': 1774630222.607707, 'last_price_update_time': 1774630222.607718, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988405') HTTP/1.1" 204 0
2026-03-27 16:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:22 [ayvens.fr] INFO: Found listing with ID: 1988407
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988407%27 HTTP/1.1" 200 None
2026-03-27 16:50:22 [ayvens.fr] INFO: Scrape type for 1988407: 1
2026-03-27 16:50:22 [ayvens.fr] INFO: Extracting data for car ID: 1988407
2026-03-27 16:50:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeb2d5ff-9532-5365-8168-e78595053366 with identifier: 1988407
2026-03-27 16:50:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeb2d5ff-9532-5365-8168-e78595053366 with scrape type 1
2026-03-27 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item aeb2d5ff-9532-5365-8168-e78595053366
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F0d4b618c55bf4002a3f21aaf67f213df%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/1.jpg not downloaded yet
2026-03-27 16:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F0d4b618c55bf4002a3f21aaf67f213df%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/2.jpg not downloaded yet
2026-03-27 16:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F0d4b618c55bf4002a3f21aaf67f213df%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/3.jpg not downloaded yet
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F0d4b618c55bf4002a3f21aaf67f213df%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/4.jpg not downloaded yet
2026-03-27 16:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911c8a90>
2026-03-27 16:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db8d8b7-223e-576c-9813-2cc5d6ecacd7/6db8d8b7-223e-576c-9813-2cc5d6ecacd7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F50ddc1d62a7d48b4af50cf56478ea807%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/2.jpg saved to cache
2026-03-27 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6db8d8b7-223e-576c-9813-2cc5d6ecacd7
2026-03-27 16:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6c2d0>
2026-03-27 16:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db8d8b7-223e-576c-9813-2cc5d6ecacd7/6db8d8b7-223e-576c-9813-2cc5d6ecacd7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F50ddc1d62a7d48b4af50cf56478ea807%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/1.jpg saved to cache
2026-03-27 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6db8d8b7-223e-576c-9813-2cc5d6ecacd7
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F0d4b618c55bf4002a3f21aaf67f213df%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/5.jpg not downloaded yet
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F0d4b618c55bf4002a3f21aaf67f213df%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/6.jpg not downloaded yet
2026-03-27 16:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590695c50>
2026-03-27 16:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db8d8b7-223e-576c-9813-2cc5d6ecacd7/6db8d8b7-223e-576c-9813-2cc5d6ecacd7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F50ddc1d62a7d48b4af50cf56478ea807%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/4.jpg saved to cache
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6db8d8b7-223e-576c-9813-2cc5d6ecacd7
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe1710>
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db8d8b7-223e-576c-9813-2cc5d6ecacd7/6db8d8b7-223e-576c-9813-2cc5d6ecacd7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F50ddc1d62a7d48b4af50cf56478ea807%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/3.jpg saved to cache
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6db8d8b7-223e-576c-9813-2cc5d6ecacd7
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e8c8d0>
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db8d8b7-223e-576c-9813-2cc5d6ecacd7/6db8d8b7-223e-576c-9813-2cc5d6ecacd7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F50ddc1d62a7d48b4af50cf56478ea807%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/5.jpg saved to cache
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6db8d8b7-223e-576c-9813-2cc5d6ecacd7
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F0d4b618c55bf4002a3f21aaf67f213df%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/7.jpg not downloaded yet
2026-03-27 16:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F0d4b618c55bf4002a3f21aaf67f213df%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/8.jpg not downloaded yet
2026-03-27 16:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:23 [ayvens.fr] INFO: Found listing with ID: 1988408
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988408%27 HTTP/1.1" 200 None
2026-03-27 16:50:23 [ayvens.fr] INFO: Scrape type for 1988408: 1
2026-03-27 16:50:23 [ayvens.fr] INFO: Extracting data for car ID: 1988408
2026-03-27 16:50:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73f04b7c-0c17-5989-99aa-61721a5811a3 with identifier: 1988408
2026-03-27 16:50:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73f04b7c-0c17-5989-99aa-61721a5811a3 with scrape type 1
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 73f04b7c-0c17-5989-99aa-61721a5811a3
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F11a07576d5254925a8dbb68638d053f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/1.jpg not downloaded yet
2026-03-27 16:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F11a07576d5254925a8dbb68638d053f8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/2.jpg not downloaded yet
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F11a07576d5254925a8dbb68638d053f8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/3.jpg not downloaded yet
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F11a07576d5254925a8dbb68638d053f8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/4.jpg not downloaded yet
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F11a07576d5254925a8dbb68638d053f8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/5.jpg not downloaded yet
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b51410>
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db8d8b7-223e-576c-9813-2cc5d6ecacd7/6db8d8b7-223e-576c-9813-2cc5d6ecacd7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F50ddc1d62a7d48b4af50cf56478ea807%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/6.jpg saved to cache
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6db8d8b7-223e-576c-9813-2cc5d6ecacd7
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591105390>
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db8d8b7-223e-576c-9813-2cc5d6ecacd7/6db8d8b7-223e-576c-9813-2cc5d6ecacd7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F50ddc1d62a7d48b4af50cf56478ea807%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/7.jpg saved to cache
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6db8d8b7-223e-576c-9813-2cc5d6ecacd7
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F11a07576d5254925a8dbb68638d053f8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/6.jpg not downloaded yet
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F11a07576d5254925a8dbb68638d053f8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/7.jpg not downloaded yet
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f82010>
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db8d8b7-223e-576c-9813-2cc5d6ecacd7/6db8d8b7-223e-576c-9813-2cc5d6ecacd7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F50ddc1d62a7d48b4af50cf56478ea807%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/8.jpg saved to cache
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6db8d8b7-223e-576c-9813-2cc5d6ecacd7
2026-03-27 16:50:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6db8d8b7-223e-576c-9813-2cc5d6ecacd7, skipping ID generation
2026-03-27 16:50:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6db8d8b7-223e-576c-9813-2cc5d6ecacd7 with scrape type 1
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6db8d8b7-223e-576c-9813-2cc5d6ecacd7 sending to next pipeline
2026-03-27 16:50:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6db8d8b7-223e-576c-9813-2cc5d6ecacd7, identifier: 1988406
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d94190>
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb2d5ff-9532-5365-8168-e78595053366/aeb2d5ff-9532-5365-8168-e78595053366_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F0d4b618c55bf4002a3f21aaf67f213df%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/2.jpg saved to cache
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aeb2d5ff-9532-5365-8168-e78595053366
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910ed010>
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb2d5ff-9532-5365-8168-e78595053366/aeb2d5ff-9532-5365-8168-e78595053366_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F0d4b618c55bf4002a3f21aaf67f213df%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/1.jpg saved to cache
2026-03-27 16:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aeb2d5ff-9532-5365-8168-e78595053366
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de4b50>
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb2d5ff-9532-5365-8168-e78595053366/aeb2d5ff-9532-5365-8168-e78595053366_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F0d4b618c55bf4002a3f21aaf67f213df%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/3.jpg saved to cache
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aeb2d5ff-9532-5365-8168-e78595053366
2026-03-27 16:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590affd10>
2026-03-27 16:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb2d5ff-9532-5365-8168-e78595053366/aeb2d5ff-9532-5365-8168-e78595053366_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F0d4b618c55bf4002a3f21aaf67f213df%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/4.jpg saved to cache
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aeb2d5ff-9532-5365-8168-e78595053366
2026-03-27 16:50:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6db8d8b7-223e-576c-9813-2cc5d6ecacd7 with identifier: 1988406
2026-03-27 16:50:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6db8d8b7-223e-576c-9813-2cc5d6ecacd7 with identifier: 1988406
2026-03-27 16:50:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6db8d8b7-223e-576c-9813-2cc5d6ecacd7 with identifier: 1988406 to the API
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 143,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/diesel',
'id': '6db8d8b7-223e-576c-9813-2cc5d6ecacd7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'TUCSON',
'odometer': 124298,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db8d8b7-223e-576c-9813-2cc5d6ecacd7/6db8d8b7-223e-576c-9813-2cc5d6ecacd7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404376,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db8d8b7-223e-576c-9813-2cc5d6ecacd7/6db8d8b7-223e-576c-9813-2cc5d6ecacd7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404376,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db8d8b7-223e-576c-9813-2cc5d6ecacd7/6db8d8b7-223e-576c-9813-2cc5d6ecacd7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 475547,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db8d8b7-223e-576c-9813-2cc5d6ecacd7/6db8d8b7-223e-576c-9813-2cc5d6ecacd7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405081,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db8d8b7-223e-576c-9813-2cc5d6ecacd7/6db8d8b7-223e-576c-9813-2cc5d6ecacd7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357679,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db8d8b7-223e-576c-9813-2cc5d6ecacd7/6db8d8b7-223e-576c-9813-2cc5d6ecacd7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374123,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db8d8b7-223e-576c-9813-2cc5d6ecacd7/6db8d8b7-223e-576c-9813-2cc5d6ecacd7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347263,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db8d8b7-223e-576c-9813-2cc5d6ecacd7/6db8d8b7-223e-576c-9813-2cc5d6ecacd7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/50ddc1d62a7d48b4af50cf56478ea807/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-06',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI TUCSON Tucson 1.6 CRDI 136ch Hybrid 48V Executive DCT7',
'transmission': 'automatic',
'trim': 'Tucson 1.6 CRDI 136ch Hybrid 48V Executive DCT7',
'vin': None,
'year': 2022}
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988406%27 HTTP/1.1" 200 None
2026-03-27 16:50:24 [ayvens.fr] INFO: Saving data for 1988406: {'created_time': 1774630224.519325, 'last_price_update_time': 1774630224.519336, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988406') HTTP/1.1" 204 0
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F11a07576d5254925a8dbb68638d053f8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/8.jpg not downloaded yet
2026-03-27 16:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:24 [ayvens.fr] INFO: Found listing with ID: 1988409
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988409%27 HTTP/1.1" 200 None
2026-03-27 16:50:24 [ayvens.fr] INFO: Scrape type for 1988409: 1
2026-03-27 16:50:24 [ayvens.fr] INFO: Extracting data for car ID: 1988409
2026-03-27 16:50:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52d5eccd-702d-5495-a8b4-deae4c500722 with identifier: 1988409
2026-03-27 16:50:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52d5eccd-702d-5495-a8b4-deae4c500722 with scrape type 1
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 52d5eccd-702d-5495-a8b4-deae4c500722
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F24bd407c046549d69f24b4b342fe0a4b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/1.jpg not downloaded yet
2026-03-27 16:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F24bd407c046549d69f24b4b342fe0a4b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/2.jpg not downloaded yet
2026-03-27 16:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F24bd407c046549d69f24b4b342fe0a4b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/3.jpg not downloaded yet
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F24bd407c046549d69f24b4b342fe0a4b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/4.jpg not downloaded yet
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F24bd407c046549d69f24b4b342fe0a4b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/5.jpg not downloaded yet
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F24bd407c046549d69f24b4b342fe0a4b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/6.jpg not downloaded yet
2026-03-27 16:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592870c50>
2026-03-27 16:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb2d5ff-9532-5365-8168-e78595053366/aeb2d5ff-9532-5365-8168-e78595053366_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F0d4b618c55bf4002a3f21aaf67f213df%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/7.jpg saved to cache
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aeb2d5ff-9532-5365-8168-e78595053366
2026-03-27 16:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59063f610>
2026-03-27 16:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb2d5ff-9532-5365-8168-e78595053366/aeb2d5ff-9532-5365-8168-e78595053366_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F0d4b618c55bf4002a3f21aaf67f213df%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/6.jpg saved to cache
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aeb2d5ff-9532-5365-8168-e78595053366
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F24bd407c046549d69f24b4b342fe0a4b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/7.jpg not downloaded yet
2026-03-27 16:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ac4690>
2026-03-27 16:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb2d5ff-9532-5365-8168-e78595053366/aeb2d5ff-9532-5365-8168-e78595053366_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F0d4b618c55bf4002a3f21aaf67f213df%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/5.jpg saved to cache
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aeb2d5ff-9532-5365-8168-e78595053366
2026-03-27 16:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F24bd407c046549d69f24b4b342fe0a4b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/8.jpg not downloaded yet
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F24bd407c046549d69f24b4b342fe0a4b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/9.jpg not downloaded yet
2026-03-27 16:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e2a90>
2026-03-27 16:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73f04b7c-0c17-5989-99aa-61721a5811a3/73f04b7c-0c17-5989-99aa-61721a5811a3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F11a07576d5254925a8dbb68638d053f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/1.jpg saved to cache
2026-03-27 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73f04b7c-0c17-5989-99aa-61721a5811a3
2026-03-27 16:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a0dd0>
2026-03-27 16:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73f04b7c-0c17-5989-99aa-61721a5811a3/73f04b7c-0c17-5989-99aa-61721a5811a3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F11a07576d5254925a8dbb68638d053f8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/3.jpg saved to cache
2026-03-27 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73f04b7c-0c17-5989-99aa-61721a5811a3
2026-03-27 16:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ddac50>
2026-03-27 16:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73f04b7c-0c17-5989-99aa-61721a5811a3/73f04b7c-0c17-5989-99aa-61721a5811a3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F11a07576d5254925a8dbb68638d053f8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/2.jpg saved to cache
2026-03-27 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73f04b7c-0c17-5989-99aa-61721a5811a3
2026-03-27 16:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590db8e50>
2026-03-27 16:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb2d5ff-9532-5365-8168-e78595053366/aeb2d5ff-9532-5365-8168-e78595053366_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F0d4b618c55bf4002a3f21aaf67f213df%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/8.jpg saved to cache
2026-03-27 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aeb2d5ff-9532-5365-8168-e78595053366
2026-03-27 16:50:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aeb2d5ff-9532-5365-8168-e78595053366, skipping ID generation
2026-03-27 16:50:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeb2d5ff-9532-5365-8168-e78595053366 with scrape type 1
2026-03-27 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aeb2d5ff-9532-5365-8168-e78595053366 sending to next pipeline
2026-03-27 16:50:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: aeb2d5ff-9532-5365-8168-e78595053366, identifier: 1988407
2026-03-27 16:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590aff890>
2026-03-27 16:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73f04b7c-0c17-5989-99aa-61721a5811a3/73f04b7c-0c17-5989-99aa-61721a5811a3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F11a07576d5254925a8dbb68638d053f8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/4.jpg saved to cache
2026-03-27 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73f04b7c-0c17-5989-99aa-61721a5811a3
2026-03-27 16:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: aeb2d5ff-9532-5365-8168-e78595053366 with identifier: 1988407
2026-03-27 16:50:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: aeb2d5ff-9532-5365-8168-e78595053366 with identifier: 1988407
2026-03-27 16:50:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: aeb2d5ff-9532-5365-8168-e78595053366 with identifier: 1988407 to the API
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'aeb2d5ff-9532-5365-8168-e78595053366',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'SEAT',
'model': 'ARONA',
'odometer': 81772,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb2d5ff-9532-5365-8168-e78595053366/aeb2d5ff-9532-5365-8168-e78595053366_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321295,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb2d5ff-9532-5365-8168-e78595053366/aeb2d5ff-9532-5365-8168-e78595053366_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321295,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb2d5ff-9532-5365-8168-e78595053366/aeb2d5ff-9532-5365-8168-e78595053366_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318752,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb2d5ff-9532-5365-8168-e78595053366/aeb2d5ff-9532-5365-8168-e78595053366_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302128,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb2d5ff-9532-5365-8168-e78595053366/aeb2d5ff-9532-5365-8168-e78595053366_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355238,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb2d5ff-9532-5365-8168-e78595053366/aeb2d5ff-9532-5365-8168-e78595053366_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290634,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb2d5ff-9532-5365-8168-e78595053366/aeb2d5ff-9532-5365-8168-e78595053366_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358192,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb2d5ff-9532-5365-8168-e78595053366/aeb2d5ff-9532-5365-8168-e78595053366_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480030,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/0d4b618c55bf4002a3f21aaf67f213df/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-04',
'seats_number': 5,
'seller_name': None,
'title': 'SEAT ARONA Arona 1.0 TSI 110ch Style Business',
'transmission': 'manual',
'trim': 'Arona 1.0 TSI 110ch Style Business',
'vin': None,
'year': 2021}
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988407%27 HTTP/1.1" 200 None
2026-03-27 16:50:25 [ayvens.fr] INFO: Saving data for 1988407: {'created_time': 1774630225.911677, 'last_price_update_time': 1774630225.911689, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988407') HTTP/1.1" 204 0
2026-03-27 16:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F24bd407c046549d69f24b4b342fe0a4b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/10.jpg not downloaded yet
2026-03-27 16:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:25 [ayvens.fr] INFO: Found listing with ID: 1988410
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988410%27 HTTP/1.1" 200 None
2026-03-27 16:50:25 [ayvens.fr] INFO: Scrape type for 1988410: 1
2026-03-27 16:50:25 [ayvens.fr] INFO: Extracting data for car ID: 1988410
2026-03-27 16:50:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ae15d47-d027-5d15-b53a-185326b13354 with identifier: 1988410
2026-03-27 16:50:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ae15d47-d027-5d15-b53a-185326b13354 with scrape type 1
2026-03-27 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0ae15d47-d027-5d15-b53a-185326b13354
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fd273fa2a0a5349f1a9fa52fec812a907%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/1.jpg not downloaded yet
2026-03-27 16:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfe450>
2026-03-27 16:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73f04b7c-0c17-5989-99aa-61721a5811a3/73f04b7c-0c17-5989-99aa-61721a5811a3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F11a07576d5254925a8dbb68638d053f8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/5.jpg saved to cache
2026-03-27 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73f04b7c-0c17-5989-99aa-61721a5811a3
2026-03-27 16:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592c2d850>
2026-03-27 16:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73f04b7c-0c17-5989-99aa-61721a5811a3/73f04b7c-0c17-5989-99aa-61721a5811a3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F11a07576d5254925a8dbb68638d053f8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/7.jpg saved to cache
2026-03-27 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73f04b7c-0c17-5989-99aa-61721a5811a3
2026-03-27 16:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fd273fa2a0a5349f1a9fa52fec812a907%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/2.jpg not downloaded yet
2026-03-27 16:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fd273fa2a0a5349f1a9fa52fec812a907%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/3.jpg not downloaded yet
2026-03-27 16:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590674450>
2026-03-27 16:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73f04b7c-0c17-5989-99aa-61721a5811a3/73f04b7c-0c17-5989-99aa-61721a5811a3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F11a07576d5254925a8dbb68638d053f8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/6.jpg saved to cache
2026-03-27 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73f04b7c-0c17-5989-99aa-61721a5811a3
2026-03-27 16:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0d350>
2026-03-27 16:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73f04b7c-0c17-5989-99aa-61721a5811a3/73f04b7c-0c17-5989-99aa-61721a5811a3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F11a07576d5254925a8dbb68638d053f8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/8.jpg saved to cache
2026-03-27 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73f04b7c-0c17-5989-99aa-61721a5811a3
2026-03-27 16:50:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73f04b7c-0c17-5989-99aa-61721a5811a3, skipping ID generation
2026-03-27 16:50:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73f04b7c-0c17-5989-99aa-61721a5811a3 with scrape type 1
2026-03-27 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73f04b7c-0c17-5989-99aa-61721a5811a3 sending to next pipeline
2026-03-27 16:50:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 73f04b7c-0c17-5989-99aa-61721a5811a3, identifier: 1988408
2026-03-27 16:50:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 73f04b7c-0c17-5989-99aa-61721a5811a3 with identifier: 1988408
2026-03-27 16:50:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 73f04b7c-0c17-5989-99aa-61721a5811a3 with identifier: 1988408
2026-03-27 16:50:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 73f04b7c-0c17-5989-99aa-61721a5811a3 with identifier: 1988408 to the API
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 144,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '73f04b7c-0c17-5989-99aa-61721a5811a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 75496,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73f04b7c-0c17-5989-99aa-61721a5811a3/73f04b7c-0c17-5989-99aa-61721a5811a3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428478,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73f04b7c-0c17-5989-99aa-61721a5811a3/73f04b7c-0c17-5989-99aa-61721a5811a3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428478,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73f04b7c-0c17-5989-99aa-61721a5811a3/73f04b7c-0c17-5989-99aa-61721a5811a3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412640,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73f04b7c-0c17-5989-99aa-61721a5811a3/73f04b7c-0c17-5989-99aa-61721a5811a3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428734,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73f04b7c-0c17-5989-99aa-61721a5811a3/73f04b7c-0c17-5989-99aa-61721a5811a3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289437,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73f04b7c-0c17-5989-99aa-61721a5811a3/73f04b7c-0c17-5989-99aa-61721a5811a3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327118,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73f04b7c-0c17-5989-99aa-61721a5811a3/73f04b7c-0c17-5989-99aa-61721a5811a3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273084,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73f04b7c-0c17-5989-99aa-61721a5811a3/73f04b7c-0c17-5989-99aa-61721a5811a3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 521385,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/11a07576d5254925a8dbb68638d053f8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-21',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Allure Pack',
'transmission': 'manual',
'trim': '5008 1.2 PureTech 130ch S&S Allure Pack',
'vin': None,
'year': 2021}
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988408%27 HTTP/1.1" 200 None
2026-03-27 16:50:26 [ayvens.fr] INFO: Saving data for 1988408: {'created_time': 1774630226.84511, 'last_price_update_time': 1774630226.845121, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988408') HTTP/1.1" 204 0
2026-03-27 16:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fd273fa2a0a5349f1a9fa52fec812a907%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/4.jpg not downloaded yet
2026-03-27 16:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fd273fa2a0a5349f1a9fa52fec812a907%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/5.jpg not downloaded yet
2026-03-27 16:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5945f9cd0>
2026-03-27 16:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52d5eccd-702d-5495-a8b4-deae4c500722/52d5eccd-702d-5495-a8b4-deae4c500722_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F24bd407c046549d69f24b4b342fe0a4b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/2.jpg saved to cache
2026-03-27 16:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 52d5eccd-702d-5495-a8b4-deae4c500722
2026-03-27 16:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fca010>
2026-03-27 16:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52d5eccd-702d-5495-a8b4-deae4c500722/52d5eccd-702d-5495-a8b4-deae4c500722_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F24bd407c046549d69f24b4b342fe0a4b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/1.jpg saved to cache
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52d5eccd-702d-5495-a8b4-deae4c500722
2026-03-27 16:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fd273fa2a0a5349f1a9fa52fec812a907%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/6.jpg not downloaded yet
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fd273fa2a0a5349f1a9fa52fec812a907%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/7.jpg not downloaded yet
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068d4d0>
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52d5eccd-702d-5495-a8b4-deae4c500722/52d5eccd-702d-5495-a8b4-deae4c500722_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F24bd407c046549d69f24b4b342fe0a4b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/3.jpg saved to cache
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 52d5eccd-702d-5495-a8b4-deae4c500722
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b74610>
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52d5eccd-702d-5495-a8b4-deae4c500722/52d5eccd-702d-5495-a8b4-deae4c500722_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F24bd407c046549d69f24b4b342fe0a4b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/4.jpg saved to cache
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 52d5eccd-702d-5495-a8b4-deae4c500722
2026-03-27 16:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fd273fa2a0a5349f1a9fa52fec812a907%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/8.jpg not downloaded yet
2026-03-27 16:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:27 [ayvens.fr] INFO: Found listing with ID: 1988411
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988411%27 HTTP/1.1" 200 None
2026-03-27 16:50:27 [ayvens.fr] INFO: Scrape type for 1988411: 1
2026-03-27 16:50:27 [ayvens.fr] INFO: Extracting data for car ID: 1988411
2026-03-27 16:50:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: beb0698b-4494-5893-9762-8e65e6568267 with identifier: 1988411
2026-03-27 16:50:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beb0698b-4494-5893-9762-8e65e6568267 with scrape type 1
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item beb0698b-4494-5893-9762-8e65e6568267
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fe3477b6e809d42bd8c2d30f53c272363%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/1.jpg not downloaded yet
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904d7dd0>
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52d5eccd-702d-5495-a8b4-deae4c500722/52d5eccd-702d-5495-a8b4-deae4c500722_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F24bd407c046549d69f24b4b342fe0a4b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/5.jpg saved to cache
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 52d5eccd-702d-5495-a8b4-deae4c500722
2026-03-27 16:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fe3477b6e809d42bd8c2d30f53c272363%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/2.jpg not downloaded yet
2026-03-27 16:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fe3477b6e809d42bd8c2d30f53c272363%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/3.jpg not downloaded yet
2026-03-27 16:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fe3477b6e809d42bd8c2d30f53c272363%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/4.jpg not downloaded yet
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59103dfd0>
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52d5eccd-702d-5495-a8b4-deae4c500722/52d5eccd-702d-5495-a8b4-deae4c500722_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F24bd407c046549d69f24b4b342fe0a4b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/7.jpg saved to cache
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 52d5eccd-702d-5495-a8b4-deae4c500722
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911a7850>
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52d5eccd-702d-5495-a8b4-deae4c500722/52d5eccd-702d-5495-a8b4-deae4c500722_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F24bd407c046549d69f24b4b342fe0a4b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/6.jpg saved to cache
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 52d5eccd-702d-5495-a8b4-deae4c500722
2026-03-27 16:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fe3477b6e809d42bd8c2d30f53c272363%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/5.jpg not downloaded yet
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fe3477b6e809d42bd8c2d30f53c272363%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/6.jpg not downloaded yet
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fcb1d0>
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ae15d47-d027-5d15-b53a-185326b13354/0ae15d47-d027-5d15-b53a-185326b13354_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fd273fa2a0a5349f1a9fa52fec812a907%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/1.jpg saved to cache
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ae15d47-d027-5d15-b53a-185326b13354
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dbaa50>
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52d5eccd-702d-5495-a8b4-deae4c500722/52d5eccd-702d-5495-a8b4-deae4c500722_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F24bd407c046549d69f24b4b342fe0a4b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/8.jpg saved to cache
2026-03-27 16:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 52d5eccd-702d-5495-a8b4-deae4c500722
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0d7d0>
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52d5eccd-702d-5495-a8b4-deae4c500722/52d5eccd-702d-5495-a8b4-deae4c500722_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F24bd407c046549d69f24b4b342fe0a4b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/10.jpg saved to cache
2026-03-27 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 52d5eccd-702d-5495-a8b4-deae4c500722
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59064cad0>
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52d5eccd-702d-5495-a8b4-deae4c500722/52d5eccd-702d-5495-a8b4-deae4c500722_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F24bd407c046549d69f24b4b342fe0a4b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/9.jpg saved to cache
2026-03-27 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 52d5eccd-702d-5495-a8b4-deae4c500722
2026-03-27 16:50:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 52d5eccd-702d-5495-a8b4-deae4c500722, skipping ID generation
2026-03-27 16:50:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52d5eccd-702d-5495-a8b4-deae4c500722 with scrape type 1
2026-03-27 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52d5eccd-702d-5495-a8b4-deae4c500722 sending to next pipeline
2026-03-27 16:50:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 52d5eccd-702d-5495-a8b4-deae4c500722, identifier: 1988409
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910ec0d0>
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ae15d47-d027-5d15-b53a-185326b13354/0ae15d47-d027-5d15-b53a-185326b13354_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fd273fa2a0a5349f1a9fa52fec812a907%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/2.jpg saved to cache
2026-03-27 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ae15d47-d027-5d15-b53a-185326b13354
2026-03-27 16:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 52d5eccd-702d-5495-a8b4-deae4c500722 with identifier: 1988409
2026-03-27 16:50:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 52d5eccd-702d-5495-a8b4-deae4c500722 with identifier: 1988409
2026-03-27 16:50:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 52d5eccd-702d-5495-a8b4-deae4c500722 with identifier: 1988409 to the API
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '52d5eccd-702d-5495-a8b4-deae4c500722',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'TIGUAN',
'odometer': 33664,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d5eccd-702d-5495-a8b4-deae4c500722/52d5eccd-702d-5495-a8b4-deae4c500722_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 627664,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d5eccd-702d-5495-a8b4-deae4c500722/52d5eccd-702d-5495-a8b4-deae4c500722_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 627664,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d5eccd-702d-5495-a8b4-deae4c500722/52d5eccd-702d-5495-a8b4-deae4c500722_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 784393,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d5eccd-702d-5495-a8b4-deae4c500722/52d5eccd-702d-5495-a8b4-deae4c500722_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 785826,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d5eccd-702d-5495-a8b4-deae4c500722/52d5eccd-702d-5495-a8b4-deae4c500722_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 834417,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d5eccd-702d-5495-a8b4-deae4c500722/52d5eccd-702d-5495-a8b4-deae4c500722_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 788088,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d5eccd-702d-5495-a8b4-deae4c500722/52d5eccd-702d-5495-a8b4-deae4c500722_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 747215,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d5eccd-702d-5495-a8b4-deae4c500722/52d5eccd-702d-5495-a8b4-deae4c500722_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 872813,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d5eccd-702d-5495-a8b4-deae4c500722/52d5eccd-702d-5495-a8b4-deae4c500722_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 984101,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d5eccd-702d-5495-a8b4-deae4c500722/52d5eccd-702d-5495-a8b4-deae4c500722_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 828398,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/24bd407c046549d69f24b4b342fe0a4b/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-17',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN Tiguan 1.5 TSI 150ch Life Business',
'transmission': 'manual',
'trim': 'Tiguan 1.5 TSI 150ch Life Business',
'vin': None,
'year': 2021}
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988409%27 HTTP/1.1" 200 None
2026-03-27 16:50:28 [ayvens.fr] INFO: Saving data for 1988409: {'created_time': 1774630228.589863, 'last_price_update_time': 1774630228.589884, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988409') HTTP/1.1" 204 0
2026-03-27 16:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fe3477b6e809d42bd8c2d30f53c272363%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/7.jpg not downloaded yet
2026-03-27 16:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fe3477b6e809d42bd8c2d30f53c272363%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/8.jpg not downloaded yet
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590669690>
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ae15d47-d027-5d15-b53a-185326b13354/0ae15d47-d027-5d15-b53a-185326b13354_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fd273fa2a0a5349f1a9fa52fec812a907%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/3.jpg saved to cache
2026-03-27 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ae15d47-d027-5d15-b53a-185326b13354
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590696a10>
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ae15d47-d027-5d15-b53a-185326b13354/0ae15d47-d027-5d15-b53a-185326b13354_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fd273fa2a0a5349f1a9fa52fec812a907%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/5.jpg saved to cache
2026-03-27 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ae15d47-d027-5d15-b53a-185326b13354
2026-03-27 16:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:28 [ayvens.fr] INFO: Found listing with ID: 1988412
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988412%27 HTTP/1.1" 200 None
2026-03-27 16:50:28 [ayvens.fr] INFO: Scrape type for 1988412: 1
2026-03-27 16:50:28 [ayvens.fr] INFO: Extracting data for car ID: 1988412
2026-03-27 16:50:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940 with identifier: 1988412
2026-03-27 16:50:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940 with scrape type 1
2026-03-27 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F8c983d8b8ad242599ba34986cd0a871f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/1.jpg not downloaded yet
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911bac90>
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ae15d47-d027-5d15-b53a-185326b13354/0ae15d47-d027-5d15-b53a-185326b13354_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fd273fa2a0a5349f1a9fa52fec812a907%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/4.jpg saved to cache
2026-03-27 16:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ae15d47-d027-5d15-b53a-185326b13354
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591104790>
2026-03-27 16:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ae15d47-d027-5d15-b53a-185326b13354/0ae15d47-d027-5d15-b53a-185326b13354_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fd273fa2a0a5349f1a9fa52fec812a907%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/8.jpg saved to cache
2026-03-27 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ae15d47-d027-5d15-b53a-185326b13354
2026-03-27 16:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4bd10>
2026-03-27 16:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ae15d47-d027-5d15-b53a-185326b13354/0ae15d47-d027-5d15-b53a-185326b13354_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fd273fa2a0a5349f1a9fa52fec812a907%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/6.jpg saved to cache
2026-03-27 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ae15d47-d027-5d15-b53a-185326b13354
2026-03-27 16:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F8c983d8b8ad242599ba34986cd0a871f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/2.jpg not downloaded yet
2026-03-27 16:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F8c983d8b8ad242599ba34986cd0a871f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/3.jpg not downloaded yet
2026-03-27 16:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fcbad0>
2026-03-27 16:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ae15d47-d027-5d15-b53a-185326b13354/0ae15d47-d027-5d15-b53a-185326b13354_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fd273fa2a0a5349f1a9fa52fec812a907%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/7.jpg saved to cache
2026-03-27 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ae15d47-d027-5d15-b53a-185326b13354
2026-03-27 16:50:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ae15d47-d027-5d15-b53a-185326b13354, skipping ID generation
2026-03-27 16:50:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ae15d47-d027-5d15-b53a-185326b13354 with scrape type 1
2026-03-27 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ae15d47-d027-5d15-b53a-185326b13354 sending to next pipeline
2026-03-27 16:50:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0ae15d47-d027-5d15-b53a-185326b13354, identifier: 1988410
2026-03-27 16:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F8c983d8b8ad242599ba34986cd0a871f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/4.jpg not downloaded yet
2026-03-27 16:50:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0ae15d47-d027-5d15-b53a-185326b13354 with identifier: 1988410
2026-03-27 16:50:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0ae15d47-d027-5d15-b53a-185326b13354 with identifier: 1988410
2026-03-27 16:50:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0ae15d47-d027-5d15-b53a-185326b13354 with identifier: 1988410 to the API
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 94,
'color': 'GRIS TITANE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '0ae15d47-d027-5d15-b53a-185326b13354',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'LEXUS',
'model': 'UX',
'odometer': 143492,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ae15d47-d027-5d15-b53a-185326b13354/0ae15d47-d027-5d15-b53a-185326b13354_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457171,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ae15d47-d027-5d15-b53a-185326b13354/0ae15d47-d027-5d15-b53a-185326b13354_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457171,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ae15d47-d027-5d15-b53a-185326b13354/0ae15d47-d027-5d15-b53a-185326b13354_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425853,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ae15d47-d027-5d15-b53a-185326b13354/0ae15d47-d027-5d15-b53a-185326b13354_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341984,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ae15d47-d027-5d15-b53a-185326b13354/0ae15d47-d027-5d15-b53a-185326b13354_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 259741,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ae15d47-d027-5d15-b53a-185326b13354/0ae15d47-d027-5d15-b53a-185326b13354_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336017,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ae15d47-d027-5d15-b53a-185326b13354/0ae15d47-d027-5d15-b53a-185326b13354_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280898,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ae15d47-d027-5d15-b53a-185326b13354/0ae15d47-d027-5d15-b53a-185326b13354_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309780,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/d273fa2a0a5349f1a9fa52fec812a907/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-14',
'seats_number': 5,
'seller_name': None,
'title': 'LEXUS UX UX 250h 2WD Pack Business',
'transmission': 'automatic',
'trim': 'UX 250h 2WD Pack Business',
'vin': None,
'year': 2019}
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988410%27 HTTP/1.1" 200 None
2026-03-27 16:50:29 [ayvens.fr] INFO: Saving data for 1988410: {'created_time': 1774630229.863117, 'last_price_update_time': 1774630229.863128, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988410') HTTP/1.1" 204 0
2026-03-27 16:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F8c983d8b8ad242599ba34986cd0a871f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/5.jpg not downloaded yet
2026-03-27 16:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fc9a50>
2026-03-27 16:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beb0698b-4494-5893-9762-8e65e6568267/beb0698b-4494-5893-9762-8e65e6568267_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fe3477b6e809d42bd8c2d30f53c272363%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/2.jpg saved to cache
2026-03-27 16:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item beb0698b-4494-5893-9762-8e65e6568267
2026-03-27 16:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591445850>
2026-03-27 16:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beb0698b-4494-5893-9762-8e65e6568267/beb0698b-4494-5893-9762-8e65e6568267_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fe3477b6e809d42bd8c2d30f53c272363%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/1.jpg saved to cache
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item beb0698b-4494-5893-9762-8e65e6568267
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6d110>
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beb0698b-4494-5893-9762-8e65e6568267/beb0698b-4494-5893-9762-8e65e6568267_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fe3477b6e809d42bd8c2d30f53c272363%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/4.jpg saved to cache
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item beb0698b-4494-5893-9762-8e65e6568267
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904cadd0>
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beb0698b-4494-5893-9762-8e65e6568267/beb0698b-4494-5893-9762-8e65e6568267_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fe3477b6e809d42bd8c2d30f53c272363%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/5.jpg saved to cache
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item beb0698b-4494-5893-9762-8e65e6568267
2026-03-27 16:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F8c983d8b8ad242599ba34986cd0a871f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/6.jpg not downloaded yet
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F8c983d8b8ad242599ba34986cd0a871f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/7.jpg not downloaded yet
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fcab50>
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beb0698b-4494-5893-9762-8e65e6568267/beb0698b-4494-5893-9762-8e65e6568267_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fe3477b6e809d42bd8c2d30f53c272363%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/6.jpg saved to cache
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item beb0698b-4494-5893-9762-8e65e6568267
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911caa50>
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beb0698b-4494-5893-9762-8e65e6568267/beb0698b-4494-5893-9762-8e65e6568267_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fe3477b6e809d42bd8c2d30f53c272363%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/7.jpg saved to cache
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item beb0698b-4494-5893-9762-8e65e6568267
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591117f90>
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beb0698b-4494-5893-9762-8e65e6568267/beb0698b-4494-5893-9762-8e65e6568267_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fe3477b6e809d42bd8c2d30f53c272363%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/3.jpg saved to cache
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item beb0698b-4494-5893-9762-8e65e6568267
2026-03-27 16:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F8c983d8b8ad242599ba34986cd0a871f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/8.jpg not downloaded yet
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d49cd0>
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beb0698b-4494-5893-9762-8e65e6568267/beb0698b-4494-5893-9762-8e65e6568267_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fe3477b6e809d42bd8c2d30f53c272363%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/8.jpg saved to cache
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item beb0698b-4494-5893-9762-8e65e6568267
2026-03-27 16:50:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: beb0698b-4494-5893-9762-8e65e6568267, skipping ID generation
2026-03-27 16:50:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beb0698b-4494-5893-9762-8e65e6568267 with scrape type 1
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item beb0698b-4494-5893-9762-8e65e6568267 sending to next pipeline
2026-03-27 16:50:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: beb0698b-4494-5893-9762-8e65e6568267, identifier: 1988411
2026-03-27 16:50:30 [ayvens.fr] INFO: Found listing with ID: 1988413
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988413%27 HTTP/1.1" 200 None
2026-03-27 16:50:30 [ayvens.fr] INFO: Scrape type for 1988413: 1
2026-03-27 16:50:30 [ayvens.fr] INFO: Extracting data for car ID: 1988413
2026-03-27 16:50:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b497c0a6-db72-5336-b240-b825066185b7 with identifier: 1988413
2026-03-27 16:50:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b497c0a6-db72-5336-b240-b825066185b7 with scrape type 1
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b497c0a6-db72-5336-b240-b825066185b7
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F1e12ff574c1b41a182902a72d96032c5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/1.jpg not downloaded yet
2026-03-27 16:50:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: beb0698b-4494-5893-9762-8e65e6568267 with identifier: 1988411
2026-03-27 16:50:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: beb0698b-4494-5893-9762-8e65e6568267 with identifier: 1988411
2026-03-27 16:50:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: beb0698b-4494-5893-9762-8e65e6568267 with identifier: 1988411 to the API
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 48,
'color': 'NOIR ONYX',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'beb0698b-4494-5893-9762-8e65e6568267',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC40',
'odometer': 128773,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beb0698b-4494-5893-9762-8e65e6568267/beb0698b-4494-5893-9762-8e65e6568267_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435228,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beb0698b-4494-5893-9762-8e65e6568267/beb0698b-4494-5893-9762-8e65e6568267_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435228,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beb0698b-4494-5893-9762-8e65e6568267/beb0698b-4494-5893-9762-8e65e6568267_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441263,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beb0698b-4494-5893-9762-8e65e6568267/beb0698b-4494-5893-9762-8e65e6568267_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428714,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beb0698b-4494-5893-9762-8e65e6568267/beb0698b-4494-5893-9762-8e65e6568267_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298864,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beb0698b-4494-5893-9762-8e65e6568267/beb0698b-4494-5893-9762-8e65e6568267_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339271,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beb0698b-4494-5893-9762-8e65e6568267/beb0698b-4494-5893-9762-8e65e6568267_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300794,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beb0698b-4494-5893-9762-8e65e6568267/beb0698b-4494-5893-9762-8e65e6568267_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242037,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/e3477b6e809d42bd8c2d30f53c272363/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-15',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC40 XC40 T5 Recharge 180 + 82ch Business DCT 7',
'transmission': 'automatic',
'trim': 'XC40 T5 Recharge 180 + 82ch Business DCT 7',
'vin': None,
'year': 2020}
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988411%27 HTTP/1.1" 200 None
2026-03-27 16:50:30 [ayvens.fr] INFO: Saving data for 1988411: {'created_time': 1774630230.909507, 'last_price_update_time': 1774630230.90952, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988411') HTTP/1.1" 204 0
2026-03-27 16:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F1e12ff574c1b41a182902a72d96032c5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/2.jpg not downloaded yet
2026-03-27 16:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f30710>
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940/8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F8c983d8b8ad242599ba34986cd0a871f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/1.jpg saved to cache
2026-03-27 16:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940
2026-03-27 16:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F1e12ff574c1b41a182902a72d96032c5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/3.jpg not downloaded yet
2026-03-27 16:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F1e12ff574c1b41a182902a72d96032c5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/4.jpg not downloaded yet
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F1e12ff574c1b41a182902a72d96032c5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/5.jpg not downloaded yet
2026-03-27 16:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F1e12ff574c1b41a182902a72d96032c5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/6.jpg not downloaded yet
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d48c90>
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940/8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F8c983d8b8ad242599ba34986cd0a871f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/2.jpg saved to cache
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fc9b50>
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940/8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F8c983d8b8ad242599ba34986cd0a871f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/3.jpg saved to cache
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F1e12ff574c1b41a182902a72d96032c5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/7.jpg not downloaded yet
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0a090>
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940/8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F8c983d8b8ad242599ba34986cd0a871f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/5.jpg saved to cache
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F1e12ff574c1b41a182902a72d96032c5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/8.jpg not downloaded yet
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905b3b50>
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940/8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F8c983d8b8ad242599ba34986cd0a871f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/4.jpg saved to cache
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591106690>
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940/8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F8c983d8b8ad242599ba34986cd0a871f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/6.jpg saved to cache
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abff10>
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940/8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F8c983d8b8ad242599ba34986cd0a871f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/8.jpg saved to cache
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940
2026-03-27 16:50:31 [ayvens.fr] INFO: Found listing with ID: 1988414
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988414%27 HTTP/1.1" 200 None
2026-03-27 16:50:31 [ayvens.fr] INFO: Scrape type for 1988414: 1
2026-03-27 16:50:31 [ayvens.fr] INFO: Extracting data for car ID: 1988414
2026-03-27 16:50:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 536f7f25-e204-5934-a78b-ff78a28810a5 with identifier: 1988414
2026-03-27 16:50:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 536f7f25-e204-5934-a78b-ff78a28810a5 with scrape type 1
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 536f7f25-e204-5934-a78b-ff78a28810a5
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4735819912154770a0d20e0c989b6a42%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/1.jpg not downloaded yet
2026-03-27 16:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4735819912154770a0d20e0c989b6a42%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/2.jpg not downloaded yet
2026-03-27 16:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4735819912154770a0d20e0c989b6a42%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/3.jpg not downloaded yet
2026-03-27 16:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4735819912154770a0d20e0c989b6a42%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/4.jpg not downloaded yet
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4735819912154770a0d20e0c989b6a42%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/5.jpg not downloaded yet
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4735819912154770a0d20e0c989b6a42%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/6.jpg not downloaded yet
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4735819912154770a0d20e0c989b6a42%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/7.jpg not downloaded yet
2026-03-27 16:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4735819912154770a0d20e0c989b6a42%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/8.jpg not downloaded yet
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de7990>
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940/8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F8c983d8b8ad242599ba34986cd0a871f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/7.jpg saved to cache
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940
2026-03-27 16:50:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940, skipping ID generation
2026-03-27 16:50:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940 with scrape type 1
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940 sending to next pipeline
2026-03-27 16:50:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940, identifier: 1988412
2026-03-27 16:50:31 [ayvens.fr] INFO: Found listing with ID: 1988415
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988415%27 HTTP/1.1" 200 None
2026-03-27 16:50:31 [ayvens.fr] INFO: Scrape type for 1988415: 1
2026-03-27 16:50:31 [ayvens.fr] INFO: Extracting data for car ID: 1988415
2026-03-27 16:50:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3b865f8-ee85-5008-b719-3e2a388ce0e3 with identifier: 1988415
2026-03-27 16:50:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3b865f8-ee85-5008-b719-3e2a388ce0e3 with scrape type 1
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a3b865f8-ee85-5008-b719-3e2a388ce0e3
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc75d7c81fc14453ab8799686fd05833a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/1.jpg not downloaded yet
2026-03-27 16:50:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940 with identifier: 1988412
2026-03-27 16:50:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940 with identifier: 1988412
2026-03-27 16:50:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940 with identifier: 1988412 to the API
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'color': 'GRIS ELECTROCLASH',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 13602,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940/8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406396,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940/8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406396,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940/8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474790,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940/8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397488,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940/8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386006,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940/8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280975,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940/8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277033,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940/8cc2ff33-3fb2-5b7e-871b-bbca0bcb9940_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200939,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/8c983d8b8ad242599ba34986cd0a871f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-11',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 1.0 70ch BSG S&S Pack Confort',
'transmission': 'manual',
'trim': '500 1.0 70ch BSG S&S Pack Confort',
'vin': None,
'year': 2023}
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988412%27 HTTP/1.1" 200 None
2026-03-27 16:50:32 [ayvens.fr] INFO: Saving data for 1988412: {'created_time': 1774630232.428895, 'last_price_update_time': 1774630232.428907, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988412') HTTP/1.1" 204 0
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc75d7c81fc14453ab8799686fd05833a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/2.jpg not downloaded yet
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911a4310>
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b497c0a6-db72-5336-b240-b825066185b7/b497c0a6-db72-5336-b240-b825066185b7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F1e12ff574c1b41a182902a72d96032c5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/4.jpg saved to cache
2026-03-27 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b497c0a6-db72-5336-b240-b825066185b7
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f13c90>
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b497c0a6-db72-5336-b240-b825066185b7/b497c0a6-db72-5336-b240-b825066185b7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F1e12ff574c1b41a182902a72d96032c5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/1.jpg saved to cache
2026-03-27 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b497c0a6-db72-5336-b240-b825066185b7
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f10110>
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b497c0a6-db72-5336-b240-b825066185b7/b497c0a6-db72-5336-b240-b825066185b7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F1e12ff574c1b41a182902a72d96032c5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/3.jpg saved to cache
2026-03-27 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b497c0a6-db72-5336-b240-b825066185b7
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591483790>
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b497c0a6-db72-5336-b240-b825066185b7/b497c0a6-db72-5336-b240-b825066185b7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F1e12ff574c1b41a182902a72d96032c5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/2.jpg saved to cache
2026-03-27 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b497c0a6-db72-5336-b240-b825066185b7
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591482c50>
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b497c0a6-db72-5336-b240-b825066185b7/b497c0a6-db72-5336-b240-b825066185b7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F1e12ff574c1b41a182902a72d96032c5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/6.jpg saved to cache
2026-03-27 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b497c0a6-db72-5336-b240-b825066185b7
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f13450>
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b497c0a6-db72-5336-b240-b825066185b7/b497c0a6-db72-5336-b240-b825066185b7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F1e12ff574c1b41a182902a72d96032c5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/5.jpg saved to cache
2026-03-27 16:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b497c0a6-db72-5336-b240-b825066185b7
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dac250>
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b497c0a6-db72-5336-b240-b825066185b7/b497c0a6-db72-5336-b240-b825066185b7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F1e12ff574c1b41a182902a72d96032c5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/7.jpg saved to cache
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b497c0a6-db72-5336-b240-b825066185b7
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc75d7c81fc14453ab8799686fd05833a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/3.jpg not downloaded yet
2026-03-27 16:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc75d7c81fc14453ab8799686fd05833a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/4.jpg not downloaded yet
2026-03-27 16:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc75d7c81fc14453ab8799686fd05833a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/5.jpg not downloaded yet
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc75d7c81fc14453ab8799686fd05833a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/6.jpg not downloaded yet
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc75d7c81fc14453ab8799686fd05833a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/7.jpg not downloaded yet
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc75d7c81fc14453ab8799686fd05833a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/8.jpg not downloaded yet
2026-03-27 16:50:33 [ayvens.fr] INFO: Found listing with ID: 1988416
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988416%27 HTTP/1.1" 200 None
2026-03-27 16:50:33 [ayvens.fr] INFO: Scrape type for 1988416: 1
2026-03-27 16:50:33 [ayvens.fr] INFO: Extracting data for car ID: 1988416
2026-03-27 16:50:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e954377c-c6f8-5720-a943-5547b5f2a3fc with identifier: 1988416
2026-03-27 16:50:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e954377c-c6f8-5720-a943-5547b5f2a3fc with scrape type 1
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e954377c-c6f8-5720-a943-5547b5f2a3fc
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F66755cdc19ed4dafabca93c2cd2f881b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/1.jpg not downloaded yet
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F66755cdc19ed4dafabca93c2cd2f881b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/2.jpg not downloaded yet
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F66755cdc19ed4dafabca93c2cd2f881b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/3.jpg not downloaded yet
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591482450>
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_536f7f25-e204-5934-a78b-ff78a28810a5/536f7f25-e204-5934-a78b-ff78a28810a5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4735819912154770a0d20e0c989b6a42%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/1.jpg saved to cache
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 536f7f25-e204-5934-a78b-ff78a28810a5
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6d5d0>
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_536f7f25-e204-5934-a78b-ff78a28810a5/536f7f25-e204-5934-a78b-ff78a28810a5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4735819912154770a0d20e0c989b6a42%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/3.jpg saved to cache
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 536f7f25-e204-5934-a78b-ff78a28810a5
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906686d0>
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b497c0a6-db72-5336-b240-b825066185b7/b497c0a6-db72-5336-b240-b825066185b7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F1e12ff574c1b41a182902a72d96032c5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/8.jpg saved to cache
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b497c0a6-db72-5336-b240-b825066185b7
2026-03-27 16:50:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b497c0a6-db72-5336-b240-b825066185b7, skipping ID generation
2026-03-27 16:50:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b497c0a6-db72-5336-b240-b825066185b7 with scrape type 1
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b497c0a6-db72-5336-b240-b825066185b7 sending to next pipeline
2026-03-27 16:50:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b497c0a6-db72-5336-b240-b825066185b7, identifier: 1988413
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59102ef90>
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_536f7f25-e204-5934-a78b-ff78a28810a5/536f7f25-e204-5934-a78b-ff78a28810a5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4735819912154770a0d20e0c989b6a42%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/4.jpg saved to cache
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 536f7f25-e204-5934-a78b-ff78a28810a5
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efdc90>
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_536f7f25-e204-5934-a78b-ff78a28810a5/536f7f25-e204-5934-a78b-ff78a28810a5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4735819912154770a0d20e0c989b6a42%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/5.jpg saved to cache
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 536f7f25-e204-5934-a78b-ff78a28810a5
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591208cd0>
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_536f7f25-e204-5934-a78b-ff78a28810a5/536f7f25-e204-5934-a78b-ff78a28810a5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4735819912154770a0d20e0c989b6a42%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/2.jpg saved to cache
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 536f7f25-e204-5934-a78b-ff78a28810a5
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e5c10>
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_536f7f25-e204-5934-a78b-ff78a28810a5/536f7f25-e204-5934-a78b-ff78a28810a5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4735819912154770a0d20e0c989b6a42%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/6.jpg saved to cache
2026-03-27 16:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 536f7f25-e204-5934-a78b-ff78a28810a5
2026-03-27 16:50:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b497c0a6-db72-5336-b240-b825066185b7 with identifier: 1988413
2026-03-27 16:50:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:50:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b497c0a6-db72-5336-b240-b825066185b7 with identifier: 1988413
2026-03-27 16:50:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b497c0a6-db72-5336-b240-b825066185b7 with identifier: 1988413 to the API
2026-03-27 16:50:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'BLEU ATLANTIQUE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'b497c0a6-db72-5336-b240-b825066185b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 117914,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b497c0a6-db72-5336-b240-b825066185b7/b497c0a6-db72-5336-b240-b825066185b7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492810,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b497c0a6-db72-5336-b240-b825066185b7/b497c0a6-db72-5336-b240-b825066185b7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492810,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b497c0a6-db72-5336-b240-b825066185b7/b497c0a6-db72-5336-b240-b825066185b7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 467490,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b497c0a6-db72-5336-b240-b825066185b7/b497c0a6-db72-5336-b240-b825066185b7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398852,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b497c0a6-db72-5336-b240-b825066185b7/b497c0a6-db72-5336-b240-b825066185b7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328237,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b497c0a6-db72-5336-b240-b825066185b7/b497c0a6-db72-5336-b240-b825066185b7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319891,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b497c0a6-db72-5336-b240-b825066185b7/b497c0a6-db72-5336-b240-b825066185b7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394690,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b497c0a6-db72-5336-b240-b825066185b7/b497c0a6-db72-5336-b240-b825066185b7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346494,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/1e12ff574c1b41a182902a72d96032c5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-01',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN GOLF Golf 2.0 TDI SCR 115ch Life Business DSG7',
'transmission': 'automatic',
'trim': 'Golf 2.0 TDI SCR 115ch Life Business DSG7',
'vin': None,
'year': 2022}
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988413%27 HTTP/1.1" 200 None
2026-03-27 16:50:34 [ayvens.fr] INFO: Saving data for 1988413: {'created_time': 1774630234.25744, 'last_price_update_time': 1774630234.257453, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988413') HTTP/1.1" 204 0
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F66755cdc19ed4dafabca93c2cd2f881b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/4.jpg not downloaded yet
2026-03-27 16:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911cfe90>
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_536f7f25-e204-5934-a78b-ff78a28810a5/536f7f25-e204-5934-a78b-ff78a28810a5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4735819912154770a0d20e0c989b6a42%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/7.jpg saved to cache
2026-03-27 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 536f7f25-e204-5934-a78b-ff78a28810a5
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F66755cdc19ed4dafabca93c2cd2f881b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/5.jpg not downloaded yet
2026-03-27 16:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F66755cdc19ed4dafabca93c2cd2f881b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/6.jpg not downloaded yet
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfd1d0>
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3b865f8-ee85-5008-b719-3e2a388ce0e3/a3b865f8-ee85-5008-b719-3e2a388ce0e3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc75d7c81fc14453ab8799686fd05833a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/1.jpg saved to cache
2026-03-27 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3b865f8-ee85-5008-b719-3e2a388ce0e3
2026-03-27 16:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F66755cdc19ed4dafabca93c2cd2f881b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/7.jpg not downloaded yet
2026-03-27 16:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F66755cdc19ed4dafabca93c2cd2f881b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/8.jpg not downloaded yet
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591181e90>
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_536f7f25-e204-5934-a78b-ff78a28810a5/536f7f25-e204-5934-a78b-ff78a28810a5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4735819912154770a0d20e0c989b6a42%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/8.jpg saved to cache
2026-03-27 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 536f7f25-e204-5934-a78b-ff78a28810a5
2026-03-27 16:50:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 536f7f25-e204-5934-a78b-ff78a28810a5, skipping ID generation
2026-03-27 16:50:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 536f7f25-e204-5934-a78b-ff78a28810a5 with scrape type 1
2026-03-27 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 536f7f25-e204-5934-a78b-ff78a28810a5 sending to next pipeline
2026-03-27 16:50:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 536f7f25-e204-5934-a78b-ff78a28810a5, identifier: 1988414
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dff050>
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3b865f8-ee85-5008-b719-3e2a388ce0e3/a3b865f8-ee85-5008-b719-3e2a388ce0e3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc75d7c81fc14453ab8799686fd05833a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/2.jpg saved to cache
2026-03-27 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3b865f8-ee85-5008-b719-3e2a388ce0e3
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6ccd0>
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3b865f8-ee85-5008-b719-3e2a388ce0e3/a3b865f8-ee85-5008-b719-3e2a388ce0e3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc75d7c81fc14453ab8799686fd05833a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/7.jpg saved to cache
2026-03-27 16:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3b865f8-ee85-5008-b719-3e2a388ce0e3
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c0350>
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3b865f8-ee85-5008-b719-3e2a388ce0e3/a3b865f8-ee85-5008-b719-3e2a388ce0e3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc75d7c81fc14453ab8799686fd05833a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/6.jpg saved to cache
2026-03-27 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3b865f8-ee85-5008-b719-3e2a388ce0e3
2026-03-27 16:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911cd610>
2026-03-27 16:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3b865f8-ee85-5008-b719-3e2a388ce0e3/a3b865f8-ee85-5008-b719-3e2a388ce0e3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc75d7c81fc14453ab8799686fd05833a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/5.jpg saved to cache
2026-03-27 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3b865f8-ee85-5008-b719-3e2a388ce0e3
2026-03-27 16:50:35 [ayvens.fr] INFO: Found listing with ID: 1988417
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988417%27 HTTP/1.1" 200 None
2026-03-27 16:50:35 [ayvens.fr] INFO: Scrape type for 1988417: 1
2026-03-27 16:50:35 [ayvens.fr] INFO: Extracting data for car ID: 1988417
2026-03-27 16:50:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f44342f-c642-547c-ab7e-c3bbaf308242 with identifier: 1988417
2026-03-27 16:50:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f44342f-c642-547c-ab7e-c3bbaf308242 with scrape type 1
2026-03-27 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4f44342f-c642-547c-ab7e-c3bbaf308242
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F46a1b901228f42798dcd23caa2497f6a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/1.jpg not downloaded yet
2026-03-27 16:50:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 536f7f25-e204-5934-a78b-ff78a28810a5 with identifier: 1988414
2026-03-27 16:50:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 536f7f25-e204-5934-a78b-ff78a28810a5 with identifier: 1988414
2026-03-27 16:50:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 536f7f25-e204-5934-a78b-ff78a28810a5 with identifier: 1988414 to the API
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 100,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '536f7f25-e204-5934-a78b-ff78a28810a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 132821,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536f7f25-e204-5934-a78b-ff78a28810a5/536f7f25-e204-5934-a78b-ff78a28810a5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429032,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536f7f25-e204-5934-a78b-ff78a28810a5/536f7f25-e204-5934-a78b-ff78a28810a5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429032,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536f7f25-e204-5934-a78b-ff78a28810a5/536f7f25-e204-5934-a78b-ff78a28810a5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411834,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536f7f25-e204-5934-a78b-ff78a28810a5/536f7f25-e204-5934-a78b-ff78a28810a5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375073,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536f7f25-e204-5934-a78b-ff78a28810a5/536f7f25-e204-5934-a78b-ff78a28810a5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321981,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536f7f25-e204-5934-a78b-ff78a28810a5/536f7f25-e204-5934-a78b-ff78a28810a5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328244,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536f7f25-e204-5934-a78b-ff78a28810a5/536f7f25-e204-5934-a78b-ff78a28810a5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319983,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536f7f25-e204-5934-a78b-ff78a28810a5/536f7f25-e204-5934-a78b-ff78a28810a5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412493,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/4735819912154770a0d20e0c989b6a42/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-04',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.5 BlueHDi 130ch.c Active Business S&S',
'transmission': 'manual',
'trim': '3008 1.5 BlueHDi 130ch.c Active Business S&S',
'vin': None,
'year': 2019}
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988414%27 HTTP/1.1" 200 None
2026-03-27 16:50:35 [ayvens.fr] INFO: Saving data for 1988414: {'created_time': 1774630235.500211, 'last_price_update_time': 1774630235.500221, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988414') HTTP/1.1" 204 0
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F46a1b901228f42798dcd23caa2497f6a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/2.jpg not downloaded yet
2026-03-27 16:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7f410>
2026-03-27 16:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3b865f8-ee85-5008-b719-3e2a388ce0e3/a3b865f8-ee85-5008-b719-3e2a388ce0e3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc75d7c81fc14453ab8799686fd05833a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/3.jpg saved to cache
2026-03-27 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3b865f8-ee85-5008-b719-3e2a388ce0e3
2026-03-27 16:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59052a0d0>
2026-03-27 16:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3b865f8-ee85-5008-b719-3e2a388ce0e3/a3b865f8-ee85-5008-b719-3e2a388ce0e3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc75d7c81fc14453ab8799686fd05833a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/4.jpg saved to cache
2026-03-27 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3b865f8-ee85-5008-b719-3e2a388ce0e3
2026-03-27 16:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe1790>
2026-03-27 16:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3b865f8-ee85-5008-b719-3e2a388ce0e3/a3b865f8-ee85-5008-b719-3e2a388ce0e3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fc75d7c81fc14453ab8799686fd05833a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/8.jpg saved to cache
2026-03-27 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3b865f8-ee85-5008-b719-3e2a388ce0e3
2026-03-27 16:50:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3b865f8-ee85-5008-b719-3e2a388ce0e3, skipping ID generation
2026-03-27 16:50:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3b865f8-ee85-5008-b719-3e2a388ce0e3 with scrape type 1
2026-03-27 16:50:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3b865f8-ee85-5008-b719-3e2a388ce0e3 sending to next pipeline
2026-03-27 16:50:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a3b865f8-ee85-5008-b719-3e2a388ce0e3, identifier: 1988415
2026-03-27 16:50:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a3b865f8-ee85-5008-b719-3e2a388ce0e3 with identifier: 1988415
2026-03-27 16:50:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a3b865f8-ee85-5008-b719-3e2a388ce0e3 with identifier: 1988415
2026-03-27 16:50:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a3b865f8-ee85-5008-b719-3e2a388ce0e3 with identifier: 1988415 to the API
2026-03-27 16:50:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'GRIS NUIT',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': 'a3b865f8-ee85-5008-b719-3e2a388ce0e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TESLA',
'model': 'MODEL 3',
'odometer': 52020,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3b865f8-ee85-5008-b719-3e2a388ce0e3/a3b865f8-ee85-5008-b719-3e2a388ce0e3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303864,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3b865f8-ee85-5008-b719-3e2a388ce0e3/a3b865f8-ee85-5008-b719-3e2a388ce0e3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303864,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3b865f8-ee85-5008-b719-3e2a388ce0e3/a3b865f8-ee85-5008-b719-3e2a388ce0e3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326506,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3b865f8-ee85-5008-b719-3e2a388ce0e3/a3b865f8-ee85-5008-b719-3e2a388ce0e3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356919,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3b865f8-ee85-5008-b719-3e2a388ce0e3/a3b865f8-ee85-5008-b719-3e2a388ce0e3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283105,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3b865f8-ee85-5008-b719-3e2a388ce0e3/a3b865f8-ee85-5008-b719-3e2a388ce0e3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316545,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3b865f8-ee85-5008-b719-3e2a388ce0e3/a3b865f8-ee85-5008-b719-3e2a388ce0e3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303872,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3b865f8-ee85-5008-b719-3e2a388ce0e3/a3b865f8-ee85-5008-b719-3e2a388ce0e3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191808,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/c75d7c81fc14453ab8799686fd05833a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-08',
'seats_number': 5,
'seller_name': None,
'title': 'TESLA MODEL 3 Model 3 Standard RWD Plus MY22',
'transmission': 'automatic',
'trim': 'Model 3 Standard RWD Plus MY22',
'vin': None,
'year': 2022}
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988415%27 HTTP/1.1" 200 None
2026-03-27 16:50:36 [ayvens.fr] INFO: Saving data for 1988415: {'created_time': 1774630236.165162, 'last_price_update_time': 1774630236.165176, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988415') HTTP/1.1" 204 0
2026-03-27 16:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F46a1b901228f42798dcd23caa2497f6a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/3.jpg not downloaded yet
2026-03-27 16:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F46a1b901228f42798dcd23caa2497f6a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/4.jpg not downloaded yet
2026-03-27 16:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F46a1b901228f42798dcd23caa2497f6a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/5.jpg not downloaded yet
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F46a1b901228f42798dcd23caa2497f6a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/6.jpg not downloaded yet
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F46a1b901228f42798dcd23caa2497f6a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/7.jpg not downloaded yet
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F46a1b901228f42798dcd23caa2497f6a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/8.jpg not downloaded yet
2026-03-27 16:50:36 [ayvens.fr] INFO: Found listing with ID: 1988418
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988418%27 HTTP/1.1" 200 None
2026-03-27 16:50:36 [ayvens.fr] INFO: Scrape type for 1988418: 1
2026-03-27 16:50:36 [ayvens.fr] INFO: Extracting data for car ID: 1988418
2026-03-27 16:50:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f339786d-5059-55f1-9a56-d8c770e12da8 with identifier: 1988418
2026-03-27 16:50:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f339786d-5059-55f1-9a56-d8c770e12da8 with scrape type 1
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f339786d-5059-55f1-9a56-d8c770e12da8
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F61cc60f450bd4e5383cc5f1f3b58d54e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/1.jpg not downloaded yet
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d6f7d0>
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e954377c-c6f8-5720-a943-5547b5f2a3fc/e954377c-c6f8-5720-a943-5547b5f2a3fc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F66755cdc19ed4dafabca93c2cd2f881b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/6.jpg saved to cache
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e954377c-c6f8-5720-a943-5547b5f2a3fc
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910d1790>
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e954377c-c6f8-5720-a943-5547b5f2a3fc/e954377c-c6f8-5720-a943-5547b5f2a3fc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F66755cdc19ed4dafabca93c2cd2f881b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/2.jpg saved to cache
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e954377c-c6f8-5720-a943-5547b5f2a3fc
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903cfb90>
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e954377c-c6f8-5720-a943-5547b5f2a3fc/e954377c-c6f8-5720-a943-5547b5f2a3fc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F66755cdc19ed4dafabca93c2cd2f881b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/3.jpg saved to cache
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e954377c-c6f8-5720-a943-5547b5f2a3fc
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b5a290>
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e954377c-c6f8-5720-a943-5547b5f2a3fc/e954377c-c6f8-5720-a943-5547b5f2a3fc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F66755cdc19ed4dafabca93c2cd2f881b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/1.jpg saved to cache
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e954377c-c6f8-5720-a943-5547b5f2a3fc
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903cca10>
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e954377c-c6f8-5720-a943-5547b5f2a3fc/e954377c-c6f8-5720-a943-5547b5f2a3fc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F66755cdc19ed4dafabca93c2cd2f881b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/4.jpg saved to cache
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e954377c-c6f8-5720-a943-5547b5f2a3fc
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F61cc60f450bd4e5383cc5f1f3b58d54e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/2.jpg not downloaded yet
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5938d3c10>
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e954377c-c6f8-5720-a943-5547b5f2a3fc/e954377c-c6f8-5720-a943-5547b5f2a3fc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F66755cdc19ed4dafabca93c2cd2f881b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/5.jpg saved to cache
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e954377c-c6f8-5720-a943-5547b5f2a3fc
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F61cc60f450bd4e5383cc5f1f3b58d54e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/3.jpg not downloaded yet
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904fde10>
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e954377c-c6f8-5720-a943-5547b5f2a3fc/e954377c-c6f8-5720-a943-5547b5f2a3fc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F66755cdc19ed4dafabca93c2cd2f881b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/7.jpg saved to cache
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e954377c-c6f8-5720-a943-5547b5f2a3fc
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904fcb90>
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e954377c-c6f8-5720-a943-5547b5f2a3fc/e954377c-c6f8-5720-a943-5547b5f2a3fc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F66755cdc19ed4dafabca93c2cd2f881b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/8.jpg saved to cache
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e954377c-c6f8-5720-a943-5547b5f2a3fc
2026-03-27 16:50:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e954377c-c6f8-5720-a943-5547b5f2a3fc, skipping ID generation
2026-03-27 16:50:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e954377c-c6f8-5720-a943-5547b5f2a3fc with scrape type 1
2026-03-27 16:50:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e954377c-c6f8-5720-a943-5547b5f2a3fc sending to next pipeline
2026-03-27 16:50:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e954377c-c6f8-5720-a943-5547b5f2a3fc, identifier: 1988416
2026-03-27 16:50:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e954377c-c6f8-5720-a943-5547b5f2a3fc with identifier: 1988416
2026-03-27 16:50:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:50:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e954377c-c6f8-5720-a943-5547b5f2a3fc with identifier: 1988416
2026-03-27 16:50:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e954377c-c6f8-5720-a943-5547b5f2a3fc with identifier: 1988416 to the API
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'ARGENT SILVER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'e954377c-c6f8-5720-a943-5547b5f2a3fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 35669,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e954377c-c6f8-5720-a943-5547b5f2a3fc/e954377c-c6f8-5720-a943-5547b5f2a3fc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313214,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e954377c-c6f8-5720-a943-5547b5f2a3fc/e954377c-c6f8-5720-a943-5547b5f2a3fc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313214,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e954377c-c6f8-5720-a943-5547b5f2a3fc/e954377c-c6f8-5720-a943-5547b5f2a3fc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294396,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e954377c-c6f8-5720-a943-5547b5f2a3fc/e954377c-c6f8-5720-a943-5547b5f2a3fc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306570,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e954377c-c6f8-5720-a943-5547b5f2a3fc/e954377c-c6f8-5720-a943-5547b5f2a3fc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367588,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e954377c-c6f8-5720-a943-5547b5f2a3fc/e954377c-c6f8-5720-a943-5547b5f2a3fc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295237,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e954377c-c6f8-5720-a943-5547b5f2a3fc/e954377c-c6f8-5720-a943-5547b5f2a3fc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364092,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e954377c-c6f8-5720-a943-5547b5f2a3fc/e954377c-c6f8-5720-a943-5547b5f2a3fc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307619,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/66755cdc19ed4dafabca93c2cd2f881b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-29',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN POLO Polo 1.0 TSI 95ch R-Line DSG7',
'transmission': 'automatic',
'trim': 'Polo 1.0 TSI 95ch R-Line DSG7',
'vin': None,
'year': 2023}
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988416%27 HTTP/1.1" 200 None
2026-03-27 16:50:37 [ayvens.fr] INFO: Saving data for 1988416: {'created_time': 1774630237.303401, 'last_price_update_time': 1774630237.303413, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988416') HTTP/1.1" 204 0
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F61cc60f450bd4e5383cc5f1f3b58d54e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/4.jpg not downloaded yet
2026-03-27 16:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F61cc60f450bd4e5383cc5f1f3b58d54e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/5.jpg not downloaded yet
2026-03-27 16:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F61cc60f450bd4e5383cc5f1f3b58d54e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/6.jpg not downloaded yet
2026-03-27 16:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F61cc60f450bd4e5383cc5f1f3b58d54e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/7.jpg not downloaded yet
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F61cc60f450bd4e5383cc5f1f3b58d54e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/8.jpg not downloaded yet
2026-03-27 16:50:37 [ayvens.fr] INFO: Found listing with ID: 1988419
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988419%27 HTTP/1.1" 200 None
2026-03-27 16:50:37 [ayvens.fr] INFO: Scrape type for 1988419: 1
2026-03-27 16:50:37 [ayvens.fr] INFO: Extracting data for car ID: 1988419
2026-03-27 16:50:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d873425a-89d8-552e-b61c-e3ec50f1f51f with identifier: 1988419
2026-03-27 16:50:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d873425a-89d8-552e-b61c-e3ec50f1f51f with scrape type 1
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d873425a-89d8-552e-b61c-e3ec50f1f51f
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9d09cc0135a3472bb02388395f575892%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/1.jpg not downloaded yet
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9d09cc0135a3472bb02388395f575892%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/2.jpg not downloaded yet
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9d09cc0135a3472bb02388395f575892%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/3.jpg not downloaded yet
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9d09cc0135a3472bb02388395f575892%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/4.jpg not downloaded yet
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590590950>
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f44342f-c642-547c-ab7e-c3bbaf308242/4f44342f-c642-547c-ab7e-c3bbaf308242_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F46a1b901228f42798dcd23caa2497f6a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/1.jpg saved to cache
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f44342f-c642-547c-ab7e-c3bbaf308242
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c0cd0>
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f44342f-c642-547c-ab7e-c3bbaf308242/4f44342f-c642-547c-ab7e-c3bbaf308242_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F46a1b901228f42798dcd23caa2497f6a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/4.jpg saved to cache
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f44342f-c642-547c-ab7e-c3bbaf308242
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906560d0>
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f44342f-c642-547c-ab7e-c3bbaf308242/4f44342f-c642-547c-ab7e-c3bbaf308242_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F46a1b901228f42798dcd23caa2497f6a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/6.jpg saved to cache
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f44342f-c642-547c-ab7e-c3bbaf308242
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066db90>
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f44342f-c642-547c-ab7e-c3bbaf308242/4f44342f-c642-547c-ab7e-c3bbaf308242_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F46a1b901228f42798dcd23caa2497f6a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/5.jpg saved to cache
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f44342f-c642-547c-ab7e-c3bbaf308242
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590656350>
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f44342f-c642-547c-ab7e-c3bbaf308242/4f44342f-c642-547c-ab7e-c3bbaf308242_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F46a1b901228f42798dcd23caa2497f6a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/7.jpg saved to cache
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f44342f-c642-547c-ab7e-c3bbaf308242
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9d09cc0135a3472bb02388395f575892%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/5.jpg not downloaded yet
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59287ba10>
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f44342f-c642-547c-ab7e-c3bbaf308242/4f44342f-c642-547c-ab7e-c3bbaf308242_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F46a1b901228f42798dcd23caa2497f6a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/3.jpg saved to cache
2026-03-27 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f44342f-c642-547c-ab7e-c3bbaf308242
2026-03-27 16:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59120be10>
2026-03-27 16:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f44342f-c642-547c-ab7e-c3bbaf308242/4f44342f-c642-547c-ab7e-c3bbaf308242_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F46a1b901228f42798dcd23caa2497f6a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/2.jpg saved to cache
2026-03-27 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f44342f-c642-547c-ab7e-c3bbaf308242
2026-03-27 16:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9d09cc0135a3472bb02388395f575892%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/6.jpg not downloaded yet
2026-03-27 16:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065db10>
2026-03-27 16:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f44342f-c642-547c-ab7e-c3bbaf308242/4f44342f-c642-547c-ab7e-c3bbaf308242_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F46a1b901228f42798dcd23caa2497f6a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/8.jpg saved to cache
2026-03-27 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f44342f-c642-547c-ab7e-c3bbaf308242
2026-03-27 16:50:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f44342f-c642-547c-ab7e-c3bbaf308242, skipping ID generation
2026-03-27 16:50:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f44342f-c642-547c-ab7e-c3bbaf308242 with scrape type 1
2026-03-27 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f44342f-c642-547c-ab7e-c3bbaf308242 sending to next pipeline
2026-03-27 16:50:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4f44342f-c642-547c-ab7e-c3bbaf308242, identifier: 1988417
2026-03-27 16:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9d09cc0135a3472bb02388395f575892%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/7.jpg not downloaded yet
2026-03-27 16:50:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4f44342f-c642-547c-ab7e-c3bbaf308242 with identifier: 1988417
2026-03-27 16:50:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4f44342f-c642-547c-ab7e-c3bbaf308242 with identifier: 1988417
2026-03-27 16:50:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4f44342f-c642-547c-ab7e-c3bbaf308242 with identifier: 1988417 to the API
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 46,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '4f44342f-c642-547c-ab7e-c3bbaf308242',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'X3',
'odometer': 111897,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f44342f-c642-547c-ab7e-c3bbaf308242/4f44342f-c642-547c-ab7e-c3bbaf308242_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 479096,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f44342f-c642-547c-ab7e-c3bbaf308242/4f44342f-c642-547c-ab7e-c3bbaf308242_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 479096,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f44342f-c642-547c-ab7e-c3bbaf308242/4f44342f-c642-547c-ab7e-c3bbaf308242_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 487076,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f44342f-c642-547c-ab7e-c3bbaf308242/4f44342f-c642-547c-ab7e-c3bbaf308242_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425307,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f44342f-c642-547c-ab7e-c3bbaf308242/4f44342f-c642-547c-ab7e-c3bbaf308242_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364476,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f44342f-c642-547c-ab7e-c3bbaf308242/4f44342f-c642-547c-ab7e-c3bbaf308242_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357103,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f44342f-c642-547c-ab7e-c3bbaf308242/4f44342f-c642-547c-ab7e-c3bbaf308242_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376127,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f44342f-c642-547c-ab7e-c3bbaf308242/4f44342f-c642-547c-ab7e-c3bbaf308242_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458835,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/46a1b901228f42798dcd23caa2497f6a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-08',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 X3 xDrive30e 292ch M Sport',
'transmission': 'automatic',
'trim': 'X3 xDrive30e 292ch M Sport',
'vin': None,
'year': 2023}
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988417%27 HTTP/1.1" 200 None
2026-03-27 16:50:38 [ayvens.fr] INFO: Saving data for 1988417: {'created_time': 1774630238.67028, 'last_price_update_time': 1774630238.670292, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988417') HTTP/1.1" 204 0
2026-03-27 16:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9d09cc0135a3472bb02388395f575892%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/8.jpg not downloaded yet
2026-03-27 16:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d8c190>
2026-03-27 16:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f339786d-5059-55f1-9a56-d8c770e12da8/f339786d-5059-55f1-9a56-d8c770e12da8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F61cc60f450bd4e5383cc5f1f3b58d54e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/6.jpg saved to cache
2026-03-27 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f339786d-5059-55f1-9a56-d8c770e12da8
2026-03-27 16:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065f850>
2026-03-27 16:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f339786d-5059-55f1-9a56-d8c770e12da8/f339786d-5059-55f1-9a56-d8c770e12da8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F61cc60f450bd4e5383cc5f1f3b58d54e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/1.jpg saved to cache
2026-03-27 16:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f339786d-5059-55f1-9a56-d8c770e12da8
2026-03-27 16:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfec90>
2026-03-27 16:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f339786d-5059-55f1-9a56-d8c770e12da8/f339786d-5059-55f1-9a56-d8c770e12da8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F61cc60f450bd4e5383cc5f1f3b58d54e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/2.jpg saved to cache
2026-03-27 16:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f339786d-5059-55f1-9a56-d8c770e12da8
2026-03-27 16:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065d090>
2026-03-27 16:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f339786d-5059-55f1-9a56-d8c770e12da8/f339786d-5059-55f1-9a56-d8c770e12da8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F61cc60f450bd4e5383cc5f1f3b58d54e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/8.jpg saved to cache
2026-03-27 16:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f339786d-5059-55f1-9a56-d8c770e12da8
2026-03-27 16:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911cc290>
2026-03-27 16:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f339786d-5059-55f1-9a56-d8c770e12da8/f339786d-5059-55f1-9a56-d8c770e12da8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F61cc60f450bd4e5383cc5f1f3b58d54e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/5.jpg saved to cache
2026-03-27 16:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f339786d-5059-55f1-9a56-d8c770e12da8
2026-03-27 16:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e5e10>
2026-03-27 16:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f339786d-5059-55f1-9a56-d8c770e12da8/f339786d-5059-55f1-9a56-d8c770e12da8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F61cc60f450bd4e5383cc5f1f3b58d54e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/4.jpg saved to cache
2026-03-27 16:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f339786d-5059-55f1-9a56-d8c770e12da8
2026-03-27 16:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfcbd0>
2026-03-27 16:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f339786d-5059-55f1-9a56-d8c770e12da8/f339786d-5059-55f1-9a56-d8c770e12da8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F61cc60f450bd4e5383cc5f1f3b58d54e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/3.jpg saved to cache
2026-03-27 16:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f339786d-5059-55f1-9a56-d8c770e12da8
2026-03-27 16:50:39 [ayvens.fr] INFO: Found listing with ID: 1988420
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988420%27 HTTP/1.1" 200 None
2026-03-27 16:50:39 [ayvens.fr] INFO: Scrape type for 1988420: 1
2026-03-27 16:50:39 [ayvens.fr] INFO: Extracting data for car ID: 1988420
2026-03-27 16:50:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a656b1d2-a6dd-57a1-a2dc-6abbfa90b250 with identifier: 1988420
2026-03-27 16:50:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a656b1d2-a6dd-57a1-a2dc-6abbfa90b250 with scrape type 1
2026-03-27 16:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a656b1d2-a6dd-57a1-a2dc-6abbfa90b250
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F4df9f22e15f242549cb9e29d7c7f05c2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/1.jpg not downloaded yet
2026-03-27 16:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F4df9f22e15f242549cb9e29d7c7f05c2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/2.jpg not downloaded yet
2026-03-27 16:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59064cd90>
2026-03-27 16:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f339786d-5059-55f1-9a56-d8c770e12da8/f339786d-5059-55f1-9a56-d8c770e12da8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F61cc60f450bd4e5383cc5f1f3b58d54e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/7.jpg saved to cache
2026-03-27 16:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f339786d-5059-55f1-9a56-d8c770e12da8
2026-03-27 16:50:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f339786d-5059-55f1-9a56-d8c770e12da8, skipping ID generation
2026-03-27 16:50:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f339786d-5059-55f1-9a56-d8c770e12da8 with scrape type 1
2026-03-27 16:50:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f339786d-5059-55f1-9a56-d8c770e12da8 sending to next pipeline
2026-03-27 16:50:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f339786d-5059-55f1-9a56-d8c770e12da8, identifier: 1988418
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F4df9f22e15f242549cb9e29d7c7f05c2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/3.jpg not downloaded yet
2026-03-27 16:50:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f339786d-5059-55f1-9a56-d8c770e12da8 with identifier: 1988418
2026-03-27 16:50:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f339786d-5059-55f1-9a56-d8c770e12da8 with identifier: 1988418
2026-03-27 16:50:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f339786d-5059-55f1-9a56-d8c770e12da8 with identifier: 1988418 to the API
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'f339786d-5059-55f1-9a56-d8c770e12da8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 104557,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f339786d-5059-55f1-9a56-d8c770e12da8/f339786d-5059-55f1-9a56-d8c770e12da8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319201,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f339786d-5059-55f1-9a56-d8c770e12da8/f339786d-5059-55f1-9a56-d8c770e12da8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319201,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f339786d-5059-55f1-9a56-d8c770e12da8/f339786d-5059-55f1-9a56-d8c770e12da8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296028,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f339786d-5059-55f1-9a56-d8c770e12da8/f339786d-5059-55f1-9a56-d8c770e12da8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292360,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f339786d-5059-55f1-9a56-d8c770e12da8/f339786d-5059-55f1-9a56-d8c770e12da8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339349,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f339786d-5059-55f1-9a56-d8c770e12da8/f339786d-5059-55f1-9a56-d8c770e12da8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308457,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f339786d-5059-55f1-9a56-d8c770e12da8/f339786d-5059-55f1-9a56-d8c770e12da8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346966,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f339786d-5059-55f1-9a56-d8c770e12da8/f339786d-5059-55f1-9a56-d8c770e12da8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 259651,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/61cc60f450bd4e5383cc5f1f3b58d54e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-24',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.0 TCe 90ch Evolution',
'transmission': 'manual',
'trim': 'Clio 1.0 TCe 90ch Evolution',
'vin': None,
'year': 2022}
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988418%27 HTTP/1.1" 200 None
2026-03-27 16:50:40 [ayvens.fr] INFO: Saving data for 1988418: {'created_time': 1774630240.086022, 'last_price_update_time': 1774630240.086032, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988418') HTTP/1.1" 204 0
2026-03-27 16:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F4df9f22e15f242549cb9e29d7c7f05c2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/4.jpg not downloaded yet
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59f01fdd0>
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d873425a-89d8-552e-b61c-e3ec50f1f51f/d873425a-89d8-552e-b61c-e3ec50f1f51f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9d09cc0135a3472bb02388395f575892%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/1.jpg saved to cache
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d873425a-89d8-552e-b61c-e3ec50f1f51f
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590511490>
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d873425a-89d8-552e-b61c-e3ec50f1f51f/d873425a-89d8-552e-b61c-e3ec50f1f51f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9d09cc0135a3472bb02388395f575892%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/2.jpg saved to cache
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d873425a-89d8-552e-b61c-e3ec50f1f51f
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae0b10>
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d873425a-89d8-552e-b61c-e3ec50f1f51f/d873425a-89d8-552e-b61c-e3ec50f1f51f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9d09cc0135a3472bb02388395f575892%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/4.jpg saved to cache
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d873425a-89d8-552e-b61c-e3ec50f1f51f
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9cc90>
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d873425a-89d8-552e-b61c-e3ec50f1f51f/d873425a-89d8-552e-b61c-e3ec50f1f51f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9d09cc0135a3472bb02388395f575892%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/3.jpg saved to cache
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d873425a-89d8-552e-b61c-e3ec50f1f51f
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F4df9f22e15f242549cb9e29d7c7f05c2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/5.jpg not downloaded yet
2026-03-27 16:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F4df9f22e15f242549cb9e29d7c7f05c2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/6.jpg not downloaded yet
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b23210>
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d873425a-89d8-552e-b61c-e3ec50f1f51f/d873425a-89d8-552e-b61c-e3ec50f1f51f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9d09cc0135a3472bb02388395f575892%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/6.jpg saved to cache
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d873425a-89d8-552e-b61c-e3ec50f1f51f
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fc9410>
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d873425a-89d8-552e-b61c-e3ec50f1f51f/d873425a-89d8-552e-b61c-e3ec50f1f51f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9d09cc0135a3472bb02388395f575892%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/5.jpg saved to cache
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d873425a-89d8-552e-b61c-e3ec50f1f51f
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F4df9f22e15f242549cb9e29d7c7f05c2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/7.jpg not downloaded yet
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F4df9f22e15f242549cb9e29d7c7f05c2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/8.jpg not downloaded yet
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d49650>
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d873425a-89d8-552e-b61c-e3ec50f1f51f/d873425a-89d8-552e-b61c-e3ec50f1f51f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9d09cc0135a3472bb02388395f575892%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/7.jpg saved to cache
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d873425a-89d8-552e-b61c-e3ec50f1f51f
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e8f790>
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d873425a-89d8-552e-b61c-e3ec50f1f51f/d873425a-89d8-552e-b61c-e3ec50f1f51f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F9d09cc0135a3472bb02388395f575892%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/8.jpg saved to cache
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d873425a-89d8-552e-b61c-e3ec50f1f51f
2026-03-27 16:50:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d873425a-89d8-552e-b61c-e3ec50f1f51f, skipping ID generation
2026-03-27 16:50:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d873425a-89d8-552e-b61c-e3ec50f1f51f with scrape type 1
2026-03-27 16:50:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d873425a-89d8-552e-b61c-e3ec50f1f51f sending to next pipeline
2026-03-27 16:50:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d873425a-89d8-552e-b61c-e3ec50f1f51f, identifier: 1988419
2026-03-27 16:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d873425a-89d8-552e-b61c-e3ec50f1f51f with identifier: 1988419
2026-03-27 16:50:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:50:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d873425a-89d8-552e-b61c-e3ec50f1f51f with identifier: 1988419
2026-03-27 16:50:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d873425a-89d8-552e-b61c-e3ec50f1f51f with identifier: 1988419 to the API
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 146,
'color': 'BLEU CELEBS',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'd873425a-89d8-552e-b61c-e3ec50f1f51f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 47229,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d873425a-89d8-552e-b61c-e3ec50f1f51f/d873425a-89d8-552e-b61c-e3ec50f1f51f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343623,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d873425a-89d8-552e-b61c-e3ec50f1f51f/d873425a-89d8-552e-b61c-e3ec50f1f51f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343623,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d873425a-89d8-552e-b61c-e3ec50f1f51f/d873425a-89d8-552e-b61c-e3ec50f1f51f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338323,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d873425a-89d8-552e-b61c-e3ec50f1f51f/d873425a-89d8-552e-b61c-e3ec50f1f51f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309481,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d873425a-89d8-552e-b61c-e3ec50f1f51f/d873425a-89d8-552e-b61c-e3ec50f1f51f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378723,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d873425a-89d8-552e-b61c-e3ec50f1f51f/d873425a-89d8-552e-b61c-e3ec50f1f51f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307895,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d873425a-89d8-552e-b61c-e3ec50f1f51f/d873425a-89d8-552e-b61c-e3ec50f1f51f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306313,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d873425a-89d8-552e-b61c-e3ec50f1f51f/d873425a-89d8-552e-b61c-e3ec50f1f51f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374634,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/9d09cc0135a3472bb02388395f575892/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-16',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch S&S Allure Pack EAT8',
'transmission': 'automatic',
'trim': '3008 1.2 PureTech 130ch S&S Allure Pack EAT8',
'vin': None,
'year': 2022}
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988419%27 HTTP/1.1" 200 None
2026-03-27 16:50:41 [ayvens.fr] INFO: Saving data for 1988419: {'created_time': 1774630241.587298, 'last_price_update_time': 1774630241.587309, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988419') HTTP/1.1" 204 0
2026-03-27 16:50:41 [ayvens.fr] INFO: Found listing with ID: 1988421
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988421%27 HTTP/1.1" 200 None
2026-03-27 16:50:41 [ayvens.fr] INFO: Scrape type for 1988421: 1
2026-03-27 16:50:41 [ayvens.fr] INFO: Extracting data for car ID: 1988421
2026-03-27 16:50:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7715689-55f8-5493-a9f8-dfb6dc9c67c0 with identifier: 1988421
2026-03-27 16:50:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7715689-55f8-5493-a9f8-dfb6dc9c67c0 with scrape type 1
2026-03-27 16:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f7715689-55f8-5493-a9f8-dfb6dc9c67c0
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc16ff704cda34d4389956114145692a2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/1.jpg not downloaded yet
2026-03-27 16:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc16ff704cda34d4389956114145692a2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/2.jpg not downloaded yet
2026-03-27 16:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f636d0>
2026-03-27 16:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a656b1d2-a6dd-57a1-a2dc-6abbfa90b250/a656b1d2-a6dd-57a1-a2dc-6abbfa90b250_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F4df9f22e15f242549cb9e29d7c7f05c2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/1.jpg saved to cache
2026-03-27 16:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a656b1d2-a6dd-57a1-a2dc-6abbfa90b250
2026-03-27 16:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ab8150>
2026-03-27 16:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a656b1d2-a6dd-57a1-a2dc-6abbfa90b250/a656b1d2-a6dd-57a1-a2dc-6abbfa90b250_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F4df9f22e15f242549cb9e29d7c7f05c2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/2.jpg saved to cache
2026-03-27 16:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a656b1d2-a6dd-57a1-a2dc-6abbfa90b250
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc16ff704cda34d4389956114145692a2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/3.jpg not downloaded yet
2026-03-27 16:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc16ff704cda34d4389956114145692a2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/4.jpg not downloaded yet
2026-03-27 16:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d3d50>
2026-03-27 16:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a656b1d2-a6dd-57a1-a2dc-6abbfa90b250/a656b1d2-a6dd-57a1-a2dc-6abbfa90b250_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F4df9f22e15f242549cb9e29d7c7f05c2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/3.jpg saved to cache
2026-03-27 16:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a656b1d2-a6dd-57a1-a2dc-6abbfa90b250
2026-03-27 16:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b41f90>
2026-03-27 16:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a656b1d2-a6dd-57a1-a2dc-6abbfa90b250/a656b1d2-a6dd-57a1-a2dc-6abbfa90b250_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F4df9f22e15f242549cb9e29d7c7f05c2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/4.jpg saved to cache
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a656b1d2-a6dd-57a1-a2dc-6abbfa90b250
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc16ff704cda34d4389956114145692a2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/5.jpg not downloaded yet
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e8d650>
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a656b1d2-a6dd-57a1-a2dc-6abbfa90b250/a656b1d2-a6dd-57a1-a2dc-6abbfa90b250_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F4df9f22e15f242549cb9e29d7c7f05c2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/5.jpg saved to cache
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a656b1d2-a6dd-57a1-a2dc-6abbfa90b250
2026-03-27 16:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc16ff704cda34d4389956114145692a2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/6.jpg not downloaded yet
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b423d0>
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a656b1d2-a6dd-57a1-a2dc-6abbfa90b250/a656b1d2-a6dd-57a1-a2dc-6abbfa90b250_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F4df9f22e15f242549cb9e29d7c7f05c2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/6.jpg saved to cache
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a656b1d2-a6dd-57a1-a2dc-6abbfa90b250
2026-03-27 16:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc16ff704cda34d4389956114145692a2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/7.jpg not downloaded yet
2026-03-27 16:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc16ff704cda34d4389956114145692a2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/8.jpg not downloaded yet
2026-03-27 16:50:42 [ayvens.fr] INFO: Found listing with ID: 1988422
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988422%27 HTTP/1.1" 200 None
2026-03-27 16:50:42 [ayvens.fr] INFO: Scrape type for 1988422: 1
2026-03-27 16:50:42 [ayvens.fr] INFO: Extracting data for car ID: 1988422
2026-03-27 16:50:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8 with identifier: 1988422
2026-03-27 16:50:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8 with scrape type 1
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6feb9a81fb8e485892d229fe00eafe58%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/1.jpg not downloaded yet
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050cc10>
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a656b1d2-a6dd-57a1-a2dc-6abbfa90b250/a656b1d2-a6dd-57a1-a2dc-6abbfa90b250_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F4df9f22e15f242549cb9e29d7c7f05c2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/7.jpg saved to cache
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a656b1d2-a6dd-57a1-a2dc-6abbfa90b250
2026-03-27 16:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6feb9a81fb8e485892d229fe00eafe58%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/2.jpg not downloaded yet
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6feb9a81fb8e485892d229fe00eafe58%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/3.jpg not downloaded yet
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ddb410>
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7715689-55f8-5493-a9f8-dfb6dc9c67c0/f7715689-55f8-5493-a9f8-dfb6dc9c67c0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc16ff704cda34d4389956114145692a2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/1.jpg saved to cache
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7715689-55f8-5493-a9f8-dfb6dc9c67c0
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7f1d0>
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a656b1d2-a6dd-57a1-a2dc-6abbfa90b250/a656b1d2-a6dd-57a1-a2dc-6abbfa90b250_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F4df9f22e15f242549cb9e29d7c7f05c2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/8.jpg saved to cache
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a656b1d2-a6dd-57a1-a2dc-6abbfa90b250
2026-03-27 16:50:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a656b1d2-a6dd-57a1-a2dc-6abbfa90b250, skipping ID generation
2026-03-27 16:50:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a656b1d2-a6dd-57a1-a2dc-6abbfa90b250 with scrape type 1
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a656b1d2-a6dd-57a1-a2dc-6abbfa90b250 sending to next pipeline
2026-03-27 16:50:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a656b1d2-a6dd-57a1-a2dc-6abbfa90b250, identifier: 1988420
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b36d10>
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7715689-55f8-5493-a9f8-dfb6dc9c67c0/f7715689-55f8-5493-a9f8-dfb6dc9c67c0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc16ff704cda34d4389956114145692a2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/2.jpg saved to cache
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f7715689-55f8-5493-a9f8-dfb6dc9c67c0
2026-03-27 16:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6feb9a81fb8e485892d229fe00eafe58%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/4.jpg not downloaded yet
2026-03-27 16:50:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a656b1d2-a6dd-57a1-a2dc-6abbfa90b250 with identifier: 1988420
2026-03-27 16:50:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:50:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a656b1d2-a6dd-57a1-a2dc-6abbfa90b250 with identifier: 1988420
2026-03-27 16:50:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a656b1d2-a6dd-57a1-a2dc-6abbfa90b250 with identifier: 1988420 to the API
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 26,
'color': 'NOIR INTENSE NACR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'a656b1d2-a6dd-57a1-a2dc-6abbfa90b250',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 103020,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a656b1d2-a6dd-57a1-a2dc-6abbfa90b250/a656b1d2-a6dd-57a1-a2dc-6abbfa90b250_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391721,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a656b1d2-a6dd-57a1-a2dc-6abbfa90b250/a656b1d2-a6dd-57a1-a2dc-6abbfa90b250_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391721,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a656b1d2-a6dd-57a1-a2dc-6abbfa90b250/a656b1d2-a6dd-57a1-a2dc-6abbfa90b250_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299157,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a656b1d2-a6dd-57a1-a2dc-6abbfa90b250/a656b1d2-a6dd-57a1-a2dc-6abbfa90b250_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408848,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a656b1d2-a6dd-57a1-a2dc-6abbfa90b250/a656b1d2-a6dd-57a1-a2dc-6abbfa90b250_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333879,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a656b1d2-a6dd-57a1-a2dc-6abbfa90b250/a656b1d2-a6dd-57a1-a2dc-6abbfa90b250_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370762,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a656b1d2-a6dd-57a1-a2dc-6abbfa90b250/a656b1d2-a6dd-57a1-a2dc-6abbfa90b250_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335183,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a656b1d2-a6dd-57a1-a2dc-6abbfa90b250/a656b1d2-a6dd-57a1-a2dc-6abbfa90b250_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391245,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/4df9f22e15f242549cb9e29d7c7f05c2/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-16',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN GOLF Golf 1.4 eHybrid 245ch GTE DSG6',
'transmission': 'automatic',
'trim': 'Golf 1.4 eHybrid 245ch GTE DSG6',
'vin': None,
'year': 2021}
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988420%27 HTTP/1.1" 200 None
2026-03-27 16:50:43 [ayvens.fr] INFO: Saving data for 1988420: {'created_time': 1774630243.098292, 'last_price_update_time': 1774630243.098303, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988420') HTTP/1.1" 204 0
2026-03-27 16:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6feb9a81fb8e485892d229fe00eafe58%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/5.jpg not downloaded yet
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4a790>
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7715689-55f8-5493-a9f8-dfb6dc9c67c0/f7715689-55f8-5493-a9f8-dfb6dc9c67c0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc16ff704cda34d4389956114145692a2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/3.jpg saved to cache
2026-03-27 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f7715689-55f8-5493-a9f8-dfb6dc9c67c0
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b67c50>
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7715689-55f8-5493-a9f8-dfb6dc9c67c0/f7715689-55f8-5493-a9f8-dfb6dc9c67c0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc16ff704cda34d4389956114145692a2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/7.jpg saved to cache
2026-03-27 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f7715689-55f8-5493-a9f8-dfb6dc9c67c0
2026-03-27 16:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6feb9a81fb8e485892d229fe00eafe58%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/6.jpg not downloaded yet
2026-03-27 16:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6feb9a81fb8e485892d229fe00eafe58%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/7.jpg not downloaded yet
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3e590>
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7715689-55f8-5493-a9f8-dfb6dc9c67c0/f7715689-55f8-5493-a9f8-dfb6dc9c67c0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc16ff704cda34d4389956114145692a2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/4.jpg saved to cache
2026-03-27 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f7715689-55f8-5493-a9f8-dfb6dc9c67c0
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b2bc50>
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7715689-55f8-5493-a9f8-dfb6dc9c67c0/f7715689-55f8-5493-a9f8-dfb6dc9c67c0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc16ff704cda34d4389956114145692a2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/6.jpg saved to cache
2026-03-27 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f7715689-55f8-5493-a9f8-dfb6dc9c67c0
2026-03-27 16:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6feb9a81fb8e485892d229fe00eafe58%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/8.jpg not downloaded yet
2026-03-27 16:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:43 [ayvens.fr] INFO: Found listing with ID: 1988423
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988423%27 HTTP/1.1" 200 None
2026-03-27 16:50:43 [ayvens.fr] INFO: Scrape type for 1988423: 1
2026-03-27 16:50:43 [ayvens.fr] INFO: Extracting data for car ID: 1988423
2026-03-27 16:50:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f1f00f1-f79d-5160-823f-83a03d3db38e with identifier: 1988423
2026-03-27 16:50:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f1f00f1-f79d-5160-823f-83a03d3db38e with scrape type 1
2026-03-27 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3f1f00f1-f79d-5160-823f-83a03d3db38e
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F2d326c8ac67f431ebefed4622d18eb55%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/1.jpg not downloaded yet
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3c550>
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7715689-55f8-5493-a9f8-dfb6dc9c67c0/f7715689-55f8-5493-a9f8-dfb6dc9c67c0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc16ff704cda34d4389956114145692a2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/5.jpg saved to cache
2026-03-27 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f7715689-55f8-5493-a9f8-dfb6dc9c67c0
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7da90>
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7715689-55f8-5493-a9f8-dfb6dc9c67c0/f7715689-55f8-5493-a9f8-dfb6dc9c67c0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fc16ff704cda34d4389956114145692a2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/8.jpg saved to cache
2026-03-27 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f7715689-55f8-5493-a9f8-dfb6dc9c67c0
2026-03-27 16:50:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7715689-55f8-5493-a9f8-dfb6dc9c67c0, skipping ID generation
2026-03-27 16:50:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7715689-55f8-5493-a9f8-dfb6dc9c67c0 with scrape type 1
2026-03-27 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7715689-55f8-5493-a9f8-dfb6dc9c67c0 sending to next pipeline
2026-03-27 16:50:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f7715689-55f8-5493-a9f8-dfb6dc9c67c0, identifier: 1988421
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F2d326c8ac67f431ebefed4622d18eb55%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/2.jpg not downloaded yet
2026-03-27 16:50:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f7715689-55f8-5493-a9f8-dfb6dc9c67c0 with identifier: 1988421
2026-03-27 16:50:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f7715689-55f8-5493-a9f8-dfb6dc9c67c0 with identifier: 1988421
2026-03-27 16:50:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f7715689-55f8-5493-a9f8-dfb6dc9c67c0 with identifier: 1988421 to the API
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 106,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'f7715689-55f8-5493-a9f8-dfb6dc9c67c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 131799,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7715689-55f8-5493-a9f8-dfb6dc9c67c0/f7715689-55f8-5493-a9f8-dfb6dc9c67c0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242156,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7715689-55f8-5493-a9f8-dfb6dc9c67c0/f7715689-55f8-5493-a9f8-dfb6dc9c67c0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242156,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7715689-55f8-5493-a9f8-dfb6dc9c67c0/f7715689-55f8-5493-a9f8-dfb6dc9c67c0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429743,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7715689-55f8-5493-a9f8-dfb6dc9c67c0/f7715689-55f8-5493-a9f8-dfb6dc9c67c0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368124,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7715689-55f8-5493-a9f8-dfb6dc9c67c0/f7715689-55f8-5493-a9f8-dfb6dc9c67c0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326123,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7715689-55f8-5493-a9f8-dfb6dc9c67c0/f7715689-55f8-5493-a9f8-dfb6dc9c67c0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292775,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7715689-55f8-5493-a9f8-dfb6dc9c67c0/f7715689-55f8-5493-a9f8-dfb6dc9c67c0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220742,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7715689-55f8-5493-a9f8-dfb6dc9c67c0/f7715689-55f8-5493-a9f8-dfb6dc9c67c0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276134,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/c16ff704cda34d4389956114145692a2/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-07',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.5 BlueHDi 130ch E6.c Active Business S&S',
'transmission': 'manual',
'trim': '3008 1.5 BlueHDi 130ch E6.c Active Business S&S',
'vin': None,
'year': 2019}
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988421%27 HTTP/1.1" 200 None
2026-03-27 16:50:43 [ayvens.fr] INFO: Saving data for 1988421: {'created_time': 1774630243.981863, 'last_price_update_time': 1774630243.981877, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988421') HTTP/1.1" 204 0
2026-03-27 16:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F2d326c8ac67f431ebefed4622d18eb55%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/3.jpg not downloaded yet
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b37ad0>
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8/9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6feb9a81fb8e485892d229fe00eafe58%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/1.jpg saved to cache
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dda090>
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8/9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6feb9a81fb8e485892d229fe00eafe58%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/2.jpg saved to cache
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8
2026-03-27 16:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F2d326c8ac67f431ebefed4622d18eb55%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/4.jpg not downloaded yet
2026-03-27 16:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b2b950>
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8/9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6feb9a81fb8e485892d229fe00eafe58%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/4.jpg saved to cache
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8
2026-03-27 16:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F2d326c8ac67f431ebefed4622d18eb55%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/5.jpg not downloaded yet
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F2d326c8ac67f431ebefed4622d18eb55%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/6.jpg not downloaded yet
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3cc90>
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8/9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6feb9a81fb8e485892d229fe00eafe58%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/3.jpg saved to cache
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f30690>
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8/9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6feb9a81fb8e485892d229fe00eafe58%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/5.jpg saved to cache
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F2d326c8ac67f431ebefed4622d18eb55%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/7.jpg not downloaded yet
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b4a350>
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8/9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6feb9a81fb8e485892d229fe00eafe58%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/7.jpg saved to cache
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F2d326c8ac67f431ebefed4622d18eb55%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/8.jpg not downloaded yet
2026-03-27 16:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b665d0>
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8/9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6feb9a81fb8e485892d229fe00eafe58%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/6.jpg saved to cache
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8
2026-03-27 16:50:44 [ayvens.fr] INFO: Found listing with ID: 1988424
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988424%27 HTTP/1.1" 200 None
2026-03-27 16:50:44 [ayvens.fr] INFO: Scrape type for 1988424: 1
2026-03-27 16:50:44 [ayvens.fr] INFO: Extracting data for car ID: 1988424
2026-03-27 16:50:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28961215-80d4-5187-a5c1-c9f902963e74 with identifier: 1988424
2026-03-27 16:50:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28961215-80d4-5187-a5c1-c9f902963e74 with scrape type 1
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 28961215-80d4-5187-a5c1-c9f902963e74
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fc0ba457ab4bd4318a3ec7e2d59465233%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/1.jpg not downloaded yet
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fc0ba457ab4bd4318a3ec7e2d59465233%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/2.jpg not downloaded yet
2026-03-27 16:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fc0ba457ab4bd4318a3ec7e2d59465233%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/3.jpg not downloaded yet
2026-03-27 16:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b22c90>
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8/9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F6feb9a81fb8e485892d229fe00eafe58%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/8.jpg saved to cache
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8
2026-03-27 16:50:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8, skipping ID generation
2026-03-27 16:50:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8 with scrape type 1
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8 sending to next pipeline
2026-03-27 16:50:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8, identifier: 1988422
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3f790>
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f1f00f1-f79d-5160-823f-83a03d3db38e/3f1f00f1-f79d-5160-823f-83a03d3db38e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F2d326c8ac67f431ebefed4622d18eb55%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/1.jpg saved to cache
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f1f00f1-f79d-5160-823f-83a03d3db38e
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fc0ba457ab4bd4318a3ec7e2d59465233%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/4.jpg not downloaded yet
2026-03-27 16:50:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8 with identifier: 1988422
2026-03-27 16:50:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8 with identifier: 1988422
2026-03-27 16:50:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8 with identifier: 1988422 to the API
2026-03-27 16:50:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': 'SKYCRAPERGRAU',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 1',
'odometer': 58020,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8/9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 507687,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8/9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 507687,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8/9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 483827,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8/9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351720,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8/9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404832,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8/9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380985,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8/9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313502,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8/9405ea61-fd5b-5a52-9ea2-b9b2e8a042a8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 595926,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/6feb9a81fb8e485892d229fe00eafe58/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-26',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 1 Serie 1 118iA 136ch Edition Sport DKG7',
'transmission': 'automatic',
'trim': 'Serie 1 118iA 136ch Edition Sport DKG7',
'vin': None,
'year': 2023}
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988422%27 HTTP/1.1" 200 None
2026-03-27 16:50:45 [ayvens.fr] INFO: Saving data for 1988422: {'created_time': 1774630245.401892, 'last_price_update_time': 1774630245.401901, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988422') HTTP/1.1" 204 0
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fc0ba457ab4bd4318a3ec7e2d59465233%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/5.jpg not downloaded yet
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d44410>
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f1f00f1-f79d-5160-823f-83a03d3db38e/3f1f00f1-f79d-5160-823f-83a03d3db38e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F2d326c8ac67f431ebefed4622d18eb55%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/2.jpg saved to cache
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f1f00f1-f79d-5160-823f-83a03d3db38e
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa3710>
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f1f00f1-f79d-5160-823f-83a03d3db38e/3f1f00f1-f79d-5160-823f-83a03d3db38e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F2d326c8ac67f431ebefed4622d18eb55%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/4.jpg saved to cache
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f1f00f1-f79d-5160-823f-83a03d3db38e
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa22d0>
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f1f00f1-f79d-5160-823f-83a03d3db38e/3f1f00f1-f79d-5160-823f-83a03d3db38e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F2d326c8ac67f431ebefed4622d18eb55%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/3.jpg saved to cache
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f1f00f1-f79d-5160-823f-83a03d3db38e
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591003ed0>
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f1f00f1-f79d-5160-823f-83a03d3db38e/3f1f00f1-f79d-5160-823f-83a03d3db38e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F2d326c8ac67f431ebefed4622d18eb55%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/5.jpg saved to cache
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f1f00f1-f79d-5160-823f-83a03d3db38e
2026-03-27 16:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fc0ba457ab4bd4318a3ec7e2d59465233%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/6.jpg not downloaded yet
2026-03-27 16:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fc0ba457ab4bd4318a3ec7e2d59465233%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/7.jpg not downloaded yet
2026-03-27 16:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fc0ba457ab4bd4318a3ec7e2d59465233%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/8.jpg not downloaded yet
2026-03-27 16:50:45 [ayvens.fr] INFO: Found listing with ID: 1988425
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988425%27 HTTP/1.1" 200 None
2026-03-27 16:50:45 [ayvens.fr] INFO: Scrape type for 1988425: 1
2026-03-27 16:50:45 [ayvens.fr] INFO: Extracting data for car ID: 1988425
2026-03-27 16:50:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e584509c-eba9-5196-9bd9-4706c746e75a with identifier: 1988425
2026-03-27 16:50:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e584509c-eba9-5196-9bd9-4706c746e75a with scrape type 1
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e584509c-eba9-5196-9bd9-4706c746e75a
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Ffdaf216927d8461981441c4686ab5c8b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/1.jpg not downloaded yet
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Ffdaf216927d8461981441c4686ab5c8b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/2.jpg not downloaded yet
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Ffdaf216927d8461981441c4686ab5c8b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/3.jpg not downloaded yet
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591001ed0>
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f1f00f1-f79d-5160-823f-83a03d3db38e/3f1f00f1-f79d-5160-823f-83a03d3db38e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F2d326c8ac67f431ebefed4622d18eb55%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/8.jpg saved to cache
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f1f00f1-f79d-5160-823f-83a03d3db38e
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Ffdaf216927d8461981441c4686ab5c8b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/4.jpg not downloaded yet
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Ffdaf216927d8461981441c4686ab5c8b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/5.jpg not downloaded yet
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Ffdaf216927d8461981441c4686ab5c8b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/6.jpg not downloaded yet
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a0710>
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28961215-80d4-5187-a5c1-c9f902963e74/28961215-80d4-5187-a5c1-c9f902963e74_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fc0ba457ab4bd4318a3ec7e2d59465233%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/1.jpg saved to cache
2026-03-27 16:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28961215-80d4-5187-a5c1-c9f902963e74
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd8a90>
2026-03-27 16:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f1f00f1-f79d-5160-823f-83a03d3db38e/3f1f00f1-f79d-5160-823f-83a03d3db38e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F2d326c8ac67f431ebefed4622d18eb55%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/7.jpg saved to cache
2026-03-27 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f1f00f1-f79d-5160-823f-83a03d3db38e
2026-03-27 16:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59067de50>
2026-03-27 16:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f1f00f1-f79d-5160-823f-83a03d3db38e/3f1f00f1-f79d-5160-823f-83a03d3db38e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffp-%252F2d326c8ac67f431ebefed4622d18eb55%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/6.jpg saved to cache
2026-03-27 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f1f00f1-f79d-5160-823f-83a03d3db38e
2026-03-27 16:50:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f1f00f1-f79d-5160-823f-83a03d3db38e, skipping ID generation
2026-03-27 16:50:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f1f00f1-f79d-5160-823f-83a03d3db38e with scrape type 1
2026-03-27 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f1f00f1-f79d-5160-823f-83a03d3db38e sending to next pipeline
2026-03-27 16:50:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3f1f00f1-f79d-5160-823f-83a03d3db38e, identifier: 1988423
2026-03-27 16:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b88510>
2026-03-27 16:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28961215-80d4-5187-a5c1-c9f902963e74/28961215-80d4-5187-a5c1-c9f902963e74_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fc0ba457ab4bd4318a3ec7e2d59465233%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/3.jpg saved to cache
2026-03-27 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28961215-80d4-5187-a5c1-c9f902963e74
2026-03-27 16:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911042d0>
2026-03-27 16:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28961215-80d4-5187-a5c1-c9f902963e74/28961215-80d4-5187-a5c1-c9f902963e74_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fc0ba457ab4bd4318a3ec7e2d59465233%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/2.jpg saved to cache
2026-03-27 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28961215-80d4-5187-a5c1-c9f902963e74
2026-03-27 16:50:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3f1f00f1-f79d-5160-823f-83a03d3db38e with identifier: 1988423
2026-03-27 16:50:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3f1f00f1-f79d-5160-823f-83a03d3db38e with identifier: 1988423
2026-03-27 16:50:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3f1f00f1-f79d-5160-823f-83a03d3db38e with identifier: 1988423 to the API
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 158,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '3f1f00f1-f79d-5160-823f-83a03d3db38e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC60',
'odometer': 103843,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1f00f1-f79d-5160-823f-83a03d3db38e/3f1f00f1-f79d-5160-823f-83a03d3db38e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 471662,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1f00f1-f79d-5160-823f-83a03d3db38e/3f1f00f1-f79d-5160-823f-83a03d3db38e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 471662,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1f00f1-f79d-5160-823f-83a03d3db38e/3f1f00f1-f79d-5160-823f-83a03d3db38e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 503583,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1f00f1-f79d-5160-823f-83a03d3db38e/3f1f00f1-f79d-5160-823f-83a03d3db38e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397220,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1f00f1-f79d-5160-823f-83a03d3db38e/3f1f00f1-f79d-5160-823f-83a03d3db38e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325022,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1f00f1-f79d-5160-823f-83a03d3db38e/3f1f00f1-f79d-5160-823f-83a03d3db38e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347018,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1f00f1-f79d-5160-823f-83a03d3db38e/3f1f00f1-f79d-5160-823f-83a03d3db38e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350631,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1f00f1-f79d-5160-823f-83a03d3db38e/3f1f00f1-f79d-5160-823f-83a03d3db38e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175086,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fp-/2d326c8ac67f431ebefed4622d18eb55/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-13',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC60 XC60 D4 AdBlue 190ch Business Executive Geartronic',
'transmission': 'automatic',
'trim': 'XC60 D4 AdBlue 190ch Business Executive Geartronic',
'vin': None,
'year': 2020}
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988423%27 HTTP/1.1" 200 None
2026-03-27 16:50:46 [ayvens.fr] INFO: Saving data for 1988423: {'created_time': 1774630246.903315, 'last_price_update_time': 1774630246.903328, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988423') HTTP/1.1" 204 0
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Ffdaf216927d8461981441c4686ab5c8b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/7.jpg not downloaded yet
2026-03-27 16:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Ffdaf216927d8461981441c4686ab5c8b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/8.jpg not downloaded yet
2026-03-27 16:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:46 [ayvens.fr] INFO: Found listing with ID: 1988426
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988426%27 HTTP/1.1" 200 None
2026-03-27 16:50:46 [ayvens.fr] INFO: Scrape type for 1988426: 1
2026-03-27 16:50:46 [ayvens.fr] INFO: Extracting data for car ID: 1988426
2026-03-27 16:50:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 306d86be-8739-5614-9c72-b1f4cd38d347 with identifier: 1988426
2026-03-27 16:50:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 306d86be-8739-5614-9c72-b1f4cd38d347 with scrape type 1
2026-03-27 16:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 306d86be-8739-5614-9c72-b1f4cd38d347
2026-03-27 16:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe5db24760e2c43b6874a313b07330aa8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/1.jpg not downloaded yet
2026-03-27 16:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe5db24760e2c43b6874a313b07330aa8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/2.jpg not downloaded yet
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe5db24760e2c43b6874a313b07330aa8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/3.jpg not downloaded yet
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe5db24760e2c43b6874a313b07330aa8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/4.jpg not downloaded yet
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe5db24760e2c43b6874a313b07330aa8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/5.jpg not downloaded yet
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5914810d0>
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28961215-80d4-5187-a5c1-c9f902963e74/28961215-80d4-5187-a5c1-c9f902963e74_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fc0ba457ab4bd4318a3ec7e2d59465233%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/4.jpg saved to cache
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28961215-80d4-5187-a5c1-c9f902963e74
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590db8f10>
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28961215-80d4-5187-a5c1-c9f902963e74/28961215-80d4-5187-a5c1-c9f902963e74_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fc0ba457ab4bd4318a3ec7e2d59465233%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/6.jpg saved to cache
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28961215-80d4-5187-a5c1-c9f902963e74
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b42b10>
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28961215-80d4-5187-a5c1-c9f902963e74/28961215-80d4-5187-a5c1-c9f902963e74_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fc0ba457ab4bd4318a3ec7e2d59465233%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/5.jpg saved to cache
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28961215-80d4-5187-a5c1-c9f902963e74
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe5db24760e2c43b6874a313b07330aa8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/6.jpg not downloaded yet
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068edd0>
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28961215-80d4-5187-a5c1-c9f902963e74/28961215-80d4-5187-a5c1-c9f902963e74_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fc0ba457ab4bd4318a3ec7e2d59465233%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/8.jpg saved to cache
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28961215-80d4-5187-a5c1-c9f902963e74
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59063e390>
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28961215-80d4-5187-a5c1-c9f902963e74/28961215-80d4-5187-a5c1-c9f902963e74_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fc0ba457ab4bd4318a3ec7e2d59465233%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/7.jpg saved to cache
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28961215-80d4-5187-a5c1-c9f902963e74
2026-03-27 16:50:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28961215-80d4-5187-a5c1-c9f902963e74, skipping ID generation
2026-03-27 16:50:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28961215-80d4-5187-a5c1-c9f902963e74 with scrape type 1
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28961215-80d4-5187-a5c1-c9f902963e74 sending to next pipeline
2026-03-27 16:50:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 28961215-80d4-5187-a5c1-c9f902963e74, identifier: 1988424
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe5db24760e2c43b6874a313b07330aa8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/7.jpg not downloaded yet
2026-03-27 16:50:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 28961215-80d4-5187-a5c1-c9f902963e74 with identifier: 1988424
2026-03-27 16:50:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 28961215-80d4-5187-a5c1-c9f902963e74 with identifier: 1988424
2026-03-27 16:50:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 28961215-80d4-5187-a5c1-c9f902963e74 with identifier: 1988424 to the API
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 145,
'color': 'BLANC NACR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '28961215-80d4-5187-a5c1-c9f902963e74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 65765,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28961215-80d4-5187-a5c1-c9f902963e74/28961215-80d4-5187-a5c1-c9f902963e74_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314644,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28961215-80d4-5187-a5c1-c9f902963e74/28961215-80d4-5187-a5c1-c9f902963e74_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314644,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28961215-80d4-5187-a5c1-c9f902963e74/28961215-80d4-5187-a5c1-c9f902963e74_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306245,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28961215-80d4-5187-a5c1-c9f902963e74/28961215-80d4-5187-a5c1-c9f902963e74_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297592,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28961215-80d4-5187-a5c1-c9f902963e74/28961215-80d4-5187-a5c1-c9f902963e74_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345074,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28961215-80d4-5187-a5c1-c9f902963e74/28961215-80d4-5187-a5c1-c9f902963e74_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307517,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28961215-80d4-5187-a5c1-c9f902963e74/28961215-80d4-5187-a5c1-c9f902963e74_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28961215-80d4-5187-a5c1-c9f902963e74/28961215-80d4-5187-a5c1-c9f902963e74_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292419,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/c0ba457ab4bd4318a3ec7e2d59465233/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-07',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch S&S Active Business',
'transmission': 'manual',
'trim': '3008 1.2 PureTech 130ch S&S Active Business',
'vin': None,
'year': 2020}
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988424%27 HTTP/1.1" 200 None
2026-03-27 16:50:47 [ayvens.fr] INFO: Saving data for 1988424: {'created_time': 1774630247.85383, 'last_price_update_time': 1774630247.85384, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988424') HTTP/1.1" 204 0
2026-03-27 16:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe5db24760e2c43b6874a313b07330aa8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/8.jpg not downloaded yet
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590674090>
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e584509c-eba9-5196-9bd9-4706c746e75a/e584509c-eba9-5196-9bd9-4706c746e75a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Ffdaf216927d8461981441c4686ab5c8b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/2.jpg saved to cache
2026-03-27 16:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e584509c-eba9-5196-9bd9-4706c746e75a
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f126d0>
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e584509c-eba9-5196-9bd9-4706c746e75a/e584509c-eba9-5196-9bd9-4706c746e75a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Ffdaf216927d8461981441c4686ab5c8b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/1.jpg saved to cache
2026-03-27 16:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e584509c-eba9-5196-9bd9-4706c746e75a
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b67390>
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e584509c-eba9-5196-9bd9-4706c746e75a/e584509c-eba9-5196-9bd9-4706c746e75a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Ffdaf216927d8461981441c4686ab5c8b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/3.jpg saved to cache
2026-03-27 16:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e584509c-eba9-5196-9bd9-4706c746e75a
2026-03-27 16:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:48 [ayvens.fr] INFO: Found listing with ID: 1988427
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988427%27 HTTP/1.1" 200 None
2026-03-27 16:50:48 [ayvens.fr] INFO: Scrape type for 1988427: 1
2026-03-27 16:50:48 [ayvens.fr] INFO: Extracting data for car ID: 1988427
2026-03-27 16:50:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c783d81c-bb74-52da-9e56-a1e37a83aaba with identifier: 1988427
2026-03-27 16:50:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c783d81c-bb74-52da-9e56-a1e37a83aaba with scrape type 1
2026-03-27 16:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c783d81c-bb74-52da-9e56-a1e37a83aaba
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F9a0099b98e3b4d4bb79b90da69ceaae6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/1.jpg not downloaded yet
2026-03-27 16:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f116d0>
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e584509c-eba9-5196-9bd9-4706c746e75a/e584509c-eba9-5196-9bd9-4706c746e75a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Ffdaf216927d8461981441c4686ab5c8b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/5.jpg saved to cache
2026-03-27 16:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e584509c-eba9-5196-9bd9-4706c746e75a
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906752d0>
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e584509c-eba9-5196-9bd9-4706c746e75a/e584509c-eba9-5196-9bd9-4706c746e75a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Ffdaf216927d8461981441c4686ab5c8b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/4.jpg saved to cache
2026-03-27 16:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e584509c-eba9-5196-9bd9-4706c746e75a
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f82150>
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e584509c-eba9-5196-9bd9-4706c746e75a/e584509c-eba9-5196-9bd9-4706c746e75a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Ffdaf216927d8461981441c4686ab5c8b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/6.jpg saved to cache
2026-03-27 16:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e584509c-eba9-5196-9bd9-4706c746e75a
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3cb50>
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e584509c-eba9-5196-9bd9-4706c746e75a/e584509c-eba9-5196-9bd9-4706c746e75a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Ffdaf216927d8461981441c4686ab5c8b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/7.jpg saved to cache
2026-03-27 16:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e584509c-eba9-5196-9bd9-4706c746e75a
2026-03-27 16:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F9a0099b98e3b4d4bb79b90da69ceaae6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/2.jpg not downloaded yet
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59063e790>
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e584509c-eba9-5196-9bd9-4706c746e75a/e584509c-eba9-5196-9bd9-4706c746e75a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Ffdaf216927d8461981441c4686ab5c8b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/8.jpg saved to cache
2026-03-27 16:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e584509c-eba9-5196-9bd9-4706c746e75a
2026-03-27 16:50:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e584509c-eba9-5196-9bd9-4706c746e75a, skipping ID generation
2026-03-27 16:50:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e584509c-eba9-5196-9bd9-4706c746e75a with scrape type 1
2026-03-27 16:50:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e584509c-eba9-5196-9bd9-4706c746e75a sending to next pipeline
2026-03-27 16:50:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e584509c-eba9-5196-9bd9-4706c746e75a, identifier: 1988425
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F9a0099b98e3b4d4bb79b90da69ceaae6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/3.jpg not downloaded yet
2026-03-27 16:50:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e584509c-eba9-5196-9bd9-4706c746e75a with identifier: 1988425
2026-03-27 16:50:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e584509c-eba9-5196-9bd9-4706c746e75a with identifier: 1988425
2026-03-27 16:50:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e584509c-eba9-5196-9bd9-4706c746e75a with identifier: 1988425 to the API
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': 'NOIR MYTHIC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'e584509c-eba9-5196-9bd9-4706c746e75a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'A3 SPORTBACK',
'odometer': 112063,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e584509c-eba9-5196-9bd9-4706c746e75a/e584509c-eba9-5196-9bd9-4706c746e75a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336665,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e584509c-eba9-5196-9bd9-4706c746e75a/e584509c-eba9-5196-9bd9-4706c746e75a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336665,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e584509c-eba9-5196-9bd9-4706c746e75a/e584509c-eba9-5196-9bd9-4706c746e75a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328513,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e584509c-eba9-5196-9bd9-4706c746e75a/e584509c-eba9-5196-9bd9-4706c746e75a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305755,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e584509c-eba9-5196-9bd9-4706c746e75a/e584509c-eba9-5196-9bd9-4706c746e75a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322247,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e584509c-eba9-5196-9bd9-4706c746e75a/e584509c-eba9-5196-9bd9-4706c746e75a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349326,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e584509c-eba9-5196-9bd9-4706c746e75a/e584509c-eba9-5196-9bd9-4706c746e75a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316190,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e584509c-eba9-5196-9bd9-4706c746e75a/e584509c-eba9-5196-9bd9-4706c746e75a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342207,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/fdaf216927d8461981441c4686ab5c8b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-28',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI A3 SPORTBACK A3 Sportback 30 TFSI 110ch Mild Hybrid Business '
'line S tronic 7',
'transmission': 'automatic',
'trim': 'A3 Sportback 30 TFSI 110ch Mild Hybrid Business line S tronic 7',
'vin': None,
'year': 2021}
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988425%27 HTTP/1.1" 200 None
2026-03-27 16:50:49 [ayvens.fr] INFO: Saving data for 1988425: {'created_time': 1774630249.047379, 'last_price_update_time': 1774630249.047389, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988425') HTTP/1.1" 204 0
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e8ce50>
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d86be-8739-5614-9c72-b1f4cd38d347/306d86be-8739-5614-9c72-b1f4cd38d347_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe5db24760e2c43b6874a313b07330aa8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/1.jpg saved to cache
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 306d86be-8739-5614-9c72-b1f4cd38d347
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6de10>
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d86be-8739-5614-9c72-b1f4cd38d347/306d86be-8739-5614-9c72-b1f4cd38d347_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe5db24760e2c43b6874a313b07330aa8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/2.jpg saved to cache
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 306d86be-8739-5614-9c72-b1f4cd38d347
2026-03-27 16:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F9a0099b98e3b4d4bb79b90da69ceaae6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/4.jpg not downloaded yet
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591106b10>
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d86be-8739-5614-9c72-b1f4cd38d347/306d86be-8739-5614-9c72-b1f4cd38d347_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe5db24760e2c43b6874a313b07330aa8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/3.jpg saved to cache
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 306d86be-8739-5614-9c72-b1f4cd38d347
2026-03-27 16:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F9a0099b98e3b4d4bb79b90da69ceaae6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/5.jpg not downloaded yet
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F9a0099b98e3b4d4bb79b90da69ceaae6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/6.jpg not downloaded yet
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911a6190>
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d86be-8739-5614-9c72-b1f4cd38d347/306d86be-8739-5614-9c72-b1f4cd38d347_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe5db24760e2c43b6874a313b07330aa8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/5.jpg saved to cache
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 306d86be-8739-5614-9c72-b1f4cd38d347
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F9a0099b98e3b4d4bb79b90da69ceaae6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/7.jpg not downloaded yet
2026-03-27 16:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59063cfd0>
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d86be-8739-5614-9c72-b1f4cd38d347/306d86be-8739-5614-9c72-b1f4cd38d347_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe5db24760e2c43b6874a313b07330aa8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/6.jpg saved to cache
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 306d86be-8739-5614-9c72-b1f4cd38d347
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590510590>
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d86be-8739-5614-9c72-b1f4cd38d347/306d86be-8739-5614-9c72-b1f4cd38d347_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe5db24760e2c43b6874a313b07330aa8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/4.jpg saved to cache
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 306d86be-8739-5614-9c72-b1f4cd38d347
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b5aed0>
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d86be-8739-5614-9c72-b1f4cd38d347/306d86be-8739-5614-9c72-b1f4cd38d347_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe5db24760e2c43b6874a313b07330aa8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/7.jpg saved to cache
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 306d86be-8739-5614-9c72-b1f4cd38d347
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F9a0099b98e3b4d4bb79b90da69ceaae6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/8.jpg not downloaded yet
2026-03-27 16:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:49 [ayvens.fr] INFO: Found listing with ID: 1988428
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988428%27 HTTP/1.1" 200 None
2026-03-27 16:50:49 [ayvens.fr] INFO: Scrape type for 1988428: 1
2026-03-27 16:50:49 [ayvens.fr] INFO: Extracting data for car ID: 1988428
2026-03-27 16:50:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4 with identifier: 1988428
2026-03-27 16:50:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4 with scrape type 1
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fdff3a4f023cc429a9ae91a96e5e675fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/1.jpg not downloaded yet
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df4350>
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d86be-8739-5614-9c72-b1f4cd38d347/306d86be-8739-5614-9c72-b1f4cd38d347_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe5db24760e2c43b6874a313b07330aa8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/8.jpg saved to cache
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 306d86be-8739-5614-9c72-b1f4cd38d347
2026-03-27 16:50:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 306d86be-8739-5614-9c72-b1f4cd38d347, skipping ID generation
2026-03-27 16:50:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 306d86be-8739-5614-9c72-b1f4cd38d347 with scrape type 1
2026-03-27 16:50:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 306d86be-8739-5614-9c72-b1f4cd38d347 sending to next pipeline
2026-03-27 16:50:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 306d86be-8739-5614-9c72-b1f4cd38d347, identifier: 1988426
2026-03-27 16:50:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 306d86be-8739-5614-9c72-b1f4cd38d347 with identifier: 1988426
2026-03-27 16:50:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 306d86be-8739-5614-9c72-b1f4cd38d347 with identifier: 1988426
2026-03-27 16:50:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 306d86be-8739-5614-9c72-b1f4cd38d347 with identifier: 1988426 to the API
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '306d86be-8739-5614-9c72-b1f4cd38d347',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3 AIRCROSS',
'odometer': 112194,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d86be-8739-5614-9c72-b1f4cd38d347/306d86be-8739-5614-9c72-b1f4cd38d347_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441129,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d86be-8739-5614-9c72-b1f4cd38d347/306d86be-8739-5614-9c72-b1f4cd38d347_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441129,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d86be-8739-5614-9c72-b1f4cd38d347/306d86be-8739-5614-9c72-b1f4cd38d347_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 459221,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d86be-8739-5614-9c72-b1f4cd38d347/306d86be-8739-5614-9c72-b1f4cd38d347_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402811,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d86be-8739-5614-9c72-b1f4cd38d347/306d86be-8739-5614-9c72-b1f4cd38d347_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314567,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d86be-8739-5614-9c72-b1f4cd38d347/306d86be-8739-5614-9c72-b1f4cd38d347_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407204,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d86be-8739-5614-9c72-b1f4cd38d347/306d86be-8739-5614-9c72-b1f4cd38d347_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328629,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d86be-8739-5614-9c72-b1f4cd38d347/306d86be-8739-5614-9c72-b1f4cd38d347_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 531597,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e5db24760e2c43b6874a313b07330aa8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-02',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 AIRCROSS C3 Aircross PureTech 130ch S&S Feel Pack EAT6',
'transmission': 'automatic',
'trim': 'C3 Aircross PureTech 130ch S&S Feel Pack EAT6',
'vin': None,
'year': 2023}
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988426%27 HTTP/1.1" 200 None
2026-03-27 16:50:50 [ayvens.fr] INFO: Saving data for 1988426: {'created_time': 1774630250.312321, 'last_price_update_time': 1774630250.312331, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988426') HTTP/1.1" 204 0
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fdff3a4f023cc429a9ae91a96e5e675fd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/2.jpg not downloaded yet
2026-03-27 16:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df6610>
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c783d81c-bb74-52da-9e56-a1e37a83aaba/c783d81c-bb74-52da-9e56-a1e37a83aaba_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F9a0099b98e3b4d4bb79b90da69ceaae6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/1.jpg saved to cache
2026-03-27 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c783d81c-bb74-52da-9e56-a1e37a83aaba
2026-03-27 16:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fdff3a4f023cc429a9ae91a96e5e675fd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/3.jpg not downloaded yet
2026-03-27 16:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fdff3a4f023cc429a9ae91a96e5e675fd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/4.jpg not downloaded yet
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fdff3a4f023cc429a9ae91a96e5e675fd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/5.jpg not downloaded yet
2026-03-27 16:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d430d0>
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c783d81c-bb74-52da-9e56-a1e37a83aaba/c783d81c-bb74-52da-9e56-a1e37a83aaba_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F9a0099b98e3b4d4bb79b90da69ceaae6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/3.jpg saved to cache
2026-03-27 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c783d81c-bb74-52da-9e56-a1e37a83aaba
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590511dd0>
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c783d81c-bb74-52da-9e56-a1e37a83aaba/c783d81c-bb74-52da-9e56-a1e37a83aaba_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F9a0099b98e3b4d4bb79b90da69ceaae6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/4.jpg saved to cache
2026-03-27 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c783d81c-bb74-52da-9e56-a1e37a83aaba
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fdff3a4f023cc429a9ae91a96e5e675fd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/6.jpg not downloaded yet
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fdff3a4f023cc429a9ae91a96e5e675fd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/7.jpg not downloaded yet
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b231d0>
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c783d81c-bb74-52da-9e56-a1e37a83aaba/c783d81c-bb74-52da-9e56-a1e37a83aaba_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F9a0099b98e3b4d4bb79b90da69ceaae6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/5.jpg saved to cache
2026-03-27 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c783d81c-bb74-52da-9e56-a1e37a83aaba
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dac210>
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c783d81c-bb74-52da-9e56-a1e37a83aaba/c783d81c-bb74-52da-9e56-a1e37a83aaba_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F9a0099b98e3b4d4bb79b90da69ceaae6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/2.jpg saved to cache
2026-03-27 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c783d81c-bb74-52da-9e56-a1e37a83aaba
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa3e90>
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c783d81c-bb74-52da-9e56-a1e37a83aaba/c783d81c-bb74-52da-9e56-a1e37a83aaba_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F9a0099b98e3b4d4bb79b90da69ceaae6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/7.jpg saved to cache
2026-03-27 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c783d81c-bb74-52da-9e56-a1e37a83aaba
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904fee50>
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c783d81c-bb74-52da-9e56-a1e37a83aaba/c783d81c-bb74-52da-9e56-a1e37a83aaba_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F9a0099b98e3b4d4bb79b90da69ceaae6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/6.jpg saved to cache
2026-03-27 16:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c783d81c-bb74-52da-9e56-a1e37a83aaba
2026-03-27 16:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fdff3a4f023cc429a9ae91a96e5e675fd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/8.jpg not downloaded yet
2026-03-27 16:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:51 [ayvens.fr] INFO: Found listing with ID: 1988429
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988429%27 HTTP/1.1" 200 None
2026-03-27 16:50:51 [ayvens.fr] INFO: Scrape type for 1988429: 1
2026-03-27 16:50:51 [ayvens.fr] INFO: Extracting data for car ID: 1988429
2026-03-27 16:50:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e403431e-565e-513a-a528-72a9026e5c88 with identifier: 1988429
2026-03-27 16:50:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e403431e-565e-513a-a528-72a9026e5c88 with scrape type 1
2026-03-27 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e403431e-565e-513a-a528-72a9026e5c88
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F0034640b169f4d5994f6fa121798837c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/1.jpg not downloaded yet
2026-03-27 16:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F0034640b169f4d5994f6fa121798837c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/2.jpg not downloaded yet
2026-03-27 16:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F0034640b169f4d5994f6fa121798837c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/3.jpg not downloaded yet
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F0034640b169f4d5994f6fa121798837c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/4.jpg not downloaded yet
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F0034640b169f4d5994f6fa121798837c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/5.jpg not downloaded yet
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F0034640b169f4d5994f6fa121798837c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/6.jpg not downloaded yet
2026-03-27 16:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b6b650>
2026-03-27 16:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c783d81c-bb74-52da-9e56-a1e37a83aaba/c783d81c-bb74-52da-9e56-a1e37a83aaba_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F9a0099b98e3b4d4bb79b90da69ceaae6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/8.jpg saved to cache
2026-03-27 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c783d81c-bb74-52da-9e56-a1e37a83aaba
2026-03-27 16:50:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c783d81c-bb74-52da-9e56-a1e37a83aaba, skipping ID generation
2026-03-27 16:50:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c783d81c-bb74-52da-9e56-a1e37a83aaba with scrape type 1
2026-03-27 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c783d81c-bb74-52da-9e56-a1e37a83aaba sending to next pipeline
2026-03-27 16:50:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c783d81c-bb74-52da-9e56-a1e37a83aaba, identifier: 1988427
2026-03-27 16:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc593864910>
2026-03-27 16:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4/fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fdff3a4f023cc429a9ae91a96e5e675fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/1.jpg saved to cache
2026-03-27 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4
2026-03-27 16:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d6cc50>
2026-03-27 16:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4/fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fdff3a4f023cc429a9ae91a96e5e675fd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/2.jpg saved to cache
2026-03-27 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F0034640b169f4d5994f6fa121798837c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/7.jpg not downloaded yet
2026-03-27 16:50:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c783d81c-bb74-52da-9e56-a1e37a83aaba with identifier: 1988427
2026-03-27 16:50:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:50:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c783d81c-bb74-52da-9e56-a1e37a83aaba with identifier: 1988427
2026-03-27 16:50:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c783d81c-bb74-52da-9e56-a1e37a83aaba with identifier: 1988427 to the API
2026-03-27 16:50:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 174,
'color': 'GRIS PLATINE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'c783d81c-bb74-52da-9e56-a1e37a83aaba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'ESPACE',
'odometer': 74705,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c783d81c-bb74-52da-9e56-a1e37a83aaba/c783d81c-bb74-52da-9e56-a1e37a83aaba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 615320,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c783d81c-bb74-52da-9e56-a1e37a83aaba/c783d81c-bb74-52da-9e56-a1e37a83aaba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 615320,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c783d81c-bb74-52da-9e56-a1e37a83aaba/c783d81c-bb74-52da-9e56-a1e37a83aaba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481524,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c783d81c-bb74-52da-9e56-a1e37a83aaba/c783d81c-bb74-52da-9e56-a1e37a83aaba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387088,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c783d81c-bb74-52da-9e56-a1e37a83aaba/c783d81c-bb74-52da-9e56-a1e37a83aaba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342550,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c783d81c-bb74-52da-9e56-a1e37a83aaba/c783d81c-bb74-52da-9e56-a1e37a83aaba_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410900,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c783d81c-bb74-52da-9e56-a1e37a83aaba/c783d81c-bb74-52da-9e56-a1e37a83aaba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304688,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c783d81c-bb74-52da-9e56-a1e37a83aaba/c783d81c-bb74-52da-9e56-a1e37a83aaba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320415,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/9a0099b98e3b4d4bb79b90da69ceaae6/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-16',
'seats_number': 7,
'seller_name': None,
'title': 'RENAULT ESPACE Espace 2.0 Blue dCi 160ch Zen EDCD-Full',
'transmission': 'automatic',
'trim': 'Espace 2.0 Blue dCi 160ch Zen EDCD-Full',
'vin': None,
'year': 2021}
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988427%27 HTTP/1.1" 200 None
2026-03-27 16:50:52 [ayvens.fr] INFO: Saving data for 1988427: {'created_time': 1774630252.529514, 'last_price_update_time': 1774630252.529527, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988427') HTTP/1.1" 204 0
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F0034640b169f4d5994f6fa121798837c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/8.jpg not downloaded yet
2026-03-27 16:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d2d50>
2026-03-27 16:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4/fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fdff3a4f023cc429a9ae91a96e5e675fd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/4.jpg saved to cache
2026-03-27 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4
2026-03-27 16:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911a7b50>
2026-03-27 16:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4/fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fdff3a4f023cc429a9ae91a96e5e675fd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/3.jpg saved to cache
2026-03-27 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4
2026-03-27 16:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b67350>
2026-03-27 16:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4/fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fdff3a4f023cc429a9ae91a96e5e675fd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/5.jpg saved to cache
2026-03-27 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4
2026-03-27 16:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:52 [ayvens.fr] INFO: Found listing with ID: 1988430
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988430%27 HTTP/1.1" 200 None
2026-03-27 16:50:52 [ayvens.fr] INFO: Scrape type for 1988430: 1
2026-03-27 16:50:52 [ayvens.fr] INFO: Extracting data for car ID: 1988430
2026-03-27 16:50:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb with identifier: 1988430
2026-03-27 16:50:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb with scrape type 1
2026-03-27 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d06043db1341e89e93acda76d91487%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/1.jpg not downloaded yet
2026-03-27 16:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d06043db1341e89e93acda76d91487%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/2.jpg not downloaded yet
2026-03-27 16:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d06043db1341e89e93acda76d91487%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/3.jpg not downloaded yet
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d06043db1341e89e93acda76d91487%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/4.jpg not downloaded yet
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d06043db1341e89e93acda76d91487%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/5.jpg not downloaded yet
2026-03-27 16:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df4690>
2026-03-27 16:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4/fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fdff3a4f023cc429a9ae91a96e5e675fd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/6.jpg saved to cache
2026-03-27 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d06043db1341e89e93acda76d91487%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/6.jpg not downloaded yet
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d06043db1341e89e93acda76d91487%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/7.jpg not downloaded yet
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d06043db1341e89e93acda76d91487%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/8.jpg not downloaded yet
2026-03-27 16:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590656090>
2026-03-27 16:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4/fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fdff3a4f023cc429a9ae91a96e5e675fd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/7.jpg saved to cache
2026-03-27 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911ce1d0>
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e403431e-565e-513a-a528-72a9026e5c88/e403431e-565e-513a-a528-72a9026e5c88_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F0034640b169f4d5994f6fa121798837c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/2.jpg saved to cache
2026-03-27 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e403431e-565e-513a-a528-72a9026e5c88
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59062d5d0>
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e403431e-565e-513a-a528-72a9026e5c88/e403431e-565e-513a-a528-72a9026e5c88_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F0034640b169f4d5994f6fa121798837c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/4.jpg saved to cache
2026-03-27 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e403431e-565e-513a-a528-72a9026e5c88
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905ab810>
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4/fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fdff3a4f023cc429a9ae91a96e5e675fd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/8.jpg saved to cache
2026-03-27 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4
2026-03-27 16:50:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4, skipping ID generation
2026-03-27 16:50:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4 with scrape type 1
2026-03-27 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4 sending to next pipeline
2026-03-27 16:50:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4, identifier: 1988428
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b68fd0>
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e403431e-565e-513a-a528-72a9026e5c88/e403431e-565e-513a-a528-72a9026e5c88_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F0034640b169f4d5994f6fa121798837c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/1.jpg saved to cache
2026-03-27 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e403431e-565e-513a-a528-72a9026e5c88
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d1950>
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e403431e-565e-513a-a528-72a9026e5c88/e403431e-565e-513a-a528-72a9026e5c88_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F0034640b169f4d5994f6fa121798837c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/3.jpg saved to cache
2026-03-27 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e403431e-565e-513a-a528-72a9026e5c88
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d6fc90>
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e403431e-565e-513a-a528-72a9026e5c88/e403431e-565e-513a-a528-72a9026e5c88_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F0034640b169f4d5994f6fa121798837c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/5.jpg saved to cache
2026-03-27 16:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e403431e-565e-513a-a528-72a9026e5c88
2026-03-27 16:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4 with identifier: 1988428
2026-03-27 16:50:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:50:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4 with identifier: 1988428
2026-03-27 16:50:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4 with identifier: 1988428 to the API
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'BLANCHE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 57880,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4/fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289192,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4/fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289192,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4/fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308062,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4/fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246910,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4/fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342512,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4/fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295342,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4/fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328215,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4/fb3b3f1f-fbd8-552c-b057-bfbbc31dbbe4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384776,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/dff3a4f023cc429a9ae91a96e5e675fd/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-27',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.0 TCe 90ch Business',
'transmission': 'manual',
'trim': 'Clio 1.0 TCe 90ch Business',
'vin': None,
'year': 2021}
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988428%27 HTTP/1.1" 200 None
2026-03-27 16:50:53 [ayvens.fr] INFO: Saving data for 1988428: {'created_time': 1774630253.890865, 'last_price_update_time': 1774630253.890875, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988428') HTTP/1.1" 204 0
2026-03-27 16:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:54 [ayvens.fr] INFO: Found listing with ID: 1988431
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988431%27 HTTP/1.1" 200 None
2026-03-27 16:50:54 [ayvens.fr] INFO: Scrape type for 1988431: 1
2026-03-27 16:50:54 [ayvens.fr] INFO: Extracting data for car ID: 1988431
2026-03-27 16:50:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16b7225d-3481-5857-a753-401f204d32fe with identifier: 1988431
2026-03-27 16:50:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16b7225d-3481-5857-a753-401f204d32fe with scrape type 1
2026-03-27 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 16b7225d-3481-5857-a753-401f204d32fe
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F8c87029bc54a4034b6f68d980dc2bfdb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/1.jpg not downloaded yet
2026-03-27 16:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F8c87029bc54a4034b6f68d980dc2bfdb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/2.jpg not downloaded yet
2026-03-27 16:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a9150>
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e403431e-565e-513a-a528-72a9026e5c88/e403431e-565e-513a-a528-72a9026e5c88_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F0034640b169f4d5994f6fa121798837c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/7.jpg saved to cache
2026-03-27 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e403431e-565e-513a-a528-72a9026e5c88
2026-03-27 16:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F8c87029bc54a4034b6f68d980dc2bfdb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/3.jpg not downloaded yet
2026-03-27 16:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F8c87029bc54a4034b6f68d980dc2bfdb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/4.jpg not downloaded yet
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9e5d0>
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e403431e-565e-513a-a528-72a9026e5c88/e403431e-565e-513a-a528-72a9026e5c88_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F0034640b169f4d5994f6fa121798837c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/8.jpg saved to cache
2026-03-27 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e403431e-565e-513a-a528-72a9026e5c88
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0c610>
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb/0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d06043db1341e89e93acda76d91487%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/1.jpg saved to cache
2026-03-27 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911baed0>
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb/0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d06043db1341e89e93acda76d91487%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/3.jpg saved to cache
2026-03-27 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0db10>
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e403431e-565e-513a-a528-72a9026e5c88/e403431e-565e-513a-a528-72a9026e5c88_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F0034640b169f4d5994f6fa121798837c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/6.jpg saved to cache
2026-03-27 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e403431e-565e-513a-a528-72a9026e5c88
2026-03-27 16:50:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e403431e-565e-513a-a528-72a9026e5c88, skipping ID generation
2026-03-27 16:50:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e403431e-565e-513a-a528-72a9026e5c88 with scrape type 1
2026-03-27 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e403431e-565e-513a-a528-72a9026e5c88 sending to next pipeline
2026-03-27 16:50:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e403431e-565e-513a-a528-72a9026e5c88, identifier: 1988429
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590515050>
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb/0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d06043db1341e89e93acda76d91487%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/2.jpg saved to cache
2026-03-27 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F8c87029bc54a4034b6f68d980dc2bfdb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/5.jpg not downloaded yet
2026-03-27 16:50:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e403431e-565e-513a-a528-72a9026e5c88 with identifier: 1988429
2026-03-27 16:50:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e403431e-565e-513a-a528-72a9026e5c88 with identifier: 1988429
2026-03-27 16:50:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e403431e-565e-513a-a528-72a9026e5c88 with identifier: 1988429 to the API
2026-03-27 16:50:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': 'e403431e-565e-513a-a528-72a9026e5c88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'LEAF',
'odometer': 22315,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e403431e-565e-513a-a528-72a9026e5c88/e403431e-565e-513a-a528-72a9026e5c88_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398460,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e403431e-565e-513a-a528-72a9026e5c88/e403431e-565e-513a-a528-72a9026e5c88_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398460,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e403431e-565e-513a-a528-72a9026e5c88/e403431e-565e-513a-a528-72a9026e5c88_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438716,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e403431e-565e-513a-a528-72a9026e5c88/e403431e-565e-513a-a528-72a9026e5c88_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382869,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e403431e-565e-513a-a528-72a9026e5c88/e403431e-565e-513a-a528-72a9026e5c88_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301327,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e403431e-565e-513a-a528-72a9026e5c88/e403431e-565e-513a-a528-72a9026e5c88_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292539,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e403431e-565e-513a-a528-72a9026e5c88/e403431e-565e-513a-a528-72a9026e5c88_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330995,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e403431e-565e-513a-a528-72a9026e5c88/e403431e-565e-513a-a528-72a9026e5c88_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394473,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/0034640b169f4d5994f6fa121798837c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-31',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN LEAF Leaf 217ch e+ 62kWh Business',
'transmission': 'automatic',
'trim': 'Leaf 217ch e+ 62kWh Business',
'vin': None,
'year': 2022}
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988429%27 HTTP/1.1" 200 None
2026-03-27 16:50:55 [ayvens.fr] INFO: Saving data for 1988429: {'created_time': 1774630255.151851, 'last_price_update_time': 1774630255.151862, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988429') HTTP/1.1" 204 0
2026-03-27 16:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F8c87029bc54a4034b6f68d980dc2bfdb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/6.jpg not downloaded yet
2026-03-27 16:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911c9a10>
2026-03-27 16:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb/0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d06043db1341e89e93acda76d91487%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/4.jpg saved to cache
2026-03-27 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb
2026-03-27 16:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b77b50>
2026-03-27 16:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb/0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d06043db1341e89e93acda76d91487%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/5.jpg saved to cache
2026-03-27 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F8c87029bc54a4034b6f68d980dc2bfdb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/7.jpg not downloaded yet
2026-03-27 16:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d6f190>
2026-03-27 16:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb/0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d06043db1341e89e93acda76d91487%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/6.jpg saved to cache
2026-03-27 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb
2026-03-27 16:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b587d0>
2026-03-27 16:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb/0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d06043db1341e89e93acda76d91487%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/7.jpg saved to cache
2026-03-27 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F8c87029bc54a4034b6f68d980dc2bfdb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/8.jpg not downloaded yet
2026-03-27 16:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4fe90>
2026-03-27 16:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb/0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F34d06043db1341e89e93acda76d91487%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/8.jpg saved to cache
2026-03-27 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb
2026-03-27 16:50:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb, skipping ID generation
2026-03-27 16:50:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb with scrape type 1
2026-03-27 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb sending to next pipeline
2026-03-27 16:50:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb, identifier: 1988430
2026-03-27 16:50:55 [ayvens.fr] INFO: Found listing with ID: 1988432
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988432%27 HTTP/1.1" 200 None
2026-03-27 16:50:55 [ayvens.fr] INFO: Scrape type for 1988432: 1
2026-03-27 16:50:55 [ayvens.fr] INFO: Extracting data for car ID: 1988432
2026-03-27 16:50:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80d4009f-7e6d-58e5-87a6-6320c125d3e8 with identifier: 1988432
2026-03-27 16:50:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80d4009f-7e6d-58e5-87a6-6320c125d3e8 with scrape type 1
2026-03-27 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 80d4009f-7e6d-58e5-87a6-6320c125d3e8
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6fe8c7a9c4334fcdb0274cd8b984523e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/1.jpg not downloaded yet
2026-03-27 16:50:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb with identifier: 1988430
2026-03-27 16:50:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:50:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb with identifier: 1988430
2026-03-27 16:50:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb with identifier: 1988430 to the API
2026-03-27 16:50:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 146,
'color': 'GRIS SQUALE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'X-TRAIL',
'odometer': 27811,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb/0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295913,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb/0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295913,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb/0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318204,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb/0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320846,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb/0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329493,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb/0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275133,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb/0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295582,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb/0de76df8-dd0c-5274-9f8b-e5c6abdfcbdb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 266417,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/34d06043db1341e89e93acda76d91487/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-02',
'seats_number': 7,
'seller_name': None,
'title': 'NISSAN X-TRAIL X-Trail e-4orce 213ch N-Connecta 7 places',
'transmission': 'automatic',
'trim': 'X-Trail e-4orce 213ch N-Connecta 7 places',
'vin': None,
'year': 2023}
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988430%27 HTTP/1.1" 200 None
2026-03-27 16:50:56 [ayvens.fr] INFO: Saving data for 1988430: {'created_time': 1774630256.123149, 'last_price_update_time': 1774630256.12316, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988430') HTTP/1.1" 204 0
2026-03-27 16:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dae210>
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16b7225d-3481-5857-a753-401f204d32fe/16b7225d-3481-5857-a753-401f204d32fe_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F8c87029bc54a4034b6f68d980dc2bfdb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/1.jpg saved to cache
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16b7225d-3481-5857-a753-401f204d32fe
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f62550>
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16b7225d-3481-5857-a753-401f204d32fe/16b7225d-3481-5857-a753-401f204d32fe_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F8c87029bc54a4034b6f68d980dc2bfdb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/2.jpg saved to cache
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 16b7225d-3481-5857-a753-401f204d32fe
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6fe8c7a9c4334fcdb0274cd8b984523e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/2.jpg not downloaded yet
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6fe8c7a9c4334fcdb0274cd8b984523e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/3.jpg not downloaded yet
2026-03-27 16:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590db88d0>
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16b7225d-3481-5857-a753-401f204d32fe/16b7225d-3481-5857-a753-401f204d32fe_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F8c87029bc54a4034b6f68d980dc2bfdb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/4.jpg saved to cache
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 16b7225d-3481-5857-a753-401f204d32fe
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591430c50>
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16b7225d-3481-5857-a753-401f204d32fe/16b7225d-3481-5857-a753-401f204d32fe_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F8c87029bc54a4034b6f68d980dc2bfdb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/3.jpg saved to cache
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 16b7225d-3481-5857-a753-401f204d32fe
2026-03-27 16:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6fe8c7a9c4334fcdb0274cd8b984523e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/4.jpg not downloaded yet
2026-03-27 16:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6fe8c7a9c4334fcdb0274cd8b984523e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/5.jpg not downloaded yet
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59120b9d0>
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16b7225d-3481-5857-a753-401f204d32fe/16b7225d-3481-5857-a753-401f204d32fe_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F8c87029bc54a4034b6f68d980dc2bfdb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/6.jpg saved to cache
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 16b7225d-3481-5857-a753-401f204d32fe
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6fe8c7a9c4334fcdb0274cd8b984523e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/6.jpg not downloaded yet
2026-03-27 16:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6fe8c7a9c4334fcdb0274cd8b984523e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/7.jpg not downloaded yet
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590675410>
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16b7225d-3481-5857-a753-401f204d32fe/16b7225d-3481-5857-a753-401f204d32fe_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F8c87029bc54a4034b6f68d980dc2bfdb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/5.jpg saved to cache
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 16b7225d-3481-5857-a753-401f204d32fe
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d78b50>
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16b7225d-3481-5857-a753-401f204d32fe/16b7225d-3481-5857-a753-401f204d32fe_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F8c87029bc54a4034b6f68d980dc2bfdb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/7.jpg saved to cache
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 16b7225d-3481-5857-a753-401f204d32fe
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6fe8c7a9c4334fcdb0274cd8b984523e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/8.jpg not downloaded yet
2026-03-27 16:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:56 [ayvens.fr] INFO: Found listing with ID: 1988433
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988433%27 HTTP/1.1" 200 None
2026-03-27 16:50:56 [ayvens.fr] INFO: Scrape type for 1988433: 1
2026-03-27 16:50:56 [ayvens.fr] INFO: Extracting data for car ID: 1988433
2026-03-27 16:50:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56ba123f-f338-5495-88c8-4c694605adbf with identifier: 1988433
2026-03-27 16:50:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56ba123f-f338-5495-88c8-4c694605adbf with scrape type 1
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 56ba123f-f338-5495-88c8-4c694605adbf
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fd2965a4ff0d744aead400347fd89d804%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/1.jpg not downloaded yet
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d74a10>
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16b7225d-3481-5857-a753-401f204d32fe/16b7225d-3481-5857-a753-401f204d32fe_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F8c87029bc54a4034b6f68d980dc2bfdb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/8.jpg saved to cache
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 16b7225d-3481-5857-a753-401f204d32fe
2026-03-27 16:50:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16b7225d-3481-5857-a753-401f204d32fe, skipping ID generation
2026-03-27 16:50:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16b7225d-3481-5857-a753-401f204d32fe with scrape type 1
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16b7225d-3481-5857-a753-401f204d32fe sending to next pipeline
2026-03-27 16:50:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 16b7225d-3481-5857-a753-401f204d32fe, identifier: 1988431
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fd2965a4ff0d744aead400347fd89d804%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/2.jpg not downloaded yet
2026-03-27 16:50:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 16b7225d-3481-5857-a753-401f204d32fe with identifier: 1988431
2026-03-27 16:50:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:50:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 16b7225d-3481-5857-a753-401f204d32fe with identifier: 1988431
2026-03-27 16:50:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 16b7225d-3481-5857-a753-401f204d32fe with identifier: 1988431 to the API
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 145,
'color': 'BLANC SENSATION',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/diesel',
'id': '16b7225d-3481-5857-a753-401f204d32fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 121938,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16b7225d-3481-5857-a753-401f204d32fe/16b7225d-3481-5857-a753-401f204d32fe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304834,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16b7225d-3481-5857-a753-401f204d32fe/16b7225d-3481-5857-a753-401f204d32fe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304834,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16b7225d-3481-5857-a753-401f204d32fe/16b7225d-3481-5857-a753-401f204d32fe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317311,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16b7225d-3481-5857-a753-401f204d32fe/16b7225d-3481-5857-a753-401f204d32fe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303557,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16b7225d-3481-5857-a753-401f204d32fe/16b7225d-3481-5857-a753-401f204d32fe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340484,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16b7225d-3481-5857-a753-401f204d32fe/16b7225d-3481-5857-a753-401f204d32fe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302536,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16b7225d-3481-5857-a753-401f204d32fe/16b7225d-3481-5857-a753-401f204d32fe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323843,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16b7225d-3481-5857-a753-401f204d32fe/16b7225d-3481-5857-a753-401f204d32fe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384806,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/8c87029bc54a4034b6f68d980dc2bfdb/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-12',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 CRDi 136ch MHEV Black Edition 4x2 DCT7',
'transmission': 'automatic',
'trim': 'Sportage 1.6 CRDi 136ch MHEV Black Edition 4x2 DCT7',
'vin': None,
'year': 2021}
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988431%27 HTTP/1.1" 200 None
2026-03-27 16:50:57 [ayvens.fr] INFO: Saving data for 1988431: {'created_time': 1774630257.374765, 'last_price_update_time': 1774630257.374776, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988431') HTTP/1.1" 204 0
2026-03-27 16:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fd2965a4ff0d744aead400347fd89d804%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/3.jpg not downloaded yet
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b50a50>
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d4009f-7e6d-58e5-87a6-6320c125d3e8/80d4009f-7e6d-58e5-87a6-6320c125d3e8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6fe8c7a9c4334fcdb0274cd8b984523e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/1.jpg saved to cache
2026-03-27 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80d4009f-7e6d-58e5-87a6-6320c125d3e8
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fd2965a4ff0d744aead400347fd89d804%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/4.jpg not downloaded yet
2026-03-27 16:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fd2965a4ff0d744aead400347fd89d804%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/5.jpg not downloaded yet
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b6abd0>
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d4009f-7e6d-58e5-87a6-6320c125d3e8/80d4009f-7e6d-58e5-87a6-6320c125d3e8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6fe8c7a9c4334fcdb0274cd8b984523e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/2.jpg saved to cache
2026-03-27 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80d4009f-7e6d-58e5-87a6-6320c125d3e8
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904d4d50>
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d4009f-7e6d-58e5-87a6-6320c125d3e8/80d4009f-7e6d-58e5-87a6-6320c125d3e8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6fe8c7a9c4334fcdb0274cd8b984523e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/4.jpg saved to cache
2026-03-27 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80d4009f-7e6d-58e5-87a6-6320c125d3e8
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa2190>
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d4009f-7e6d-58e5-87a6-6320c125d3e8/80d4009f-7e6d-58e5-87a6-6320c125d3e8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6fe8c7a9c4334fcdb0274cd8b984523e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/3.jpg saved to cache
2026-03-27 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80d4009f-7e6d-58e5-87a6-6320c125d3e8
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fd2965a4ff0d744aead400347fd89d804%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/6.jpg not downloaded yet
2026-03-27 16:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fd2965a4ff0d744aead400347fd89d804%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/7.jpg not downloaded yet
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590513850>
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d4009f-7e6d-58e5-87a6-6320c125d3e8/80d4009f-7e6d-58e5-87a6-6320c125d3e8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6fe8c7a9c4334fcdb0274cd8b984523e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/5.jpg saved to cache
2026-03-27 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80d4009f-7e6d-58e5-87a6-6320c125d3e8
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59057e750>
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d4009f-7e6d-58e5-87a6-6320c125d3e8/80d4009f-7e6d-58e5-87a6-6320c125d3e8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6fe8c7a9c4334fcdb0274cd8b984523e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/7.jpg saved to cache
2026-03-27 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80d4009f-7e6d-58e5-87a6-6320c125d3e8
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ec54d0>
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d4009f-7e6d-58e5-87a6-6320c125d3e8/80d4009f-7e6d-58e5-87a6-6320c125d3e8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6fe8c7a9c4334fcdb0274cd8b984523e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/6.jpg saved to cache
2026-03-27 16:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80d4009f-7e6d-58e5-87a6-6320c125d3e8
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b22c50>
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d4009f-7e6d-58e5-87a6-6320c125d3e8/80d4009f-7e6d-58e5-87a6-6320c125d3e8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6fe8c7a9c4334fcdb0274cd8b984523e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/8.jpg saved to cache
2026-03-27 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80d4009f-7e6d-58e5-87a6-6320c125d3e8
2026-03-27 16:50:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80d4009f-7e6d-58e5-87a6-6320c125d3e8, skipping ID generation
2026-03-27 16:50:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80d4009f-7e6d-58e5-87a6-6320c125d3e8 with scrape type 1
2026-03-27 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80d4009f-7e6d-58e5-87a6-6320c125d3e8 sending to next pipeline
2026-03-27 16:50:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 80d4009f-7e6d-58e5-87a6-6320c125d3e8, identifier: 1988432
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fd2965a4ff0d744aead400347fd89d804%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/8.jpg not downloaded yet
2026-03-27 16:50:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 80d4009f-7e6d-58e5-87a6-6320c125d3e8 with identifier: 1988432
2026-03-27 16:50:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 80d4009f-7e6d-58e5-87a6-6320c125d3e8 with identifier: 1988432
2026-03-27 16:50:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 80d4009f-7e6d-58e5-87a6-6320c125d3e8 with identifier: 1988432 to the API
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:50:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '80d4009f-7e6d-58e5-87a6-6320c125d3e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 87176,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d4009f-7e6d-58e5-87a6-6320c125d3e8/80d4009f-7e6d-58e5-87a6-6320c125d3e8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336102,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d4009f-7e6d-58e5-87a6-6320c125d3e8/80d4009f-7e6d-58e5-87a6-6320c125d3e8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336102,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d4009f-7e6d-58e5-87a6-6320c125d3e8/80d4009f-7e6d-58e5-87a6-6320c125d3e8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358416,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d4009f-7e6d-58e5-87a6-6320c125d3e8/80d4009f-7e6d-58e5-87a6-6320c125d3e8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292954,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d4009f-7e6d-58e5-87a6-6320c125d3e8/80d4009f-7e6d-58e5-87a6-6320c125d3e8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386080,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d4009f-7e6d-58e5-87a6-6320c125d3e8/80d4009f-7e6d-58e5-87a6-6320c125d3e8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312180,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d4009f-7e6d-58e5-87a6-6320c125d3e8/80d4009f-7e6d-58e5-87a6-6320c125d3e8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287032,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d4009f-7e6d-58e5-87a6-6320c125d3e8/80d4009f-7e6d-58e5-87a6-6320c125d3e8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311710,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/6fe8c7a9c4334fcdb0274cd8b984523e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-12',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.5 BlueHDi 130ch S&S Active Pack',
'transmission': 'manual',
'trim': '3008 1.5 BlueHDi 130ch S&S Active Pack',
'vin': None,
'year': 2022}
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988432%27 HTTP/1.1" 200 None
2026-03-27 16:50:58 [ayvens.fr] INFO: Saving data for 1988432: {'created_time': 1774630258.673308, 'last_price_update_time': 1774630258.673319, 'auction_closing_time': 1774969200.0}
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988432') HTTP/1.1" 204 0
2026-03-27 16:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:58 [ayvens.fr] INFO: Found listing with ID: 1988434
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988434%27 HTTP/1.1" 200 None
2026-03-27 16:50:58 [ayvens.fr] INFO: Scrape type for 1988434: 1
2026-03-27 16:50:58 [ayvens.fr] INFO: Extracting data for car ID: 1988434
2026-03-27 16:50:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 062b163d-6676-57eb-baf7-3893e898502a with identifier: 1988434
2026-03-27 16:50:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 062b163d-6676-57eb-baf7-3893e898502a with scrape type 1
2026-03-27 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 062b163d-6676-57eb-baf7-3893e898502a
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F90f5f4faaea54e798e4e4ac1d241cfb3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/1.jpg not downloaded yet
2026-03-27 16:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b22b10>
2026-03-27 16:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56ba123f-f338-5495-88c8-4c694605adbf/56ba123f-f338-5495-88c8-4c694605adbf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fd2965a4ff0d744aead400347fd89d804%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/1.jpg saved to cache
2026-03-27 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56ba123f-f338-5495-88c8-4c694605adbf
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F90f5f4faaea54e798e4e4ac1d241cfb3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/2.jpg not downloaded yet
2026-03-27 16:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F90f5f4faaea54e798e4e4ac1d241cfb3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/3.jpg not downloaded yet
2026-03-27 16:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d8fe90>
2026-03-27 16:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56ba123f-f338-5495-88c8-4c694605adbf/56ba123f-f338-5495-88c8-4c694605adbf_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fd2965a4ff0d744aead400347fd89d804%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/2.jpg saved to cache
2026-03-27 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 56ba123f-f338-5495-88c8-4c694605adbf
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F90f5f4faaea54e798e4e4ac1d241cfb3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/4.jpg not downloaded yet
2026-03-27 16:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e16410>
2026-03-27 16:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56ba123f-f338-5495-88c8-4c694605adbf/56ba123f-f338-5495-88c8-4c694605adbf_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fd2965a4ff0d744aead400347fd89d804%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/3.jpg saved to cache
2026-03-27 16:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 56ba123f-f338-5495-88c8-4c694605adbf
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F90f5f4faaea54e798e4e4ac1d241cfb3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/5.jpg not downloaded yet
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590529c90>
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56ba123f-f338-5495-88c8-4c694605adbf/56ba123f-f338-5495-88c8-4c694605adbf_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fd2965a4ff0d744aead400347fd89d804%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/4.jpg saved to cache
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 56ba123f-f338-5495-88c8-4c694605adbf
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc5d10>
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56ba123f-f338-5495-88c8-4c694605adbf/56ba123f-f338-5495-88c8-4c694605adbf_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fd2965a4ff0d744aead400347fd89d804%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/5.jpg saved to cache
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 56ba123f-f338-5495-88c8-4c694605adbf
2026-03-27 16:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F90f5f4faaea54e798e4e4ac1d241cfb3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/6.jpg not downloaded yet
2026-03-27 16:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F90f5f4faaea54e798e4e4ac1d241cfb3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/7.jpg not downloaded yet
2026-03-27 16:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F90f5f4faaea54e798e4e4ac1d241cfb3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/8.jpg not downloaded yet
2026-03-27 16:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:59 [ayvens.fr] INFO: Found listing with ID: 1988435
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988435%27 HTTP/1.1" 200 None
2026-03-27 16:50:59 [ayvens.fr] INFO: Scrape type for 1988435: 1
2026-03-27 16:50:59 [ayvens.fr] INFO: Extracting data for car ID: 1988435
2026-03-27 16:50:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c16c9e70-7dd8-5494-9a2d-4782445fb9f6 with identifier: 1988435
2026-03-27 16:50:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c16c9e70-7dd8-5494-9a2d-4782445fb9f6 with scrape type 1
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c16c9e70-7dd8-5494-9a2d-4782445fb9f6
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F0f3d8237192844788e6bc9466c258747%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/1.jpg not downloaded yet
2026-03-27 16:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F0f3d8237192844788e6bc9466c258747%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/2.jpg not downloaded yet
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911cae90>
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56ba123f-f338-5495-88c8-4c694605adbf/56ba123f-f338-5495-88c8-4c694605adbf_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fd2965a4ff0d744aead400347fd89d804%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/6.jpg saved to cache
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 56ba123f-f338-5495-88c8-4c694605adbf
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911bb9d0>
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56ba123f-f338-5495-88c8-4c694605adbf/56ba123f-f338-5495-88c8-4c694605adbf_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fd2965a4ff0d744aead400347fd89d804%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/7.jpg saved to cache
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 56ba123f-f338-5495-88c8-4c694605adbf
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F0f3d8237192844788e6bc9466c258747%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/3.jpg not downloaded yet
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f61350>
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062b163d-6676-57eb-baf7-3893e898502a/062b163d-6676-57eb-baf7-3893e898502a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F90f5f4faaea54e798e4e4ac1d241cfb3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/1.jpg saved to cache
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 062b163d-6676-57eb-baf7-3893e898502a
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F0f3d8237192844788e6bc9466c258747%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/4.jpg not downloaded yet
2026-03-27 16:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b4bc50>
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56ba123f-f338-5495-88c8-4c694605adbf/56ba123f-f338-5495-88c8-4c694605adbf_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252Fd2965a4ff0d744aead400347fd89d804%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/8.jpg saved to cache
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 56ba123f-f338-5495-88c8-4c694605adbf
2026-03-27 16:50:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56ba123f-f338-5495-88c8-4c694605adbf, skipping ID generation
2026-03-27 16:50:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56ba123f-f338-5495-88c8-4c694605adbf with scrape type 1
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56ba123f-f338-5495-88c8-4c694605adbf sending to next pipeline
2026-03-27 16:50:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 56ba123f-f338-5495-88c8-4c694605adbf, identifier: 1988433
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910d1310>
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062b163d-6676-57eb-baf7-3893e898502a/062b163d-6676-57eb-baf7-3893e898502a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F90f5f4faaea54e798e4e4ac1d241cfb3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/2.jpg saved to cache
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 062b163d-6676-57eb-baf7-3893e898502a
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59064fa90>
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062b163d-6676-57eb-baf7-3893e898502a/062b163d-6676-57eb-baf7-3893e898502a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F90f5f4faaea54e798e4e4ac1d241cfb3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/3.jpg saved to cache
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 062b163d-6676-57eb-baf7-3893e898502a
2026-03-27 16:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F0f3d8237192844788e6bc9466c258747%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/5.jpg not downloaded yet
2026-03-27 16:50:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 56ba123f-f338-5495-88c8-4c694605adbf with identifier: 1988433
2026-03-27 16:50:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 56ba123f-f338-5495-88c8-4c694605adbf with identifier: 1988433
2026-03-27 16:51:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 56ba123f-f338-5495-88c8-4c694605adbf with identifier: 1988433 to the API
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '56ba123f-f338-5495-88c8-4c694605adbf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 112995,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56ba123f-f338-5495-88c8-4c694605adbf/56ba123f-f338-5495-88c8-4c694605adbf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318449,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56ba123f-f338-5495-88c8-4c694605adbf/56ba123f-f338-5495-88c8-4c694605adbf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318449,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56ba123f-f338-5495-88c8-4c694605adbf/56ba123f-f338-5495-88c8-4c694605adbf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324298,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56ba123f-f338-5495-88c8-4c694605adbf/56ba123f-f338-5495-88c8-4c694605adbf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330402,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56ba123f-f338-5495-88c8-4c694605adbf/56ba123f-f338-5495-88c8-4c694605adbf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341346,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56ba123f-f338-5495-88c8-4c694605adbf/56ba123f-f338-5495-88c8-4c694605adbf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307033,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56ba123f-f338-5495-88c8-4c694605adbf/56ba123f-f338-5495-88c8-4c694605adbf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56ba123f-f338-5495-88c8-4c694605adbf/56ba123f-f338-5495-88c8-4c694605adbf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 451156,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/d2965a4ff0d744aead400347fd89d804/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-09',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch S&S Active Business',
'transmission': 'manual',
'trim': '3008 1.2 PureTech 130ch S&S Active Business',
'vin': None,
'year': 2019}
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988433%27 HTTP/1.1" 200 None
2026-03-27 16:51:00 [ayvens.fr] INFO: Saving data for 1988433: {'created_time': 1774630260.344434, 'last_price_update_time': 1774630260.344446, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988433') HTTP/1.1" 204 0
2026-03-27 16:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F0f3d8237192844788e6bc9466c258747%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/6.jpg not downloaded yet
2026-03-27 16:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc593178b50>
2026-03-27 16:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062b163d-6676-57eb-baf7-3893e898502a/062b163d-6676-57eb-baf7-3893e898502a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F90f5f4faaea54e798e4e4ac1d241cfb3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/7.jpg saved to cache
2026-03-27 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 062b163d-6676-57eb-baf7-3893e898502a
2026-03-27 16:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dadd90>
2026-03-27 16:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062b163d-6676-57eb-baf7-3893e898502a/062b163d-6676-57eb-baf7-3893e898502a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F90f5f4faaea54e798e4e4ac1d241cfb3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/4.jpg saved to cache
2026-03-27 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 062b163d-6676-57eb-baf7-3893e898502a
2026-03-27 16:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa2c90>
2026-03-27 16:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062b163d-6676-57eb-baf7-3893e898502a/062b163d-6676-57eb-baf7-3893e898502a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F90f5f4faaea54e798e4e4ac1d241cfb3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/8.jpg saved to cache
2026-03-27 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 062b163d-6676-57eb-baf7-3893e898502a
2026-03-27 16:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F0f3d8237192844788e6bc9466c258747%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/7.jpg not downloaded yet
2026-03-27 16:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F0f3d8237192844788e6bc9466c258747%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/8.jpg not downloaded yet
2026-03-27 16:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591183250>
2026-03-27 16:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062b163d-6676-57eb-baf7-3893e898502a/062b163d-6676-57eb-baf7-3893e898502a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F90f5f4faaea54e798e4e4ac1d241cfb3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/6.jpg saved to cache
2026-03-27 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 062b163d-6676-57eb-baf7-3893e898502a
2026-03-27 16:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911ef550>
2026-03-27 16:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062b163d-6676-57eb-baf7-3893e898502a/062b163d-6676-57eb-baf7-3893e898502a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F90f5f4faaea54e798e4e4ac1d241cfb3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/5.jpg saved to cache
2026-03-27 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 062b163d-6676-57eb-baf7-3893e898502a
2026-03-27 16:51:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 062b163d-6676-57eb-baf7-3893e898502a, skipping ID generation
2026-03-27 16:51:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 062b163d-6676-57eb-baf7-3893e898502a with scrape type 1
2026-03-27 16:51:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 062b163d-6676-57eb-baf7-3893e898502a sending to next pipeline
2026-03-27 16:51:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 062b163d-6676-57eb-baf7-3893e898502a, identifier: 1988434
2026-03-27 16:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 062b163d-6676-57eb-baf7-3893e898502a with identifier: 1988434
2026-03-27 16:51:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 062b163d-6676-57eb-baf7-3893e898502a with identifier: 1988434
2026-03-27 16:51:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 062b163d-6676-57eb-baf7-3893e898502a with identifier: 1988434 to the API
2026-03-27 16:51:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'BLEU DE PRUSSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '062b163d-6676-57eb-baf7-3893e898502a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'RAV4 HSD',
'odometer': 41847,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_062b163d-6676-57eb-baf7-3893e898502a/062b163d-6676-57eb-baf7-3893e898502a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_062b163d-6676-57eb-baf7-3893e898502a/062b163d-6676-57eb-baf7-3893e898502a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_062b163d-6676-57eb-baf7-3893e898502a/062b163d-6676-57eb-baf7-3893e898502a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337381,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_062b163d-6676-57eb-baf7-3893e898502a/062b163d-6676-57eb-baf7-3893e898502a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318127,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_062b163d-6676-57eb-baf7-3893e898502a/062b163d-6676-57eb-baf7-3893e898502a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324571,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_062b163d-6676-57eb-baf7-3893e898502a/062b163d-6676-57eb-baf7-3893e898502a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310794,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_062b163d-6676-57eb-baf7-3893e898502a/062b163d-6676-57eb-baf7-3893e898502a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291232,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_062b163d-6676-57eb-baf7-3893e898502a/062b163d-6676-57eb-baf7-3893e898502a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236840,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/90f5f4faaea54e798e4e4ac1d241cfb3/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-20',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA RAV4 HSD RAV4 2.5 Hybride 218ch Dynamic Business 2WD + '
'Programme Beyond Zero Academy',
'transmission': 'automatic',
'trim': 'RAV4 2.5 Hybride 218ch Dynamic Business 2WD + Programme Beyond Zero '
'Academy',
'vin': None,
'year': 2022}
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988434%27 HTTP/1.1" 200 None
2026-03-27 16:51:01 [ayvens.fr] INFO: Saving data for 1988434: {'created_time': 1774630261.253189, 'last_price_update_time': 1774630261.2532, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988434') HTTP/1.1" 204 0
2026-03-27 16:51:01 [ayvens.fr] INFO: Found listing with ID: 1988436
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988436%27 HTTP/1.1" 200 None
2026-03-27 16:51:01 [ayvens.fr] INFO: Scrape type for 1988436: 1
2026-03-27 16:51:01 [ayvens.fr] INFO: Extracting data for car ID: 1988436
2026-03-27 16:51:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f96c4d55-ef2b-55aa-ad04-74e86580d7e4 with identifier: 1988436
2026-03-27 16:51:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f96c4d55-ef2b-55aa-ad04-74e86580d7e4 with scrape type 1
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f96c4d55-ef2b-55aa-ad04-74e86580d7e4
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe8014f12d7014db49642df530b933f33%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/1.jpg not downloaded yet
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b04910>
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16c9e70-7dd8-5494-9a2d-4782445fb9f6/c16c9e70-7dd8-5494-9a2d-4782445fb9f6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F0f3d8237192844788e6bc9466c258747%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/1.jpg saved to cache
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c16c9e70-7dd8-5494-9a2d-4782445fb9f6
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590af3850>
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16c9e70-7dd8-5494-9a2d-4782445fb9f6/c16c9e70-7dd8-5494-9a2d-4782445fb9f6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F0f3d8237192844788e6bc9466c258747%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/2.jpg saved to cache
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c16c9e70-7dd8-5494-9a2d-4782445fb9f6
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe8014f12d7014db49642df530b933f33%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/2.jpg not downloaded yet
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d61b10>
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16c9e70-7dd8-5494-9a2d-4782445fb9f6/c16c9e70-7dd8-5494-9a2d-4782445fb9f6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F0f3d8237192844788e6bc9466c258747%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/3.jpg saved to cache
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c16c9e70-7dd8-5494-9a2d-4782445fb9f6
2026-03-27 16:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe8014f12d7014db49642df530b933f33%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/3.jpg not downloaded yet
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe8014f12d7014db49642df530b933f33%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/4.jpg not downloaded yet
2026-03-27 16:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe8014f12d7014db49642df530b933f33%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/5.jpg not downloaded yet
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe8014f12d7014db49642df530b933f33%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/6.jpg not downloaded yet
2026-03-27 16:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe8014f12d7014db49642df530b933f33%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/7.jpg not downloaded yet
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe8014f12d7014db49642df530b933f33%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/8.jpg not downloaded yet
2026-03-27 16:51:01 [ayvens.fr] INFO: Found listing with ID: 1988437
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988437%27 HTTP/1.1" 200 None
2026-03-27 16:51:01 [ayvens.fr] INFO: Scrape type for 1988437: 1
2026-03-27 16:51:01 [ayvens.fr] INFO: Extracting data for car ID: 1988437
2026-03-27 16:51:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62ef861c-ebdf-5e60-b32e-26d40a2fb983 with identifier: 1988437
2026-03-27 16:51:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62ef861c-ebdf-5e60-b32e-26d40a2fb983 with scrape type 1
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 62ef861c-ebdf-5e60-b32e-26d40a2fb983
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F38f2ff89371c46cf99fe9eed9e654533%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/1.jpg not downloaded yet
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F38f2ff89371c46cf99fe9eed9e654533%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/2.jpg not downloaded yet
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F38f2ff89371c46cf99fe9eed9e654533%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/3.jpg not downloaded yet
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b19d50>
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16c9e70-7dd8-5494-9a2d-4782445fb9f6/c16c9e70-7dd8-5494-9a2d-4782445fb9f6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F0f3d8237192844788e6bc9466c258747%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/4.jpg saved to cache
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c16c9e70-7dd8-5494-9a2d-4782445fb9f6
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b51210>
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16c9e70-7dd8-5494-9a2d-4782445fb9f6/c16c9e70-7dd8-5494-9a2d-4782445fb9f6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F0f3d8237192844788e6bc9466c258747%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/5.jpg saved to cache
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c16c9e70-7dd8-5494-9a2d-4782445fb9f6
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904d63d0>
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16c9e70-7dd8-5494-9a2d-4782445fb9f6/c16c9e70-7dd8-5494-9a2d-4782445fb9f6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F0f3d8237192844788e6bc9466c258747%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/6.jpg saved to cache
2026-03-27 16:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c16c9e70-7dd8-5494-9a2d-4782445fb9f6
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F38f2ff89371c46cf99fe9eed9e654533%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/4.jpg not downloaded yet
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa3890>
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16c9e70-7dd8-5494-9a2d-4782445fb9f6/c16c9e70-7dd8-5494-9a2d-4782445fb9f6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F0f3d8237192844788e6bc9466c258747%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/7.jpg saved to cache
2026-03-27 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c16c9e70-7dd8-5494-9a2d-4782445fb9f6
2026-03-27 16:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F38f2ff89371c46cf99fe9eed9e654533%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/5.jpg not downloaded yet
2026-03-27 16:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa3850>
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c16c9e70-7dd8-5494-9a2d-4782445fb9f6/c16c9e70-7dd8-5494-9a2d-4782445fb9f6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F0f3d8237192844788e6bc9466c258747%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/8.jpg saved to cache
2026-03-27 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c16c9e70-7dd8-5494-9a2d-4782445fb9f6
2026-03-27 16:51:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c16c9e70-7dd8-5494-9a2d-4782445fb9f6, skipping ID generation
2026-03-27 16:51:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c16c9e70-7dd8-5494-9a2d-4782445fb9f6 with scrape type 1
2026-03-27 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c16c9e70-7dd8-5494-9a2d-4782445fb9f6 sending to next pipeline
2026-03-27 16:51:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c16c9e70-7dd8-5494-9a2d-4782445fb9f6, identifier: 1988435
2026-03-27 16:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F38f2ff89371c46cf99fe9eed9e654533%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/6.jpg not downloaded yet
2026-03-27 16:51:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c16c9e70-7dd8-5494-9a2d-4782445fb9f6 with identifier: 1988435
2026-03-27 16:51:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c16c9e70-7dd8-5494-9a2d-4782445fb9f6 with identifier: 1988435
2026-03-27 16:51:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c16c9e70-7dd8-5494-9a2d-4782445fb9f6 with identifier: 1988435 to the API
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'c16c9e70-7dd8-5494-9a2d-4782445fb9f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'INSIGNIA',
'odometer': 105030,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16c9e70-7dd8-5494-9a2d-4782445fb9f6/c16c9e70-7dd8-5494-9a2d-4782445fb9f6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346051,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16c9e70-7dd8-5494-9a2d-4782445fb9f6/c16c9e70-7dd8-5494-9a2d-4782445fb9f6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346051,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16c9e70-7dd8-5494-9a2d-4782445fb9f6/c16c9e70-7dd8-5494-9a2d-4782445fb9f6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337788,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16c9e70-7dd8-5494-9a2d-4782445fb9f6/c16c9e70-7dd8-5494-9a2d-4782445fb9f6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380664,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16c9e70-7dd8-5494-9a2d-4782445fb9f6/c16c9e70-7dd8-5494-9a2d-4782445fb9f6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314572,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16c9e70-7dd8-5494-9a2d-4782445fb9f6/c16c9e70-7dd8-5494-9a2d-4782445fb9f6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322177,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16c9e70-7dd8-5494-9a2d-4782445fb9f6/c16c9e70-7dd8-5494-9a2d-4782445fb9f6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336088,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16c9e70-7dd8-5494-9a2d-4782445fb9f6/c16c9e70-7dd8-5494-9a2d-4782445fb9f6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350824,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/0f3d8237192844788e6bc9466c258747/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-05',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL INSIGNIA Insignia Grand Sport 1.6 D 136ch Innovation Business '
'BVA Euro6dT',
'transmission': 'automatic',
'trim': 'Insignia Grand Sport 1.6 D 136ch Innovation Business BVA Euro6dT',
'vin': None,
'year': 2019}
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988435%27 HTTP/1.1" 200 None
2026-03-27 16:51:02 [ayvens.fr] INFO: Saving data for 1988435: {'created_time': 1774630262.627998, 'last_price_update_time': 1774630262.628012, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988435') HTTP/1.1" 204 0
2026-03-27 16:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F38f2ff89371c46cf99fe9eed9e654533%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/7.jpg not downloaded yet
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e091d0>
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f96c4d55-ef2b-55aa-ad04-74e86580d7e4/f96c4d55-ef2b-55aa-ad04-74e86580d7e4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe8014f12d7014db49642df530b933f33%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/1.jpg saved to cache
2026-03-27 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f96c4d55-ef2b-55aa-ad04-74e86580d7e4
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa0510>
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f96c4d55-ef2b-55aa-ad04-74e86580d7e4/f96c4d55-ef2b-55aa-ad04-74e86580d7e4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe8014f12d7014db49642df530b933f33%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/7.jpg saved to cache
2026-03-27 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f96c4d55-ef2b-55aa-ad04-74e86580d7e4
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d2d50>
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f96c4d55-ef2b-55aa-ad04-74e86580d7e4/f96c4d55-ef2b-55aa-ad04-74e86580d7e4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe8014f12d7014db49642df530b933f33%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/8.jpg saved to cache
2026-03-27 16:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f96c4d55-ef2b-55aa-ad04-74e86580d7e4
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590655d10>
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f96c4d55-ef2b-55aa-ad04-74e86580d7e4/f96c4d55-ef2b-55aa-ad04-74e86580d7e4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe8014f12d7014db49642df530b933f33%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/2.jpg saved to cache
2026-03-27 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f96c4d55-ef2b-55aa-ad04-74e86580d7e4
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590eff350>
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f96c4d55-ef2b-55aa-ad04-74e86580d7e4/f96c4d55-ef2b-55aa-ad04-74e86580d7e4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe8014f12d7014db49642df530b933f33%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/6.jpg saved to cache
2026-03-27 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f96c4d55-ef2b-55aa-ad04-74e86580d7e4
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efca50>
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f96c4d55-ef2b-55aa-ad04-74e86580d7e4/f96c4d55-ef2b-55aa-ad04-74e86580d7e4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe8014f12d7014db49642df530b933f33%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/5.jpg saved to cache
2026-03-27 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f96c4d55-ef2b-55aa-ad04-74e86580d7e4
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591483c90>
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f96c4d55-ef2b-55aa-ad04-74e86580d7e4/f96c4d55-ef2b-55aa-ad04-74e86580d7e4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe8014f12d7014db49642df530b933f33%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/4.jpg saved to cache
2026-03-27 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f96c4d55-ef2b-55aa-ad04-74e86580d7e4
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F38f2ff89371c46cf99fe9eed9e654533%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/8.jpg not downloaded yet
2026-03-27 16:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b6b550>
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f96c4d55-ef2b-55aa-ad04-74e86580d7e4/f96c4d55-ef2b-55aa-ad04-74e86580d7e4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252Fe8014f12d7014db49642df530b933f33%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/3.jpg saved to cache
2026-03-27 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f96c4d55-ef2b-55aa-ad04-74e86580d7e4
2026-03-27 16:51:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f96c4d55-ef2b-55aa-ad04-74e86580d7e4, skipping ID generation
2026-03-27 16:51:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f96c4d55-ef2b-55aa-ad04-74e86580d7e4 with scrape type 1
2026-03-27 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f96c4d55-ef2b-55aa-ad04-74e86580d7e4 sending to next pipeline
2026-03-27 16:51:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f96c4d55-ef2b-55aa-ad04-74e86580d7e4, identifier: 1988436
2026-03-27 16:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:03 [ayvens.fr] INFO: Found listing with ID: 1988438
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988438%27 HTTP/1.1" 200 None
2026-03-27 16:51:03 [ayvens.fr] INFO: Scrape type for 1988438: 1
2026-03-27 16:51:03 [ayvens.fr] INFO: Extracting data for car ID: 1988438
2026-03-27 16:51:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3bba73f-86e7-5452-a790-ca2d125fe0f1 with identifier: 1988438
2026-03-27 16:51:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3bba73f-86e7-5452-a790-ca2d125fe0f1 with scrape type 1
2026-03-27 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f3bba73f-86e7-5452-a790-ca2d125fe0f1
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5a31f163ead4461c984e5a4876b1704d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/1.jpg not downloaded yet
2026-03-27 16:51:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f96c4d55-ef2b-55aa-ad04-74e86580d7e4 with identifier: 1988436
2026-03-27 16:51:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f96c4d55-ef2b-55aa-ad04-74e86580d7e4 with identifier: 1988436
2026-03-27 16:51:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f96c4d55-ef2b-55aa-ad04-74e86580d7e4 with identifier: 1988436 to the API
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'BLANC SENSATION',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'f96c4d55-ef2b-55aa-ad04-74e86580d7e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'CEED',
'odometer': 55405,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f96c4d55-ef2b-55aa-ad04-74e86580d7e4/f96c4d55-ef2b-55aa-ad04-74e86580d7e4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348618,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f96c4d55-ef2b-55aa-ad04-74e86580d7e4/f96c4d55-ef2b-55aa-ad04-74e86580d7e4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348618,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f96c4d55-ef2b-55aa-ad04-74e86580d7e4/f96c4d55-ef2b-55aa-ad04-74e86580d7e4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391321,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f96c4d55-ef2b-55aa-ad04-74e86580d7e4/f96c4d55-ef2b-55aa-ad04-74e86580d7e4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281918,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f96c4d55-ef2b-55aa-ad04-74e86580d7e4/f96c4d55-ef2b-55aa-ad04-74e86580d7e4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311923,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f96c4d55-ef2b-55aa-ad04-74e86580d7e4/f96c4d55-ef2b-55aa-ad04-74e86580d7e4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300543,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f96c4d55-ef2b-55aa-ad04-74e86580d7e4/f96c4d55-ef2b-55aa-ad04-74e86580d7e4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308032,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f96c4d55-ef2b-55aa-ad04-74e86580d7e4/f96c4d55-ef2b-55aa-ad04-74e86580d7e4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181747,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/e8014f12d7014db49642df530b933f33/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-09-12',
'seats_number': 5,
'seller_name': None,
'title': 'KIA CEED Ceed 1.5 T-GDi 140ch GT-Line DCT7',
'transmission': 'automatic',
'trim': 'Ceed 1.5 T-GDi 140ch GT-Line DCT7',
'vin': None,
'year': 2024}
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988436%27 HTTP/1.1" 200 None
2026-03-27 16:51:03 [ayvens.fr] INFO: Saving data for 1988436: {'created_time': 1774630263.865337, 'last_price_update_time': 1774630263.865347, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988436') HTTP/1.1" 204 0
2026-03-27 16:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5a31f163ead4461c984e5a4876b1704d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/2.jpg not downloaded yet
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e4790>
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ef861c-ebdf-5e60-b32e-26d40a2fb983/62ef861c-ebdf-5e60-b32e-26d40a2fb983_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F38f2ff89371c46cf99fe9eed9e654533%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/1.jpg saved to cache
2026-03-27 16:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62ef861c-ebdf-5e60-b32e-26d40a2fb983
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de4850>
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ef861c-ebdf-5e60-b32e-26d40a2fb983/62ef861c-ebdf-5e60-b32e-26d40a2fb983_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F38f2ff89371c46cf99fe9eed9e654533%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/2.jpg saved to cache
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 62ef861c-ebdf-5e60-b32e-26d40a2fb983
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c24d0>
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ef861c-ebdf-5e60-b32e-26d40a2fb983/62ef861c-ebdf-5e60-b32e-26d40a2fb983_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F38f2ff89371c46cf99fe9eed9e654533%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/3.jpg saved to cache
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 62ef861c-ebdf-5e60-b32e-26d40a2fb983
2026-03-27 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5a31f163ead4461c984e5a4876b1704d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/3.jpg not downloaded yet
2026-03-27 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5a31f163ead4461c984e5a4876b1704d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/4.jpg not downloaded yet
2026-03-27 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f30690>
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ef861c-ebdf-5e60-b32e-26d40a2fb983/62ef861c-ebdf-5e60-b32e-26d40a2fb983_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F38f2ff89371c46cf99fe9eed9e654533%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/4.jpg saved to cache
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 62ef861c-ebdf-5e60-b32e-26d40a2fb983
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5a31f163ead4461c984e5a4876b1704d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/5.jpg not downloaded yet
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5a31f163ead4461c984e5a4876b1704d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/6.jpg not downloaded yet
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d49310>
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ef861c-ebdf-5e60-b32e-26d40a2fb983/62ef861c-ebdf-5e60-b32e-26d40a2fb983_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F38f2ff89371c46cf99fe9eed9e654533%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/5.jpg saved to cache
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 62ef861c-ebdf-5e60-b32e-26d40a2fb983
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068ff50>
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ef861c-ebdf-5e60-b32e-26d40a2fb983/62ef861c-ebdf-5e60-b32e-26d40a2fb983_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F38f2ff89371c46cf99fe9eed9e654533%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/6.jpg saved to cache
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 62ef861c-ebdf-5e60-b32e-26d40a2fb983
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9e0d0>
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ef861c-ebdf-5e60-b32e-26d40a2fb983/62ef861c-ebdf-5e60-b32e-26d40a2fb983_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F38f2ff89371c46cf99fe9eed9e654533%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/7.jpg saved to cache
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 62ef861c-ebdf-5e60-b32e-26d40a2fb983
2026-03-27 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5a31f163ead4461c984e5a4876b1704d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/7.jpg not downloaded yet
2026-03-27 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5a31f163ead4461c984e5a4876b1704d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/8.jpg not downloaded yet
2026-03-27 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:04 [ayvens.fr] INFO: Found listing with ID: 1988439
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988439%27 HTTP/1.1" 200 None
2026-03-27 16:51:04 [ayvens.fr] INFO: Scrape type for 1988439: 1
2026-03-27 16:51:04 [ayvens.fr] INFO: Extracting data for car ID: 1988439
2026-03-27 16:51:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dba62fb4-3e74-508c-a2ac-fe1b89373c7c with identifier: 1988439
2026-03-27 16:51:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dba62fb4-3e74-508c-a2ac-fe1b89373c7c with scrape type 1
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item dba62fb4-3e74-508c-a2ac-fe1b89373c7c
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F08b7d507f2f647448999c057e7f822b3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/1.jpg not downloaded yet
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F08b7d507f2f647448999c057e7f822b3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/2.jpg not downloaded yet
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F08b7d507f2f647448999c057e7f822b3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/3.jpg not downloaded yet
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F08b7d507f2f647448999c057e7f822b3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/4.jpg not downloaded yet
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F08b7d507f2f647448999c057e7f822b3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/5.jpg not downloaded yet
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068de10>
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ef861c-ebdf-5e60-b32e-26d40a2fb983/62ef861c-ebdf-5e60-b32e-26d40a2fb983_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F38f2ff89371c46cf99fe9eed9e654533%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/8.jpg saved to cache
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 62ef861c-ebdf-5e60-b32e-26d40a2fb983
2026-03-27 16:51:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62ef861c-ebdf-5e60-b32e-26d40a2fb983, skipping ID generation
2026-03-27 16:51:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62ef861c-ebdf-5e60-b32e-26d40a2fb983 with scrape type 1
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62ef861c-ebdf-5e60-b32e-26d40a2fb983 sending to next pipeline
2026-03-27 16:51:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 62ef861c-ebdf-5e60-b32e-26d40a2fb983, identifier: 1988437
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7db50>
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3bba73f-86e7-5452-a790-ca2d125fe0f1/f3bba73f-86e7-5452-a790-ca2d125fe0f1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5a31f163ead4461c984e5a4876b1704d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/2.jpg saved to cache
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f3bba73f-86e7-5452-a790-ca2d125fe0f1
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F08b7d507f2f647448999c057e7f822b3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/6.jpg not downloaded yet
2026-03-27 16:51:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 62ef861c-ebdf-5e60-b32e-26d40a2fb983 with identifier: 1988437
2026-03-27 16:51:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:51:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 62ef861c-ebdf-5e60-b32e-26d40a2fb983 with identifier: 1988437
2026-03-27 16:51:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 62ef861c-ebdf-5e60-b32e-26d40a2fb983 with identifier: 1988437 to the API
2026-03-27 16:51:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'color': 'GRIS PYRITE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '62ef861c-ebdf-5e60-b32e-26d40a2fb983',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'PASSAT',
'odometer': 27259,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ef861c-ebdf-5e60-b32e-26d40a2fb983/62ef861c-ebdf-5e60-b32e-26d40a2fb983_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293043,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ef861c-ebdf-5e60-b32e-26d40a2fb983/62ef861c-ebdf-5e60-b32e-26d40a2fb983_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293043,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ef861c-ebdf-5e60-b32e-26d40a2fb983/62ef861c-ebdf-5e60-b32e-26d40a2fb983_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320319,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ef861c-ebdf-5e60-b32e-26d40a2fb983/62ef861c-ebdf-5e60-b32e-26d40a2fb983_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272890,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ef861c-ebdf-5e60-b32e-26d40a2fb983/62ef861c-ebdf-5e60-b32e-26d40a2fb983_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345031,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ef861c-ebdf-5e60-b32e-26d40a2fb983/62ef861c-ebdf-5e60-b32e-26d40a2fb983_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319236,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ef861c-ebdf-5e60-b32e-26d40a2fb983/62ef861c-ebdf-5e60-b32e-26d40a2fb983_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364510,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ef861c-ebdf-5e60-b32e-26d40a2fb983/62ef861c-ebdf-5e60-b32e-26d40a2fb983_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 399342,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/38f2ff89371c46cf99fe9eed9e654533/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-23',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN PASSAT Passat 1.6 TDI 120ch Business DSG7',
'transmission': 'automatic',
'trim': 'Passat 1.6 TDI 120ch Business DSG7',
'vin': None,
'year': 2020}
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988437%27 HTTP/1.1" 200 None
2026-03-27 16:51:05 [ayvens.fr] INFO: Saving data for 1988437: {'created_time': 1774630265.225757, 'last_price_update_time': 1774630265.225768, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988437') HTTP/1.1" 204 0
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F08b7d507f2f647448999c057e7f822b3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/7.jpg not downloaded yet
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050c090>
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3bba73f-86e7-5452-a790-ca2d125fe0f1/f3bba73f-86e7-5452-a790-ca2d125fe0f1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5a31f163ead4461c984e5a4876b1704d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/1.jpg saved to cache
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3bba73f-86e7-5452-a790-ca2d125fe0f1
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a10d0>
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3bba73f-86e7-5452-a790-ca2d125fe0f1/f3bba73f-86e7-5452-a790-ca2d125fe0f1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5a31f163ead4461c984e5a4876b1704d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/3.jpg saved to cache
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f3bba73f-86e7-5452-a790-ca2d125fe0f1
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068d410>
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3bba73f-86e7-5452-a790-ca2d125fe0f1/f3bba73f-86e7-5452-a790-ca2d125fe0f1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5a31f163ead4461c984e5a4876b1704d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/4.jpg saved to cache
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f3bba73f-86e7-5452-a790-ca2d125fe0f1
2026-03-27 16:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F08b7d507f2f647448999c057e7f822b3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/8.jpg not downloaded yet
2026-03-27 16:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:05 [ayvens.fr] INFO: Found listing with ID: 1988440
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988440%27 HTTP/1.1" 200 None
2026-03-27 16:51:05 [ayvens.fr] INFO: Scrape type for 1988440: 1
2026-03-27 16:51:05 [ayvens.fr] INFO: Extracting data for car ID: 1988440
2026-03-27 16:51:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44603d9f-9314-58d1-a1af-4a2e1a99ae73 with identifier: 1988440
2026-03-27 16:51:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44603d9f-9314-58d1-a1af-4a2e1a99ae73 with scrape type 1
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 44603d9f-9314-58d1-a1af-4a2e1a99ae73
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Ff7f2893b185f41219c2585465b87858f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/1.jpg not downloaded yet
2026-03-27 16:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Ff7f2893b185f41219c2585465b87858f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/2.jpg not downloaded yet
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Ff7f2893b185f41219c2585465b87858f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/3.jpg not downloaded yet
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c3c50>
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3bba73f-86e7-5452-a790-ca2d125fe0f1/f3bba73f-86e7-5452-a790-ca2d125fe0f1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5a31f163ead4461c984e5a4876b1704d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/5.jpg saved to cache
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f3bba73f-86e7-5452-a790-ca2d125fe0f1
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f81710>
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3bba73f-86e7-5452-a790-ca2d125fe0f1/f3bba73f-86e7-5452-a790-ca2d125fe0f1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5a31f163ead4461c984e5a4876b1704d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/6.jpg saved to cache
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f3bba73f-86e7-5452-a790-ca2d125fe0f1
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Ff7f2893b185f41219c2585465b87858f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/4.jpg not downloaded yet
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe22d0>
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dba62fb4-3e74-508c-a2ac-fe1b89373c7c/dba62fb4-3e74-508c-a2ac-fe1b89373c7c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F08b7d507f2f647448999c057e7f822b3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/1.jpg saved to cache
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dba62fb4-3e74-508c-a2ac-fe1b89373c7c
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d7bc90>
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dba62fb4-3e74-508c-a2ac-fe1b89373c7c/dba62fb4-3e74-508c-a2ac-fe1b89373c7c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F08b7d507f2f647448999c057e7f822b3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/2.jpg saved to cache
2026-03-27 16:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dba62fb4-3e74-508c-a2ac-fe1b89373c7c
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590593790>
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dba62fb4-3e74-508c-a2ac-fe1b89373c7c/dba62fb4-3e74-508c-a2ac-fe1b89373c7c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F08b7d507f2f647448999c057e7f822b3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/3.jpg saved to cache
2026-03-27 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dba62fb4-3e74-508c-a2ac-fe1b89373c7c
2026-03-27 16:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b198d0>
2026-03-27 16:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3bba73f-86e7-5452-a790-ca2d125fe0f1/f3bba73f-86e7-5452-a790-ca2d125fe0f1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5a31f163ead4461c984e5a4876b1704d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/8.jpg saved to cache
2026-03-27 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f3bba73f-86e7-5452-a790-ca2d125fe0f1
2026-03-27 16:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Ff7f2893b185f41219c2585465b87858f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/5.jpg not downloaded yet
2026-03-27 16:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa2e10>
2026-03-27 16:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3bba73f-86e7-5452-a790-ca2d125fe0f1/f3bba73f-86e7-5452-a790-ca2d125fe0f1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5a31f163ead4461c984e5a4876b1704d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/7.jpg saved to cache
2026-03-27 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f3bba73f-86e7-5452-a790-ca2d125fe0f1
2026-03-27 16:51:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3bba73f-86e7-5452-a790-ca2d125fe0f1, skipping ID generation
2026-03-27 16:51:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3bba73f-86e7-5452-a790-ca2d125fe0f1 with scrape type 1
2026-03-27 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3bba73f-86e7-5452-a790-ca2d125fe0f1 sending to next pipeline
2026-03-27 16:51:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f3bba73f-86e7-5452-a790-ca2d125fe0f1, identifier: 1988438
2026-03-27 16:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911a5f90>
2026-03-27 16:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dba62fb4-3e74-508c-a2ac-fe1b89373c7c/dba62fb4-3e74-508c-a2ac-fe1b89373c7c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F08b7d507f2f647448999c057e7f822b3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/4.jpg saved to cache
2026-03-27 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dba62fb4-3e74-508c-a2ac-fe1b89373c7c
2026-03-27 16:51:06 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at -3 pages/min), scraped 240 items (at 44 items/min)
2026-03-27 16:51:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-27 16:51:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f3bba73f-86e7-5452-a790-ca2d125fe0f1 with identifier: 1988438
2026-03-27 16:51:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:51:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f3bba73f-86e7-5452-a790-ca2d125fe0f1 with identifier: 1988438
2026-03-27 16:51:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f3bba73f-86e7-5452-a790-ca2d125fe0f1 with identifier: 1988438 to the API
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 102,
'color': 'GRIS ARGENT',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'f3bba73f-86e7-5452-a790-ca2d125fe0f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'COROLLA',
'odometer': 100626,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3bba73f-86e7-5452-a790-ca2d125fe0f1/f3bba73f-86e7-5452-a790-ca2d125fe0f1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276262,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3bba73f-86e7-5452-a790-ca2d125fe0f1/f3bba73f-86e7-5452-a790-ca2d125fe0f1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276262,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3bba73f-86e7-5452-a790-ca2d125fe0f1/f3bba73f-86e7-5452-a790-ca2d125fe0f1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303913,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3bba73f-86e7-5452-a790-ca2d125fe0f1/f3bba73f-86e7-5452-a790-ca2d125fe0f1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324391,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3bba73f-86e7-5452-a790-ca2d125fe0f1/f3bba73f-86e7-5452-a790-ca2d125fe0f1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302960,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3bba73f-86e7-5452-a790-ca2d125fe0f1/f3bba73f-86e7-5452-a790-ca2d125fe0f1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302505,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3bba73f-86e7-5452-a790-ca2d125fe0f1/f3bba73f-86e7-5452-a790-ca2d125fe0f1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411721,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3bba73f-86e7-5452-a790-ca2d125fe0f1/f3bba73f-86e7-5452-a790-ca2d125fe0f1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387752,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5a31f163ead4461c984e5a4876b1704d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-18',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA COROLLA Corolla 122h Dynamic Business + Programme Beyond '
'Zero Academy',
'transmission': 'automatic',
'trim': 'Corolla 122h Dynamic Business + Programme Beyond Zero Academy',
'vin': None,
'year': 2023}
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988438%27 HTTP/1.1" 200 None
2026-03-27 16:51:06 [ayvens.fr] INFO: Saving data for 1988438: {'created_time': 1774630266.88167, 'last_price_update_time': 1774630266.881681, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988438') HTTP/1.1" 204 0
2026-03-27 16:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Ff7f2893b185f41219c2585465b87858f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/6.jpg not downloaded yet
2026-03-27 16:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e09290>
2026-03-27 16:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dba62fb4-3e74-508c-a2ac-fe1b89373c7c/dba62fb4-3e74-508c-a2ac-fe1b89373c7c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F08b7d507f2f647448999c057e7f822b3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/7.jpg saved to cache
2026-03-27 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dba62fb4-3e74-508c-a2ac-fe1b89373c7c
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Ff7f2893b185f41219c2585465b87858f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/7.jpg not downloaded yet
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Ff7f2893b185f41219c2585465b87858f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/8.jpg not downloaded yet
2026-03-27 16:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f13ed0>
2026-03-27 16:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dba62fb4-3e74-508c-a2ac-fe1b89373c7c/dba62fb4-3e74-508c-a2ac-fe1b89373c7c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F08b7d507f2f647448999c057e7f822b3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/5.jpg saved to cache
2026-03-27 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dba62fb4-3e74-508c-a2ac-fe1b89373c7c
2026-03-27 16:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068f510>
2026-03-27 16:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dba62fb4-3e74-508c-a2ac-fe1b89373c7c/dba62fb4-3e74-508c-a2ac-fe1b89373c7c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F08b7d507f2f647448999c057e7f822b3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/8.jpg saved to cache
2026-03-27 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dba62fb4-3e74-508c-a2ac-fe1b89373c7c
2026-03-27 16:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b4ac10>
2026-03-27 16:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dba62fb4-3e74-508c-a2ac-fe1b89373c7c/dba62fb4-3e74-508c-a2ac-fe1b89373c7c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F08b7d507f2f647448999c057e7f822b3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/6.jpg saved to cache
2026-03-27 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dba62fb4-3e74-508c-a2ac-fe1b89373c7c
2026-03-27 16:51:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dba62fb4-3e74-508c-a2ac-fe1b89373c7c, skipping ID generation
2026-03-27 16:51:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dba62fb4-3e74-508c-a2ac-fe1b89373c7c with scrape type 1
2026-03-27 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dba62fb4-3e74-508c-a2ac-fe1b89373c7c sending to next pipeline
2026-03-27 16:51:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: dba62fb4-3e74-508c-a2ac-fe1b89373c7c, identifier: 1988439
2026-03-27 16:51:07 [ayvens.fr] INFO: Found listing with ID: 1988441
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988441%27 HTTP/1.1" 200 None
2026-03-27 16:51:07 [ayvens.fr] INFO: Scrape type for 1988441: 1
2026-03-27 16:51:07 [ayvens.fr] INFO: Extracting data for car ID: 1988441
2026-03-27 16:51:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7604db86-1de9-5b41-9488-8cb50b571240 with identifier: 1988441
2026-03-27 16:51:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7604db86-1de9-5b41-9488-8cb50b571240 with scrape type 1
2026-03-27 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7604db86-1de9-5b41-9488-8cb50b571240
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F55531f46203d4e439c627e3e1a243596%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/1.jpg not downloaded yet
2026-03-27 16:51:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: dba62fb4-3e74-508c-a2ac-fe1b89373c7c with identifier: 1988439
2026-03-27 16:51:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: dba62fb4-3e74-508c-a2ac-fe1b89373c7c with identifier: 1988439
2026-03-27 16:51:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: dba62fb4-3e74-508c-a2ac-fe1b89373c7c with identifier: 1988439 to the API
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'NOIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'dba62fb4-3e74-508c-a2ac-fe1b89373c7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 36651,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dba62fb4-3e74-508c-a2ac-fe1b89373c7c/dba62fb4-3e74-508c-a2ac-fe1b89373c7c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311882,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dba62fb4-3e74-508c-a2ac-fe1b89373c7c/dba62fb4-3e74-508c-a2ac-fe1b89373c7c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311882,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dba62fb4-3e74-508c-a2ac-fe1b89373c7c/dba62fb4-3e74-508c-a2ac-fe1b89373c7c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335726,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dba62fb4-3e74-508c-a2ac-fe1b89373c7c/dba62fb4-3e74-508c-a2ac-fe1b89373c7c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315068,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dba62fb4-3e74-508c-a2ac-fe1b89373c7c/dba62fb4-3e74-508c-a2ac-fe1b89373c7c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337505,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dba62fb4-3e74-508c-a2ac-fe1b89373c7c/dba62fb4-3e74-508c-a2ac-fe1b89373c7c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303651,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dba62fb4-3e74-508c-a2ac-fe1b89373c7c/dba62fb4-3e74-508c-a2ac-fe1b89373c7c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262467,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dba62fb4-3e74-508c-a2ac-fe1b89373c7c/dba62fb4-3e74-508c-a2ac-fe1b89373c7c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215707,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/08b7d507f2f647448999c057e7f822b3/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 230ch HEV Active Business BVA6 4x2',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 230ch HEV Active Business BVA6 4x2',
'vin': None,
'year': 2022}
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988439%27 HTTP/1.1" 200 None
2026-03-27 16:51:07 [ayvens.fr] INFO: Saving data for 1988439: {'created_time': 1774630267.766418, 'last_price_update_time': 1774630267.766429, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988439') HTTP/1.1" 204 0
2026-03-27 16:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F55531f46203d4e439c627e3e1a243596%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/2.jpg not downloaded yet
2026-03-27 16:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050cb90>
2026-03-27 16:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44603d9f-9314-58d1-a1af-4a2e1a99ae73/44603d9f-9314-58d1-a1af-4a2e1a99ae73_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Ff7f2893b185f41219c2585465b87858f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/1.jpg saved to cache
2026-03-27 16:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44603d9f-9314-58d1-a1af-4a2e1a99ae73
2026-03-27 16:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066a910>
2026-03-27 16:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44603d9f-9314-58d1-a1af-4a2e1a99ae73/44603d9f-9314-58d1-a1af-4a2e1a99ae73_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Ff7f2893b185f41219c2585465b87858f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/2.jpg saved to cache
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44603d9f-9314-58d1-a1af-4a2e1a99ae73
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e5a50>
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44603d9f-9314-58d1-a1af-4a2e1a99ae73/44603d9f-9314-58d1-a1af-4a2e1a99ae73_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Ff7f2893b185f41219c2585465b87858f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/3.jpg saved to cache
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44603d9f-9314-58d1-a1af-4a2e1a99ae73
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F55531f46203d4e439c627e3e1a243596%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/3.jpg not downloaded yet
2026-03-27 16:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F55531f46203d4e439c627e3e1a243596%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/4.jpg not downloaded yet
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abbd50>
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44603d9f-9314-58d1-a1af-4a2e1a99ae73/44603d9f-9314-58d1-a1af-4a2e1a99ae73_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Ff7f2893b185f41219c2585465b87858f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/4.jpg saved to cache
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44603d9f-9314-58d1-a1af-4a2e1a99ae73
2026-03-27 16:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F55531f46203d4e439c627e3e1a243596%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/5.jpg not downloaded yet
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F55531f46203d4e439c627e3e1a243596%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/6.jpg not downloaded yet
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911edc50>
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44603d9f-9314-58d1-a1af-4a2e1a99ae73/44603d9f-9314-58d1-a1af-4a2e1a99ae73_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Ff7f2893b185f41219c2585465b87858f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/6.jpg saved to cache
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44603d9f-9314-58d1-a1af-4a2e1a99ae73
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068d010>
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44603d9f-9314-58d1-a1af-4a2e1a99ae73/44603d9f-9314-58d1-a1af-4a2e1a99ae73_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Ff7f2893b185f41219c2585465b87858f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/7.jpg saved to cache
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44603d9f-9314-58d1-a1af-4a2e1a99ae73
2026-03-27 16:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F55531f46203d4e439c627e3e1a243596%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/7.jpg not downloaded yet
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F55531f46203d4e439c627e3e1a243596%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/8.jpg not downloaded yet
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590517850>
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44603d9f-9314-58d1-a1af-4a2e1a99ae73/44603d9f-9314-58d1-a1af-4a2e1a99ae73_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Ff7f2893b185f41219c2585465b87858f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/5.jpg saved to cache
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44603d9f-9314-58d1-a1af-4a2e1a99ae73
2026-03-27 16:51:08 [ayvens.fr] INFO: Found listing with ID: 1988442
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988442%27 HTTP/1.1" 200 None
2026-03-27 16:51:08 [ayvens.fr] INFO: Scrape type for 1988442: 1
2026-03-27 16:51:08 [ayvens.fr] INFO: Extracting data for car ID: 1988442
2026-03-27 16:51:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13599f4b-7aa3-5419-9f75-09f5355e6d21 with identifier: 1988442
2026-03-27 16:51:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13599f4b-7aa3-5419-9f75-09f5355e6d21 with scrape type 1
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 13599f4b-7aa3-5419-9f75-09f5355e6d21
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F6629aa03855c4d60a8c3d45c4a61178e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/1.jpg not downloaded yet
2026-03-27 16:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F6629aa03855c4d60a8c3d45c4a61178e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/2.jpg not downloaded yet
2026-03-27 16:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0f690>
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44603d9f-9314-58d1-a1af-4a2e1a99ae73/44603d9f-9314-58d1-a1af-4a2e1a99ae73_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Ff7f2893b185f41219c2585465b87858f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/8.jpg saved to cache
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44603d9f-9314-58d1-a1af-4a2e1a99ae73
2026-03-27 16:51:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44603d9f-9314-58d1-a1af-4a2e1a99ae73, skipping ID generation
2026-03-27 16:51:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44603d9f-9314-58d1-a1af-4a2e1a99ae73 with scrape type 1
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44603d9f-9314-58d1-a1af-4a2e1a99ae73 sending to next pipeline
2026-03-27 16:51:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 44603d9f-9314-58d1-a1af-4a2e1a99ae73, identifier: 1988440
2026-03-27 16:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F6629aa03855c4d60a8c3d45c4a61178e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/3.jpg not downloaded yet
2026-03-27 16:51:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 44603d9f-9314-58d1-a1af-4a2e1a99ae73 with identifier: 1988440
2026-03-27 16:51:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:51:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 44603d9f-9314-58d1-a1af-4a2e1a99ae73 with identifier: 1988440
2026-03-27 16:51:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 44603d9f-9314-58d1-a1af-4a2e1a99ae73 with identifier: 1988440 to the API
2026-03-27 16:51:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'BLANC BANQUISE OPAQUE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '44603d9f-9314-58d1-a1af-4a2e1a99ae73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308',
'odometer': 22797,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44603d9f-9314-58d1-a1af-4a2e1a99ae73/44603d9f-9314-58d1-a1af-4a2e1a99ae73_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402665,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44603d9f-9314-58d1-a1af-4a2e1a99ae73/44603d9f-9314-58d1-a1af-4a2e1a99ae73_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402665,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44603d9f-9314-58d1-a1af-4a2e1a99ae73/44603d9f-9314-58d1-a1af-4a2e1a99ae73_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338571,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44603d9f-9314-58d1-a1af-4a2e1a99ae73/44603d9f-9314-58d1-a1af-4a2e1a99ae73_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260425,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44603d9f-9314-58d1-a1af-4a2e1a99ae73/44603d9f-9314-58d1-a1af-4a2e1a99ae73_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397456,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44603d9f-9314-58d1-a1af-4a2e1a99ae73/44603d9f-9314-58d1-a1af-4a2e1a99ae73_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350093,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44603d9f-9314-58d1-a1af-4a2e1a99ae73/44603d9f-9314-58d1-a1af-4a2e1a99ae73_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313574,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44603d9f-9314-58d1-a1af-4a2e1a99ae73/44603d9f-9314-58d1-a1af-4a2e1a99ae73_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 396959,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/f7f2893b185f41219c2585465b87858f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-11',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 308 1.2 PureTech 130ch S&S Allure Pack EAT8',
'transmission': 'automatic',
'trim': '308 1.2 PureTech 130ch S&S Allure Pack EAT8',
'vin': None,
'year': 2022}
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988440%27 HTTP/1.1" 200 None
2026-03-27 16:51:09 [ayvens.fr] INFO: Saving data for 1988440: {'created_time': 1774630269.094805, 'last_price_update_time': 1774630269.094816, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988440') HTTP/1.1" 204 0
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F6629aa03855c4d60a8c3d45c4a61178e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/4.jpg not downloaded yet
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590528b90>
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7604db86-1de9-5b41-9488-8cb50b571240/7604db86-1de9-5b41-9488-8cb50b571240_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F55531f46203d4e439c627e3e1a243596%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/1.jpg saved to cache
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7604db86-1de9-5b41-9488-8cb50b571240
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050c8d0>
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7604db86-1de9-5b41-9488-8cb50b571240/7604db86-1de9-5b41-9488-8cb50b571240_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F55531f46203d4e439c627e3e1a243596%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/2.jpg saved to cache
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7604db86-1de9-5b41-9488-8cb50b571240
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d82310>
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7604db86-1de9-5b41-9488-8cb50b571240/7604db86-1de9-5b41-9488-8cb50b571240_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F55531f46203d4e439c627e3e1a243596%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/4.jpg saved to cache
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7604db86-1de9-5b41-9488-8cb50b571240
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ab87d0>
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7604db86-1de9-5b41-9488-8cb50b571240/7604db86-1de9-5b41-9488-8cb50b571240_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F55531f46203d4e439c627e3e1a243596%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/3.jpg saved to cache
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7604db86-1de9-5b41-9488-8cb50b571240
2026-03-27 16:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F6629aa03855c4d60a8c3d45c4a61178e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/5.jpg not downloaded yet
2026-03-27 16:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F6629aa03855c4d60a8c3d45c4a61178e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/6.jpg not downloaded yet
2026-03-27 16:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F6629aa03855c4d60a8c3d45c4a61178e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/7.jpg not downloaded yet
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F6629aa03855c4d60a8c3d45c4a61178e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/8.jpg not downloaded yet
2026-03-27 16:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:09 [ayvens.fr] INFO: Found listing with ID: 1988443
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988443%27 HTTP/1.1" 200 None
2026-03-27 16:51:09 [ayvens.fr] INFO: Scrape type for 1988443: 1
2026-03-27 16:51:09 [ayvens.fr] INFO: Extracting data for car ID: 1988443
2026-03-27 16:51:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 139b7647-31f3-533e-9069-647fec4d7ba5 with identifier: 1988443
2026-03-27 16:51:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 139b7647-31f3-533e-9069-647fec4d7ba5 with scrape type 1
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 139b7647-31f3-533e-9069-647fec4d7ba5
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F4ad5a9b892ba46ba9727b59b13c1d9e3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/1.jpg not downloaded yet
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F4ad5a9b892ba46ba9727b59b13c1d9e3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/2.jpg not downloaded yet
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e8d750>
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7604db86-1de9-5b41-9488-8cb50b571240/7604db86-1de9-5b41-9488-8cb50b571240_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F55531f46203d4e439c627e3e1a243596%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/5.jpg saved to cache
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7604db86-1de9-5b41-9488-8cb50b571240
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F4ad5a9b892ba46ba9727b59b13c1d9e3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/3.jpg not downloaded yet
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c0ed0>
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7604db86-1de9-5b41-9488-8cb50b571240/7604db86-1de9-5b41-9488-8cb50b571240_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F55531f46203d4e439c627e3e1a243596%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/6.jpg saved to cache
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7604db86-1de9-5b41-9488-8cb50b571240
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F4ad5a9b892ba46ba9727b59b13c1d9e3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/4.jpg not downloaded yet
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d5a3d0>
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7604db86-1de9-5b41-9488-8cb50b571240/7604db86-1de9-5b41-9488-8cb50b571240_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F55531f46203d4e439c627e3e1a243596%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/7.jpg saved to cache
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7604db86-1de9-5b41-9488-8cb50b571240
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b2a150>
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7604db86-1de9-5b41-9488-8cb50b571240/7604db86-1de9-5b41-9488-8cb50b571240_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F55531f46203d4e439c627e3e1a243596%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/8.jpg saved to cache
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7604db86-1de9-5b41-9488-8cb50b571240
2026-03-27 16:51:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7604db86-1de9-5b41-9488-8cb50b571240, skipping ID generation
2026-03-27 16:51:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7604db86-1de9-5b41-9488-8cb50b571240 with scrape type 1
2026-03-27 16:51:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7604db86-1de9-5b41-9488-8cb50b571240 sending to next pipeline
2026-03-27 16:51:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7604db86-1de9-5b41-9488-8cb50b571240, identifier: 1988441
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae3dd0>
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13599f4b-7aa3-5419-9f75-09f5355e6d21/13599f4b-7aa3-5419-9f75-09f5355e6d21_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F6629aa03855c4d60a8c3d45c4a61178e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/1.jpg saved to cache
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13599f4b-7aa3-5419-9f75-09f5355e6d21
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591052f90>
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13599f4b-7aa3-5419-9f75-09f5355e6d21/13599f4b-7aa3-5419-9f75-09f5355e6d21_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F6629aa03855c4d60a8c3d45c4a61178e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/2.jpg saved to cache
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13599f4b-7aa3-5419-9f75-09f5355e6d21
2026-03-27 16:51:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7604db86-1de9-5b41-9488-8cb50b571240 with identifier: 1988441
2026-03-27 16:51:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7604db86-1de9-5b41-9488-8cb50b571240 with identifier: 1988441
2026-03-27 16:51:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7604db86-1de9-5b41-9488-8cb50b571240 with identifier: 1988441 to the API
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '7604db86-1de9-5b41-9488-8cb50b571240',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'PUMA',
'odometer': 58573,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7604db86-1de9-5b41-9488-8cb50b571240/7604db86-1de9-5b41-9488-8cb50b571240_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307029,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7604db86-1de9-5b41-9488-8cb50b571240/7604db86-1de9-5b41-9488-8cb50b571240_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307029,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7604db86-1de9-5b41-9488-8cb50b571240/7604db86-1de9-5b41-9488-8cb50b571240_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7604db86-1de9-5b41-9488-8cb50b571240/7604db86-1de9-5b41-9488-8cb50b571240_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330482,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7604db86-1de9-5b41-9488-8cb50b571240/7604db86-1de9-5b41-9488-8cb50b571240_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407023,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7604db86-1de9-5b41-9488-8cb50b571240/7604db86-1de9-5b41-9488-8cb50b571240_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351492,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7604db86-1de9-5b41-9488-8cb50b571240/7604db86-1de9-5b41-9488-8cb50b571240_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332370,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7604db86-1de9-5b41-9488-8cb50b571240/7604db86-1de9-5b41-9488-8cb50b571240_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398657,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/55531f46203d4e439c627e3e1a243596/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'FORD PUMA Puma 1.0 EcoBoost 125ch S&S mHEV ST-Line Powershift',
'transmission': 'automatic',
'trim': 'Puma 1.0 EcoBoost 125ch S&S mHEV ST-Line Powershift',
'vin': None,
'year': 2022}
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988441%27 HTTP/1.1" 200 None
2026-03-27 16:51:10 [ayvens.fr] INFO: Saving data for 1988441: {'created_time': 1774630270.538193, 'last_price_update_time': 1774630270.538206, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988441') HTTP/1.1" 204 0
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F4ad5a9b892ba46ba9727b59b13c1d9e3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/5.jpg not downloaded yet
2026-03-27 16:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F4ad5a9b892ba46ba9727b59b13c1d9e3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/6.jpg not downloaded yet
2026-03-27 16:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F4ad5a9b892ba46ba9727b59b13c1d9e3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/7.jpg not downloaded yet
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F4ad5a9b892ba46ba9727b59b13c1d9e3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/8.jpg not downloaded yet
2026-03-27 16:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:10 [ayvens.fr] INFO: Found listing with ID: 1988444
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988444%27 HTTP/1.1" 200 None
2026-03-27 16:51:10 [ayvens.fr] INFO: Scrape type for 1988444: 1
2026-03-27 16:51:10 [ayvens.fr] INFO: Extracting data for car ID: 1988444
2026-03-27 16:51:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2705eba-277e-5c4d-b4c7-0aac122c72a3 with identifier: 1988444
2026-03-27 16:51:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2705eba-277e-5c4d-b4c7-0aac122c72a3 with scrape type 1
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d2705eba-277e-5c4d-b4c7-0aac122c72a3
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fa589c937b15f448aa323295bb77e876b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/1.jpg not downloaded yet
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fa589c937b15f448aa323295bb77e876b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/2.jpg not downloaded yet
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fa589c937b15f448aa323295bb77e876b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/3.jpg not downloaded yet
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fa589c937b15f448aa323295bb77e876b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/4.jpg not downloaded yet
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911ca790>
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13599f4b-7aa3-5419-9f75-09f5355e6d21/13599f4b-7aa3-5419-9f75-09f5355e6d21_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F6629aa03855c4d60a8c3d45c4a61178e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/7.jpg saved to cache
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13599f4b-7aa3-5419-9f75-09f5355e6d21
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c0310>
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13599f4b-7aa3-5419-9f75-09f5355e6d21/13599f4b-7aa3-5419-9f75-09f5355e6d21_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F6629aa03855c4d60a8c3d45c4a61178e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/3.jpg saved to cache
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13599f4b-7aa3-5419-9f75-09f5355e6d21
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592870d10>
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13599f4b-7aa3-5419-9f75-09f5355e6d21/13599f4b-7aa3-5419-9f75-09f5355e6d21_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F6629aa03855c4d60a8c3d45c4a61178e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/5.jpg saved to cache
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13599f4b-7aa3-5419-9f75-09f5355e6d21
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d81ad0>
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13599f4b-7aa3-5419-9f75-09f5355e6d21/13599f4b-7aa3-5419-9f75-09f5355e6d21_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F6629aa03855c4d60a8c3d45c4a61178e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/8.jpg saved to cache
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13599f4b-7aa3-5419-9f75-09f5355e6d21
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fa589c937b15f448aa323295bb77e876b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/5.jpg not downloaded yet
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee3bd0>
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13599f4b-7aa3-5419-9f75-09f5355e6d21/13599f4b-7aa3-5419-9f75-09f5355e6d21_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F6629aa03855c4d60a8c3d45c4a61178e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/6.jpg saved to cache
2026-03-27 16:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13599f4b-7aa3-5419-9f75-09f5355e6d21
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590591fd0>
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13599f4b-7aa3-5419-9f75-09f5355e6d21/13599f4b-7aa3-5419-9f75-09f5355e6d21_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F6629aa03855c4d60a8c3d45c4a61178e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/4.jpg saved to cache
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13599f4b-7aa3-5419-9f75-09f5355e6d21
2026-03-27 16:51:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13599f4b-7aa3-5419-9f75-09f5355e6d21, skipping ID generation
2026-03-27 16:51:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13599f4b-7aa3-5419-9f75-09f5355e6d21 with scrape type 1
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13599f4b-7aa3-5419-9f75-09f5355e6d21 sending to next pipeline
2026-03-27 16:51:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 13599f4b-7aa3-5419-9f75-09f5355e6d21, identifier: 1988442
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fa589c937b15f448aa323295bb77e876b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/6.jpg not downloaded yet
2026-03-27 16:51:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 13599f4b-7aa3-5419-9f75-09f5355e6d21 with identifier: 1988442
2026-03-27 16:51:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 13599f4b-7aa3-5419-9f75-09f5355e6d21 with identifier: 1988442
2026-03-27 16:51:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 13599f4b-7aa3-5419-9f75-09f5355e6d21 with identifier: 1988442 to the API
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 90,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '13599f4b-7aa3-5419-9f75-09f5355e6d21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FOCUS',
'odometer': 118918,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13599f4b-7aa3-5419-9f75-09f5355e6d21/13599f4b-7aa3-5419-9f75-09f5355e6d21_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428456,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13599f4b-7aa3-5419-9f75-09f5355e6d21/13599f4b-7aa3-5419-9f75-09f5355e6d21_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428456,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13599f4b-7aa3-5419-9f75-09f5355e6d21/13599f4b-7aa3-5419-9f75-09f5355e6d21_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461508,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13599f4b-7aa3-5419-9f75-09f5355e6d21/13599f4b-7aa3-5419-9f75-09f5355e6d21_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337867,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13599f4b-7aa3-5419-9f75-09f5355e6d21/13599f4b-7aa3-5419-9f75-09f5355e6d21_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330095,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13599f4b-7aa3-5419-9f75-09f5355e6d21/13599f4b-7aa3-5419-9f75-09f5355e6d21_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324701,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13599f4b-7aa3-5419-9f75-09f5355e6d21/13599f4b-7aa3-5419-9f75-09f5355e6d21_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286120,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13599f4b-7aa3-5419-9f75-09f5355e6d21/13599f4b-7aa3-5419-9f75-09f5355e6d21_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307664,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/6629aa03855c4d60a8c3d45c4a61178e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-23',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FOCUS Focus SW 1.5 EcoBlue 120ch Trend Business',
'transmission': 'manual',
'trim': 'Focus SW 1.5 EcoBlue 120ch Trend Business',
'vin': None,
'year': 2020}
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988442%27 HTTP/1.1" 200 None
2026-03-27 16:51:11 [ayvens.fr] INFO: Saving data for 1988442: {'created_time': 1774630271.498238, 'last_price_update_time': 1774630271.498257, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988442') HTTP/1.1" 204 0
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fa589c937b15f448aa323295bb77e876b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/7.jpg not downloaded yet
2026-03-27 16:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e50d0>
2026-03-27 16:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_139b7647-31f3-533e-9069-647fec4d7ba5/139b7647-31f3-533e-9069-647fec4d7ba5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F4ad5a9b892ba46ba9727b59b13c1d9e3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/1.jpg saved to cache
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 139b7647-31f3-533e-9069-647fec4d7ba5
2026-03-27 16:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904d7c50>
2026-03-27 16:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_139b7647-31f3-533e-9069-647fec4d7ba5/139b7647-31f3-533e-9069-647fec4d7ba5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F4ad5a9b892ba46ba9727b59b13c1d9e3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/2.jpg saved to cache
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 139b7647-31f3-533e-9069-647fec4d7ba5
2026-03-27 16:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fa589c937b15f448aa323295bb77e876b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/8.jpg not downloaded yet
2026-03-27 16:51:11 [ayvens.fr] INFO: Found listing with ID: 1988445
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988445%27 HTTP/1.1" 200 None
2026-03-27 16:51:11 [ayvens.fr] INFO: Scrape type for 1988445: 1
2026-03-27 16:51:11 [ayvens.fr] INFO: Extracting data for car ID: 1988445
2026-03-27 16:51:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d0ccb38-7bd7-5ee0-961a-816c970bd8dd with identifier: 1988445
2026-03-27 16:51:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d0ccb38-7bd7-5ee0-961a-816c970bd8dd with scrape type 1
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3d0ccb38-7bd7-5ee0-961a-816c970bd8dd
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9292a683b2f14fe99c082ee06d27ce05%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/1.jpg not downloaded yet
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9292a683b2f14fe99c082ee06d27ce05%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/2.jpg not downloaded yet
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9292a683b2f14fe99c082ee06d27ce05%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/3.jpg not downloaded yet
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9292a683b2f14fe99c082ee06d27ce05%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/4.jpg not downloaded yet
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9292a683b2f14fe99c082ee06d27ce05%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/5.jpg not downloaded yet
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9292a683b2f14fe99c082ee06d27ce05%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/6.jpg not downloaded yet
2026-03-27 16:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b377d0>
2026-03-27 16:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_139b7647-31f3-533e-9069-647fec4d7ba5/139b7647-31f3-533e-9069-647fec4d7ba5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F4ad5a9b892ba46ba9727b59b13c1d9e3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/3.jpg saved to cache
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 139b7647-31f3-533e-9069-647fec4d7ba5
2026-03-27 16:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3fd10>
2026-03-27 16:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_139b7647-31f3-533e-9069-647fec4d7ba5/139b7647-31f3-533e-9069-647fec4d7ba5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F4ad5a9b892ba46ba9727b59b13c1d9e3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/4.jpg saved to cache
2026-03-27 16:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 139b7647-31f3-533e-9069-647fec4d7ba5
2026-03-27 16:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9ed50>
2026-03-27 16:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_139b7647-31f3-533e-9069-647fec4d7ba5/139b7647-31f3-533e-9069-647fec4d7ba5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F4ad5a9b892ba46ba9727b59b13c1d9e3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/5.jpg saved to cache
2026-03-27 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 139b7647-31f3-533e-9069-647fec4d7ba5
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911ed750>
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_139b7647-31f3-533e-9069-647fec4d7ba5/139b7647-31f3-533e-9069-647fec4d7ba5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F4ad5a9b892ba46ba9727b59b13c1d9e3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/7.jpg saved to cache
2026-03-27 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 139b7647-31f3-533e-9069-647fec4d7ba5
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9d8d0>
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_139b7647-31f3-533e-9069-647fec4d7ba5/139b7647-31f3-533e-9069-647fec4d7ba5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F4ad5a9b892ba46ba9727b59b13c1d9e3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/8.jpg saved to cache
2026-03-27 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 139b7647-31f3-533e-9069-647fec4d7ba5
2026-03-27 16:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9292a683b2f14fe99c082ee06d27ce05%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/7.jpg not downloaded yet
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590657590>
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_139b7647-31f3-533e-9069-647fec4d7ba5/139b7647-31f3-533e-9069-647fec4d7ba5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F4ad5a9b892ba46ba9727b59b13c1d9e3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/6.jpg saved to cache
2026-03-27 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 139b7647-31f3-533e-9069-647fec4d7ba5
2026-03-27 16:51:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 139b7647-31f3-533e-9069-647fec4d7ba5, skipping ID generation
2026-03-27 16:51:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 139b7647-31f3-533e-9069-647fec4d7ba5 with scrape type 1
2026-03-27 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 139b7647-31f3-533e-9069-647fec4d7ba5 sending to next pipeline
2026-03-27 16:51:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 139b7647-31f3-533e-9069-647fec4d7ba5, identifier: 1988443
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590694150>
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2705eba-277e-5c4d-b4c7-0aac122c72a3/d2705eba-277e-5c4d-b4c7-0aac122c72a3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fa589c937b15f448aa323295bb77e876b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/1.jpg saved to cache
2026-03-27 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2705eba-277e-5c4d-b4c7-0aac122c72a3
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0d5d0>
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2705eba-277e-5c4d-b4c7-0aac122c72a3/d2705eba-277e-5c4d-b4c7-0aac122c72a3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fa589c937b15f448aa323295bb77e876b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/2.jpg saved to cache
2026-03-27 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2705eba-277e-5c4d-b4c7-0aac122c72a3
2026-03-27 16:51:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 139b7647-31f3-533e-9069-647fec4d7ba5 with identifier: 1988443
2026-03-27 16:51:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 139b7647-31f3-533e-9069-647fec4d7ba5 with identifier: 1988443
2026-03-27 16:51:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 139b7647-31f3-533e-9069-647fec4d7ba5 with identifier: 1988443 to the API
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'NOIR PERLA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '139b7647-31f3-533e-9069-647fec4d7ba5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 38407,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_139b7647-31f3-533e-9069-647fec4d7ba5/139b7647-31f3-533e-9069-647fec4d7ba5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 500154,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_139b7647-31f3-533e-9069-647fec4d7ba5/139b7647-31f3-533e-9069-647fec4d7ba5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 500154,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_139b7647-31f3-533e-9069-647fec4d7ba5/139b7647-31f3-533e-9069-647fec4d7ba5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420125,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_139b7647-31f3-533e-9069-647fec4d7ba5/139b7647-31f3-533e-9069-647fec4d7ba5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364702,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_139b7647-31f3-533e-9069-647fec4d7ba5/139b7647-31f3-533e-9069-647fec4d7ba5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285619,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_139b7647-31f3-533e-9069-647fec4d7ba5/139b7647-31f3-533e-9069-647fec4d7ba5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377092,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_139b7647-31f3-533e-9069-647fec4d7ba5/139b7647-31f3-533e-9069-647fec4d7ba5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271991,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_139b7647-31f3-533e-9069-647fec4d7ba5/139b7647-31f3-533e-9069-647fec4d7ba5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268949,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/4ad5a9b892ba46ba9727b59b13c1d9e3/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-08',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.2 PureTech 100ch S&S Active Business',
'transmission': 'manual',
'trim': '208 1.2 PureTech 100ch S&S Active Business',
'vin': None,
'year': 2020}
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988443%27 HTTP/1.1" 200 None
2026-03-27 16:51:12 [ayvens.fr] INFO: Saving data for 1988443: {'created_time': 1774630272.858112, 'last_price_update_time': 1774630272.858123, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988443') HTTP/1.1" 204 0
2026-03-27 16:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9292a683b2f14fe99c082ee06d27ce05%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/8.jpg not downloaded yet
2026-03-27 16:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59064c890>
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2705eba-277e-5c4d-b4c7-0aac122c72a3/d2705eba-277e-5c4d-b4c7-0aac122c72a3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fa589c937b15f448aa323295bb77e876b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/5.jpg saved to cache
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2705eba-277e-5c4d-b4c7-0aac122c72a3
2026-03-27 16:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:13 [ayvens.fr] INFO: Found listing with ID: 1988446
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988446%27 HTTP/1.1" 200 None
2026-03-27 16:51:13 [ayvens.fr] INFO: Scrape type for 1988446: 1
2026-03-27 16:51:13 [ayvens.fr] INFO: Extracting data for car ID: 1988446
2026-03-27 16:51:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a with identifier: 1988446
2026-03-27 16:51:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a with scrape type 1
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7b41412cac6e4636ace4636d5b807c64%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/1.jpg not downloaded yet
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7b41412cac6e4636ace4636d5b807c64%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/2.jpg not downloaded yet
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590621610>
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2705eba-277e-5c4d-b4c7-0aac122c72a3/d2705eba-277e-5c4d-b4c7-0aac122c72a3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fa589c937b15f448aa323295bb77e876b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/4.jpg saved to cache
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2705eba-277e-5c4d-b4c7-0aac122c72a3
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905119d0>
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2705eba-277e-5c4d-b4c7-0aac122c72a3/d2705eba-277e-5c4d-b4c7-0aac122c72a3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fa589c937b15f448aa323295bb77e876b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/7.jpg saved to cache
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2705eba-277e-5c4d-b4c7-0aac122c72a3
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f60f90>
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2705eba-277e-5c4d-b4c7-0aac122c72a3/d2705eba-277e-5c4d-b4c7-0aac122c72a3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fa589c937b15f448aa323295bb77e876b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/6.jpg saved to cache
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2705eba-277e-5c4d-b4c7-0aac122c72a3
2026-03-27 16:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7b41412cac6e4636ace4636d5b807c64%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/3.jpg not downloaded yet
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a9250>
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2705eba-277e-5c4d-b4c7-0aac122c72a3/d2705eba-277e-5c4d-b4c7-0aac122c72a3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fa589c937b15f448aa323295bb77e876b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/3.jpg saved to cache
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2705eba-277e-5c4d-b4c7-0aac122c72a3
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2f990>
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2705eba-277e-5c4d-b4c7-0aac122c72a3/d2705eba-277e-5c4d-b4c7-0aac122c72a3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fa589c937b15f448aa323295bb77e876b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/8.jpg saved to cache
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2705eba-277e-5c4d-b4c7-0aac122c72a3
2026-03-27 16:51:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2705eba-277e-5c4d-b4c7-0aac122c72a3, skipping ID generation
2026-03-27 16:51:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2705eba-277e-5c4d-b4c7-0aac122c72a3 with scrape type 1
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2705eba-277e-5c4d-b4c7-0aac122c72a3 sending to next pipeline
2026-03-27 16:51:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d2705eba-277e-5c4d-b4c7-0aac122c72a3, identifier: 1988444
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d1150>
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d0ccb38-7bd7-5ee0-961a-816c970bd8dd/3d0ccb38-7bd7-5ee0-961a-816c970bd8dd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9292a683b2f14fe99c082ee06d27ce05%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/1.jpg saved to cache
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d0ccb38-7bd7-5ee0-961a-816c970bd8dd
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa2990>
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d0ccb38-7bd7-5ee0-961a-816c970bd8dd/3d0ccb38-7bd7-5ee0-961a-816c970bd8dd_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9292a683b2f14fe99c082ee06d27ce05%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/2.jpg saved to cache
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3d0ccb38-7bd7-5ee0-961a-816c970bd8dd
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7b41412cac6e4636ace4636d5b807c64%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/4.jpg not downloaded yet
2026-03-27 16:51:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d2705eba-277e-5c4d-b4c7-0aac122c72a3 with identifier: 1988444
2026-03-27 16:51:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d2705eba-277e-5c4d-b4c7-0aac122c72a3 with identifier: 1988444
2026-03-27 16:51:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d2705eba-277e-5c4d-b4c7-0aac122c72a3 with identifier: 1988444 to the API
2026-03-27 16:51:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'd2705eba-277e-5c4d-b4c7-0aac122c72a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308',
'odometer': 67298,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2705eba-277e-5c4d-b4c7-0aac122c72a3/d2705eba-277e-5c4d-b4c7-0aac122c72a3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380905,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2705eba-277e-5c4d-b4c7-0aac122c72a3/d2705eba-277e-5c4d-b4c7-0aac122c72a3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380905,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2705eba-277e-5c4d-b4c7-0aac122c72a3/d2705eba-277e-5c4d-b4c7-0aac122c72a3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352082,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2705eba-277e-5c4d-b4c7-0aac122c72a3/d2705eba-277e-5c4d-b4c7-0aac122c72a3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233472,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2705eba-277e-5c4d-b4c7-0aac122c72a3/d2705eba-277e-5c4d-b4c7-0aac122c72a3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281969,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2705eba-277e-5c4d-b4c7-0aac122c72a3/d2705eba-277e-5c4d-b4c7-0aac122c72a3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297010,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2705eba-277e-5c4d-b4c7-0aac122c72a3/d2705eba-277e-5c4d-b4c7-0aac122c72a3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186826,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2705eba-277e-5c4d-b4c7-0aac122c72a3/d2705eba-277e-5c4d-b4c7-0aac122c72a3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285569,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/a589c937b15f448aa323295bb77e876b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-10',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 308 1.5 BlueHDi 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '308 1.5 BlueHDi 130ch S&S Active Business EAT8',
'vin': None,
'year': 2020}
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988444%27 HTTP/1.1" 200 None
2026-03-27 16:51:14 [ayvens.fr] INFO: Saving data for 1988444: {'created_time': 1774630274.219447, 'last_price_update_time': 1774630274.219457, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988444') HTTP/1.1" 204 0
2026-03-27 16:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7b41412cac6e4636ace4636d5b807c64%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/5.jpg not downloaded yet
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911cb090>
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d0ccb38-7bd7-5ee0-961a-816c970bd8dd/3d0ccb38-7bd7-5ee0-961a-816c970bd8dd_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9292a683b2f14fe99c082ee06d27ce05%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/3.jpg saved to cache
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3d0ccb38-7bd7-5ee0-961a-816c970bd8dd
2026-03-27 16:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7b41412cac6e4636ace4636d5b807c64%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/6.jpg not downloaded yet
2026-03-27 16:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7b41412cac6e4636ace4636d5b807c64%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/7.jpg not downloaded yet
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7b41412cac6e4636ace4636d5b807c64%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/8.jpg not downloaded yet
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050cb90>
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d0ccb38-7bd7-5ee0-961a-816c970bd8dd/3d0ccb38-7bd7-5ee0-961a-816c970bd8dd_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9292a683b2f14fe99c082ee06d27ce05%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/5.jpg saved to cache
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3d0ccb38-7bd7-5ee0-961a-816c970bd8dd
2026-03-27 16:51:14 [ayvens.fr] INFO: Found listing with ID: 1988447
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988447%27 HTTP/1.1" 200 None
2026-03-27 16:51:14 [ayvens.fr] INFO: Scrape type for 1988447: 1
2026-03-27 16:51:14 [ayvens.fr] INFO: Extracting data for car ID: 1988447
2026-03-27 16:51:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d with identifier: 1988447
2026-03-27 16:51:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d with scrape type 1
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff262608b7fdc4299bb000af5fd74ebda%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/1.jpg not downloaded yet
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff262608b7fdc4299bb000af5fd74ebda%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/2.jpg not downloaded yet
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6c110>
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d0ccb38-7bd7-5ee0-961a-816c970bd8dd/3d0ccb38-7bd7-5ee0-961a-816c970bd8dd_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9292a683b2f14fe99c082ee06d27ce05%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/4.jpg saved to cache
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3d0ccb38-7bd7-5ee0-961a-816c970bd8dd
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911b83d0>
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d0ccb38-7bd7-5ee0-961a-816c970bd8dd/3d0ccb38-7bd7-5ee0-961a-816c970bd8dd_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9292a683b2f14fe99c082ee06d27ce05%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/6.jpg saved to cache
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3d0ccb38-7bd7-5ee0-961a-816c970bd8dd
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0dc50>
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d0ccb38-7bd7-5ee0-961a-816c970bd8dd/3d0ccb38-7bd7-5ee0-961a-816c970bd8dd_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9292a683b2f14fe99c082ee06d27ce05%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/7.jpg saved to cache
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3d0ccb38-7bd7-5ee0-961a-816c970bd8dd
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7fa10>
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d0ccb38-7bd7-5ee0-961a-816c970bd8dd/3d0ccb38-7bd7-5ee0-961a-816c970bd8dd_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9292a683b2f14fe99c082ee06d27ce05%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/8.jpg saved to cache
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3d0ccb38-7bd7-5ee0-961a-816c970bd8dd
2026-03-27 16:51:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d0ccb38-7bd7-5ee0-961a-816c970bd8dd, skipping ID generation
2026-03-27 16:51:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d0ccb38-7bd7-5ee0-961a-816c970bd8dd with scrape type 1
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d0ccb38-7bd7-5ee0-961a-816c970bd8dd sending to next pipeline
2026-03-27 16:51:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3d0ccb38-7bd7-5ee0-961a-816c970bd8dd, identifier: 1988445
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592ca7950>
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a/fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7b41412cac6e4636ace4636d5b807c64%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/1.jpg saved to cache
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff262608b7fdc4299bb000af5fd74ebda%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/3.jpg not downloaded yet
2026-03-27 16:51:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3d0ccb38-7bd7-5ee0-961a-816c970bd8dd with identifier: 1988445
2026-03-27 16:51:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3d0ccb38-7bd7-5ee0-961a-816c970bd8dd with identifier: 1988445
2026-03-27 16:51:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3d0ccb38-7bd7-5ee0-961a-816c970bd8dd with identifier: 1988445 to the API
2026-03-27 16:51:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '3d0ccb38-7bd7-5ee0-961a-816c970bd8dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 109136,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d0ccb38-7bd7-5ee0-961a-816c970bd8dd/3d0ccb38-7bd7-5ee0-961a-816c970bd8dd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304441,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d0ccb38-7bd7-5ee0-961a-816c970bd8dd/3d0ccb38-7bd7-5ee0-961a-816c970bd8dd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304441,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d0ccb38-7bd7-5ee0-961a-816c970bd8dd/3d0ccb38-7bd7-5ee0-961a-816c970bd8dd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346113,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d0ccb38-7bd7-5ee0-961a-816c970bd8dd/3d0ccb38-7bd7-5ee0-961a-816c970bd8dd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362017,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d0ccb38-7bd7-5ee0-961a-816c970bd8dd/3d0ccb38-7bd7-5ee0-961a-816c970bd8dd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318544,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d0ccb38-7bd7-5ee0-961a-816c970bd8dd/3d0ccb38-7bd7-5ee0-961a-816c970bd8dd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333915,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d0ccb38-7bd7-5ee0-961a-816c970bd8dd/3d0ccb38-7bd7-5ee0-961a-816c970bd8dd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293466,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d0ccb38-7bd7-5ee0-961a-816c970bd8dd/3d0ccb38-7bd7-5ee0-961a-816c970bd8dd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331054,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9292a683b2f14fe99c082ee06d27ce05/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-23',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE Megane Estate 1.5 Blue dCi 115ch Business',
'transmission': 'manual',
'trim': 'Megane Estate 1.5 Blue dCi 115ch Business',
'vin': None,
'year': 2020}
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988445%27 HTTP/1.1" 200 None
2026-03-27 16:51:15 [ayvens.fr] INFO: Saving data for 1988445: {'created_time': 1774630275.443935, 'last_price_update_time': 1774630275.443945, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988445') HTTP/1.1" 204 0
2026-03-27 16:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff262608b7fdc4299bb000af5fd74ebda%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/4.jpg not downloaded yet
2026-03-27 16:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff262608b7fdc4299bb000af5fd74ebda%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/5.jpg not downloaded yet
2026-03-27 16:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff262608b7fdc4299bb000af5fd74ebda%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/6.jpg not downloaded yet
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff262608b7fdc4299bb000af5fd74ebda%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/7.jpg not downloaded yet
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff262608b7fdc4299bb000af5fd74ebda%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/8.jpg not downloaded yet
2026-03-27 16:51:15 [ayvens.fr] INFO: Found listing with ID: 1988448
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988448%27 HTTP/1.1" 200 None
2026-03-27 16:51:15 [ayvens.fr] INFO: Scrape type for 1988448: 1
2026-03-27 16:51:15 [ayvens.fr] INFO: Extracting data for car ID: 1988448
2026-03-27 16:51:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb9f34f9-845b-5cc2-abe4-c7ea13179749 with identifier: 1988448
2026-03-27 16:51:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb9f34f9-845b-5cc2-abe4-c7ea13179749 with scrape type 1
2026-03-27 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item fb9f34f9-845b-5cc2-abe4-c7ea13179749
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F288f667fcfe54c04bc6c2fba29746b11%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/1.jpg not downloaded yet
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F288f667fcfe54c04bc6c2fba29746b11%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/2.jpg not downloaded yet
2026-03-27 16:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911b99d0>
2026-03-27 16:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a/fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7b41412cac6e4636ace4636d5b807c64%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/3.jpg saved to cache
2026-03-27 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F288f667fcfe54c04bc6c2fba29746b11%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/3.jpg not downloaded yet
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F288f667fcfe54c04bc6c2fba29746b11%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/4.jpg not downloaded yet
2026-03-27 16:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b68d10>
2026-03-27 16:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a/fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7b41412cac6e4636ace4636d5b807c64%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/6.jpg saved to cache
2026-03-27 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a
2026-03-27 16:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0ccd0>
2026-03-27 16:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a/fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7b41412cac6e4636ace4636d5b807c64%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/8.jpg saved to cache
2026-03-27 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a
2026-03-27 16:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ac72d0>
2026-03-27 16:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a/fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7b41412cac6e4636ace4636d5b807c64%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/2.jpg saved to cache
2026-03-27 16:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a
2026-03-27 16:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df4ad0>
2026-03-27 16:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a/fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7b41412cac6e4636ace4636d5b807c64%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/5.jpg saved to cache
2026-03-27 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dace10>
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a/fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7b41412cac6e4636ace4636d5b807c64%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/7.jpg saved to cache
2026-03-27 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b6a6d0>
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a/fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F7b41412cac6e4636ace4636d5b807c64%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/4.jpg saved to cache
2026-03-27 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a
2026-03-27 16:51:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a, skipping ID generation
2026-03-27 16:51:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a with scrape type 1
2026-03-27 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a sending to next pipeline
2026-03-27 16:51:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a, identifier: 1988446
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d63810>
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d/7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff262608b7fdc4299bb000af5fd74ebda%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/1.jpg saved to cache
2026-03-27 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d
2026-03-27 16:51:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a with identifier: 1988446
2026-03-27 16:51:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a with identifier: 1988446
2026-03-27 16:51:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a with identifier: 1988446 to the API
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 35,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'Q5',
'odometer': 49981,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a/fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336553,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a/fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336553,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a/fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367982,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a/fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353075,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a/fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319796,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a/fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314077,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a/fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304654,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a/fd2c46e9-3dfa-5a63-bcbc-71d4444eea7a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 224406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/7b41412cac6e4636ace4636d5b807c64/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-22',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI Q5 Q5 50 TFSI e 299ch Business Executive quattro S tronic 7',
'transmission': 'automatic',
'trim': 'Q5 50 TFSI e 299ch Business Executive quattro S tronic 7',
'vin': None,
'year': 2024}
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988446%27 HTTP/1.1" 200 None
2026-03-27 16:51:16 [ayvens.fr] INFO: Saving data for 1988446: {'created_time': 1774630276.736591, 'last_price_update_time': 1774630276.736603, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988446') HTTP/1.1" 204 0
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F288f667fcfe54c04bc6c2fba29746b11%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/5.jpg not downloaded yet
2026-03-27 16:51:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F288f667fcfe54c04bc6c2fba29746b11%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/6.jpg not downloaded yet
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590590a50>
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d/7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff262608b7fdc4299bb000af5fd74ebda%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/2.jpg saved to cache
2026-03-27 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d
2026-03-27 16:51:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F288f667fcfe54c04bc6c2fba29746b11%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/7.jpg not downloaded yet
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F288f667fcfe54c04bc6c2fba29746b11%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/8.jpg not downloaded yet
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee11d0>
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d/7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff262608b7fdc4299bb000af5fd74ebda%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/4.jpg saved to cache
2026-03-27 16:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c3150>
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d/7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff262608b7fdc4299bb000af5fd74ebda%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/6.jpg saved to cache
2026-03-27 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d
2026-03-27 16:51:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dff810>
2026-03-27 16:51:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d/7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff262608b7fdc4299bb000af5fd74ebda%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/7.jpg saved to cache
2026-03-27 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d
2026-03-27 16:51:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c1110>
2026-03-27 16:51:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d/7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff262608b7fdc4299bb000af5fd74ebda%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/8.jpg saved to cache
2026-03-27 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d
2026-03-27 16:51:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59308cb50>
2026-03-27 16:51:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d/7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff262608b7fdc4299bb000af5fd74ebda%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/3.jpg saved to cache
2026-03-27 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d
2026-03-27 16:51:17 [ayvens.fr] INFO: Found listing with ID: 1988449
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988449%27 HTTP/1.1" 200 None
2026-03-27 16:51:17 [ayvens.fr] INFO: Scrape type for 1988449: 1
2026-03-27 16:51:17 [ayvens.fr] INFO: Extracting data for car ID: 1988449
2026-03-27 16:51:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3460164-d915-50bc-ae08-24359fa68cbb with identifier: 1988449
2026-03-27 16:51:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3460164-d915-50bc-ae08-24359fa68cbb with scrape type 1
2026-03-27 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d3460164-d915-50bc-ae08-24359fa68cbb
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F27b0d1efe5f0488fafa8326faaa581a5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/1.jpg not downloaded yet
2026-03-27 16:51:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e8fb50>
2026-03-27 16:51:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d/7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff262608b7fdc4299bb000af5fd74ebda%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/5.jpg saved to cache
2026-03-27 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d
2026-03-27 16:51:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d, skipping ID generation
2026-03-27 16:51:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d with scrape type 1
2026-03-27 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d sending to next pipeline
2026-03-27 16:51:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d, identifier: 1988447
2026-03-27 16:51:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae1dd0>
2026-03-27 16:51:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb9f34f9-845b-5cc2-abe4-c7ea13179749/fb9f34f9-845b-5cc2-abe4-c7ea13179749_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F288f667fcfe54c04bc6c2fba29746b11%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/1.jpg saved to cache
2026-03-27 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb9f34f9-845b-5cc2-abe4-c7ea13179749
2026-03-27 16:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F27b0d1efe5f0488fafa8326faaa581a5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/2.jpg not downloaded yet
2026-03-27 16:51:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d with identifier: 1988447
2026-03-27 16:51:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d with identifier: 1988447
2026-03-27 16:51:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d with identifier: 1988447 to the API
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 62915,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d/7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304134,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d/7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304134,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d/7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341749,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d/7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353548,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d/7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358414,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d/7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 278874,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d/7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279879,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d/7a3e4b3a-3e34-5a08-ae2f-e12d43b8c64d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236970,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f262608b7fdc4299bb000af5fd74ebda/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-23',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN QASHQAI Qashqai e-POWER 190ch Business Edition',
'transmission': 'automatic',
'trim': 'Qashqai e-POWER 190ch Business Edition',
'vin': None,
'year': 2023}
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988447%27 HTTP/1.1" 200 None
2026-03-27 16:51:18 [ayvens.fr] INFO: Saving data for 1988447: {'created_time': 1774630278.074167, 'last_price_update_time': 1774630278.074178, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988447') HTTP/1.1" 204 0
2026-03-27 16:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F27b0d1efe5f0488fafa8326faaa581a5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/3.jpg not downloaded yet
2026-03-27 16:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4c350>
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb9f34f9-845b-5cc2-abe4-c7ea13179749/fb9f34f9-845b-5cc2-abe4-c7ea13179749_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F288f667fcfe54c04bc6c2fba29746b11%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/4.jpg saved to cache
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb9f34f9-845b-5cc2-abe4-c7ea13179749
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F27b0d1efe5f0488fafa8326faaa581a5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/4.jpg not downloaded yet
2026-03-27 16:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F27b0d1efe5f0488fafa8326faaa581a5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/5.jpg not downloaded yet
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b18e50>
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb9f34f9-845b-5cc2-abe4-c7ea13179749/fb9f34f9-845b-5cc2-abe4-c7ea13179749_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F288f667fcfe54c04bc6c2fba29746b11%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/2.jpg saved to cache
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb9f34f9-845b-5cc2-abe4-c7ea13179749
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F27b0d1efe5f0488fafa8326faaa581a5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/6.jpg not downloaded yet
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59103f790>
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb9f34f9-845b-5cc2-abe4-c7ea13179749/fb9f34f9-845b-5cc2-abe4-c7ea13179749_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F288f667fcfe54c04bc6c2fba29746b11%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/3.jpg saved to cache
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb9f34f9-845b-5cc2-abe4-c7ea13179749
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d0890>
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb9f34f9-845b-5cc2-abe4-c7ea13179749/fb9f34f9-845b-5cc2-abe4-c7ea13179749_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F288f667fcfe54c04bc6c2fba29746b11%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/6.jpg saved to cache
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb9f34f9-845b-5cc2-abe4-c7ea13179749
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F27b0d1efe5f0488fafa8326faaa581a5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/7.jpg not downloaded yet
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911cae90>
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb9f34f9-845b-5cc2-abe4-c7ea13179749/fb9f34f9-845b-5cc2-abe4-c7ea13179749_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F288f667fcfe54c04bc6c2fba29746b11%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/5.jpg saved to cache
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb9f34f9-845b-5cc2-abe4-c7ea13179749
2026-03-27 16:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F27b0d1efe5f0488fafa8326faaa581a5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/8.jpg not downloaded yet
2026-03-27 16:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590af19d0>
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb9f34f9-845b-5cc2-abe4-c7ea13179749/fb9f34f9-845b-5cc2-abe4-c7ea13179749_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F288f667fcfe54c04bc6c2fba29746b11%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/7.jpg saved to cache
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb9f34f9-845b-5cc2-abe4-c7ea13179749
2026-03-27 16:51:18 [ayvens.fr] INFO: Found listing with ID: 1988450
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988450%27 HTTP/1.1" 200 None
2026-03-27 16:51:18 [ayvens.fr] INFO: Scrape type for 1988450: 1
2026-03-27 16:51:18 [ayvens.fr] INFO: Extracting data for car ID: 1988450
2026-03-27 16:51:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9be3d332-adbb-5f0e-ad4f-3daecc9aac5e with identifier: 1988450
2026-03-27 16:51:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9be3d332-adbb-5f0e-ad4f-3daecc9aac5e with scrape type 1
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 9be3d332-adbb-5f0e-ad4f-3daecc9aac5e
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F74164c7352c642b894f7348eccb784bb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/1.jpg not downloaded yet
2026-03-27 16:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F74164c7352c642b894f7348eccb784bb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/2.jpg not downloaded yet
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efd8d0>
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb9f34f9-845b-5cc2-abe4-c7ea13179749/fb9f34f9-845b-5cc2-abe4-c7ea13179749_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F288f667fcfe54c04bc6c2fba29746b11%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/8.jpg saved to cache
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb9f34f9-845b-5cc2-abe4-c7ea13179749
2026-03-27 16:51:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb9f34f9-845b-5cc2-abe4-c7ea13179749, skipping ID generation
2026-03-27 16:51:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb9f34f9-845b-5cc2-abe4-c7ea13179749 with scrape type 1
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb9f34f9-845b-5cc2-abe4-c7ea13179749 sending to next pipeline
2026-03-27 16:51:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: fb9f34f9-845b-5cc2-abe4-c7ea13179749, identifier: 1988448
2026-03-27 16:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F74164c7352c642b894f7348eccb784bb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/3.jpg not downloaded yet
2026-03-27 16:51:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: fb9f34f9-845b-5cc2-abe4-c7ea13179749 with identifier: 1988448
2026-03-27 16:51:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: fb9f34f9-845b-5cc2-abe4-c7ea13179749 with identifier: 1988448
2026-03-27 16:51:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: fb9f34f9-845b-5cc2-abe4-c7ea13179749 with identifier: 1988448 to the API
2026-03-27 16:51:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': 'MINERALWEISS M',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'fb9f34f9-845b-5cc2-abe4-c7ea13179749',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 1',
'odometer': 55956,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb9f34f9-845b-5cc2-abe4-c7ea13179749/fb9f34f9-845b-5cc2-abe4-c7ea13179749_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317430,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb9f34f9-845b-5cc2-abe4-c7ea13179749/fb9f34f9-845b-5cc2-abe4-c7ea13179749_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317430,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb9f34f9-845b-5cc2-abe4-c7ea13179749/fb9f34f9-845b-5cc2-abe4-c7ea13179749_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338530,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb9f34f9-845b-5cc2-abe4-c7ea13179749/fb9f34f9-845b-5cc2-abe4-c7ea13179749_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277251,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb9f34f9-845b-5cc2-abe4-c7ea13179749/fb9f34f9-845b-5cc2-abe4-c7ea13179749_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336799,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb9f34f9-845b-5cc2-abe4-c7ea13179749/fb9f34f9-845b-5cc2-abe4-c7ea13179749_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273651,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb9f34f9-845b-5cc2-abe4-c7ea13179749/fb9f34f9-845b-5cc2-abe4-c7ea13179749_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281095,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb9f34f9-845b-5cc2-abe4-c7ea13179749/fb9f34f9-845b-5cc2-abe4-c7ea13179749_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321882,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/288f667fcfe54c04bc6c2fba29746b11/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-14',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 1 Serie 1 118iA 136ch Edition Sport DKG7',
'transmission': 'automatic',
'trim': 'Serie 1 118iA 136ch Edition Sport DKG7',
'vin': None,
'year': 2023}
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988448%27 HTTP/1.1" 200 None
2026-03-27 16:51:19 [ayvens.fr] INFO: Saving data for 1988448: {'created_time': 1774630279.150934, 'last_price_update_time': 1774630279.150944, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988448') HTTP/1.1" 204 0
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6ff50>
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3460164-d915-50bc-ae08-24359fa68cbb/d3460164-d915-50bc-ae08-24359fa68cbb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F27b0d1efe5f0488fafa8326faaa581a5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/1.jpg saved to cache
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3460164-d915-50bc-ae08-24359fa68cbb
2026-03-27 16:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F74164c7352c642b894f7348eccb784bb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/4.jpg not downloaded yet
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe0c10>
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3460164-d915-50bc-ae08-24359fa68cbb/d3460164-d915-50bc-ae08-24359fa68cbb_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F27b0d1efe5f0488fafa8326faaa581a5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/3.jpg saved to cache
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3460164-d915-50bc-ae08-24359fa68cbb
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590675490>
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3460164-d915-50bc-ae08-24359fa68cbb/d3460164-d915-50bc-ae08-24359fa68cbb_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F27b0d1efe5f0488fafa8326faaa581a5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/2.jpg saved to cache
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3460164-d915-50bc-ae08-24359fa68cbb
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a8110>
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3460164-d915-50bc-ae08-24359fa68cbb/d3460164-d915-50bc-ae08-24359fa68cbb_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F27b0d1efe5f0488fafa8326faaa581a5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/4.jpg saved to cache
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3460164-d915-50bc-ae08-24359fa68cbb
2026-03-27 16:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F74164c7352c642b894f7348eccb784bb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/5.jpg not downloaded yet
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F74164c7352c642b894f7348eccb784bb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/6.jpg not downloaded yet
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590654910>
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3460164-d915-50bc-ae08-24359fa68cbb/d3460164-d915-50bc-ae08-24359fa68cbb_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F27b0d1efe5f0488fafa8326faaa581a5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/6.jpg saved to cache
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3460164-d915-50bc-ae08-24359fa68cbb
2026-03-27 16:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F74164c7352c642b894f7348eccb784bb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/7.jpg not downloaded yet
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910d8ed0>
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3460164-d915-50bc-ae08-24359fa68cbb/d3460164-d915-50bc-ae08-24359fa68cbb_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F27b0d1efe5f0488fafa8326faaa581a5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/5.jpg saved to cache
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3460164-d915-50bc-ae08-24359fa68cbb
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59063ee90>
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3460164-d915-50bc-ae08-24359fa68cbb/d3460164-d915-50bc-ae08-24359fa68cbb_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F27b0d1efe5f0488fafa8326faaa581a5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/7.jpg saved to cache
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3460164-d915-50bc-ae08-24359fa68cbb
2026-03-27 16:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F74164c7352c642b894f7348eccb784bb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/8.jpg not downloaded yet
2026-03-27 16:51:19 [ayvens.fr] INFO: Found listing with ID: 1988451
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988451%27 HTTP/1.1" 200 None
2026-03-27 16:51:19 [ayvens.fr] INFO: Scrape type for 1988451: 1
2026-03-27 16:51:19 [ayvens.fr] INFO: Extracting data for car ID: 1988451
2026-03-27 16:51:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 410e3c51-cb7d-591a-b61b-4f7b5a07a12a with identifier: 1988451
2026-03-27 16:51:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 410e3c51-cb7d-591a-b61b-4f7b5a07a12a with scrape type 1
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 410e3c51-cb7d-591a-b61b-4f7b5a07a12a
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfba5d87f15847e7ad656c66104225bd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/1.jpg not downloaded yet
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0b490>
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be3d332-adbb-5f0e-ad4f-3daecc9aac5e/9be3d332-adbb-5f0e-ad4f-3daecc9aac5e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F74164c7352c642b894f7348eccb784bb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/1.jpg saved to cache
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9be3d332-adbb-5f0e-ad4f-3daecc9aac5e
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e7350>
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3460164-d915-50bc-ae08-24359fa68cbb/d3460164-d915-50bc-ae08-24359fa68cbb_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F27b0d1efe5f0488fafa8326faaa581a5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/8.jpg saved to cache
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3460164-d915-50bc-ae08-24359fa68cbb
2026-03-27 16:51:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3460164-d915-50bc-ae08-24359fa68cbb, skipping ID generation
2026-03-27 16:51:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3460164-d915-50bc-ae08-24359fa68cbb with scrape type 1
2026-03-27 16:51:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3460164-d915-50bc-ae08-24359fa68cbb sending to next pipeline
2026-03-27 16:51:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d3460164-d915-50bc-ae08-24359fa68cbb, identifier: 1988449
2026-03-27 16:51:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d3460164-d915-50bc-ae08-24359fa68cbb with identifier: 1988449
2026-03-27 16:51:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d3460164-d915-50bc-ae08-24359fa68cbb with identifier: 1988449
2026-03-27 16:51:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d3460164-d915-50bc-ae08-24359fa68cbb with identifier: 1988449 to the API
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 146,
'color': 'BLANC NACR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'd3460164-d915-50bc-ae08-24359fa68cbb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 136895,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3460164-d915-50bc-ae08-24359fa68cbb/d3460164-d915-50bc-ae08-24359fa68cbb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348543,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3460164-d915-50bc-ae08-24359fa68cbb/d3460164-d915-50bc-ae08-24359fa68cbb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348543,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3460164-d915-50bc-ae08-24359fa68cbb/d3460164-d915-50bc-ae08-24359fa68cbb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346839,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3460164-d915-50bc-ae08-24359fa68cbb/d3460164-d915-50bc-ae08-24359fa68cbb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330485,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3460164-d915-50bc-ae08-24359fa68cbb/d3460164-d915-50bc-ae08-24359fa68cbb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336629,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3460164-d915-50bc-ae08-24359fa68cbb/d3460164-d915-50bc-ae08-24359fa68cbb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287846,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3460164-d915-50bc-ae08-24359fa68cbb/d3460164-d915-50bc-ae08-24359fa68cbb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217673,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3460164-d915-50bc-ae08-24359fa68cbb/d3460164-d915-50bc-ae08-24359fa68cbb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433162,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/27b0d1efe5f0488fafa8326faaa581a5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-19',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch S&S Allure EAT8',
'transmission': 'automatic',
'trim': '3008 1.2 PureTech 130ch S&S Allure EAT8',
'vin': None,
'year': 2022}
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988449%27 HTTP/1.1" 200 None
2026-03-27 16:51:20 [ayvens.fr] INFO: Saving data for 1988449: {'created_time': 1774630280.431693, 'last_price_update_time': 1774630280.431722, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988449') HTTP/1.1" 204 0
2026-03-27 16:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfba5d87f15847e7ad656c66104225bd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/2.jpg not downloaded yet
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0d410>
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be3d332-adbb-5f0e-ad4f-3daecc9aac5e/9be3d332-adbb-5f0e-ad4f-3daecc9aac5e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F74164c7352c642b894f7348eccb784bb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/2.jpg saved to cache
2026-03-27 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9be3d332-adbb-5f0e-ad4f-3daecc9aac5e
2026-03-27 16:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfba5d87f15847e7ad656c66104225bd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/3.jpg not downloaded yet
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfba5d87f15847e7ad656c66104225bd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/4.jpg not downloaded yet
2026-03-27 16:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfba5d87f15847e7ad656c66104225bd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/5.jpg not downloaded yet
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfba5d87f15847e7ad656c66104225bd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/6.jpg not downloaded yet
2026-03-27 16:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59063e590>
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be3d332-adbb-5f0e-ad4f-3daecc9aac5e/9be3d332-adbb-5f0e-ad4f-3daecc9aac5e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F74164c7352c642b894f7348eccb784bb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/3.jpg saved to cache
2026-03-27 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9be3d332-adbb-5f0e-ad4f-3daecc9aac5e
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2e3d0>
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be3d332-adbb-5f0e-ad4f-3daecc9aac5e/9be3d332-adbb-5f0e-ad4f-3daecc9aac5e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F74164c7352c642b894f7348eccb784bb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/4.jpg saved to cache
2026-03-27 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9be3d332-adbb-5f0e-ad4f-3daecc9aac5e
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfba5d87f15847e7ad656c66104225bd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/7.jpg not downloaded yet
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfba5d87f15847e7ad656c66104225bd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/8.jpg not downloaded yet
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911cb6d0>
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be3d332-adbb-5f0e-ad4f-3daecc9aac5e/9be3d332-adbb-5f0e-ad4f-3daecc9aac5e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F74164c7352c642b894f7348eccb784bb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/5.jpg saved to cache
2026-03-27 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9be3d332-adbb-5f0e-ad4f-3daecc9aac5e
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910ed990>
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be3d332-adbb-5f0e-ad4f-3daecc9aac5e/9be3d332-adbb-5f0e-ad4f-3daecc9aac5e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F74164c7352c642b894f7348eccb784bb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/7.jpg saved to cache
2026-03-27 16:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9be3d332-adbb-5f0e-ad4f-3daecc9aac5e
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de5d50>
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be3d332-adbb-5f0e-ad4f-3daecc9aac5e/9be3d332-adbb-5f0e-ad4f-3daecc9aac5e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F74164c7352c642b894f7348eccb784bb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/6.jpg saved to cache
2026-03-27 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9be3d332-adbb-5f0e-ad4f-3daecc9aac5e
2026-03-27 16:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae8910>
2026-03-27 16:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be3d332-adbb-5f0e-ad4f-3daecc9aac5e/9be3d332-adbb-5f0e-ad4f-3daecc9aac5e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F74164c7352c642b894f7348eccb784bb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/8.jpg saved to cache
2026-03-27 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9be3d332-adbb-5f0e-ad4f-3daecc9aac5e
2026-03-27 16:51:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9be3d332-adbb-5f0e-ad4f-3daecc9aac5e, skipping ID generation
2026-03-27 16:51:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9be3d332-adbb-5f0e-ad4f-3daecc9aac5e with scrape type 1
2026-03-27 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9be3d332-adbb-5f0e-ad4f-3daecc9aac5e sending to next pipeline
2026-03-27 16:51:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9be3d332-adbb-5f0e-ad4f-3daecc9aac5e, identifier: 1988450
2026-03-27 16:51:21 [ayvens.fr] INFO: Found listing with ID: 1988452
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988452%27 HTTP/1.1" 200 None
2026-03-27 16:51:21 [ayvens.fr] INFO: Scrape type for 1988452: 1
2026-03-27 16:51:21 [ayvens.fr] INFO: Extracting data for car ID: 1988452
2026-03-27 16:51:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44003caf-1c2b-5328-ba7e-51221d03c55b with identifier: 1988452
2026-03-27 16:51:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44003caf-1c2b-5328-ba7e-51221d03c55b with scrape type 1
2026-03-27 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 44003caf-1c2b-5328-ba7e-51221d03c55b
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F99ccf32d1df24d8ca292d58e50b07fb2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/1.jpg not downloaded yet
2026-03-27 16:51:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9be3d332-adbb-5f0e-ad4f-3daecc9aac5e with identifier: 1988450
2026-03-27 16:51:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9be3d332-adbb-5f0e-ad4f-3daecc9aac5e with identifier: 1988450
2026-03-27 16:51:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9be3d332-adbb-5f0e-ad4f-3daecc9aac5e with identifier: 1988450 to the API
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '9be3d332-adbb-5f0e-ad4f-3daecc9aac5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 41737,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be3d332-adbb-5f0e-ad4f-3daecc9aac5e/9be3d332-adbb-5f0e-ad4f-3daecc9aac5e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391681,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be3d332-adbb-5f0e-ad4f-3daecc9aac5e/9be3d332-adbb-5f0e-ad4f-3daecc9aac5e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391681,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be3d332-adbb-5f0e-ad4f-3daecc9aac5e/9be3d332-adbb-5f0e-ad4f-3daecc9aac5e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345577,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be3d332-adbb-5f0e-ad4f-3daecc9aac5e/9be3d332-adbb-5f0e-ad4f-3daecc9aac5e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340310,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be3d332-adbb-5f0e-ad4f-3daecc9aac5e/9be3d332-adbb-5f0e-ad4f-3daecc9aac5e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355185,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be3d332-adbb-5f0e-ad4f-3daecc9aac5e/9be3d332-adbb-5f0e-ad4f-3daecc9aac5e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384003,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be3d332-adbb-5f0e-ad4f-3daecc9aac5e/9be3d332-adbb-5f0e-ad4f-3daecc9aac5e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365998,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be3d332-adbb-5f0e-ad4f-3daecc9aac5e/9be3d332-adbb-5f0e-ad4f-3daecc9aac5e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214684,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/74164c7352c642b894f7348eccb784bb/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-04',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 230ch HEV GT-Line Premium Business '
'BVA6 4x2',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 230ch HEV GT-Line Premium Business BVA6 4x2',
'vin': None,
'year': 2023}
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988450%27 HTTP/1.1" 200 None
2026-03-27 16:51:21 [ayvens.fr] INFO: Saving data for 1988450: {'created_time': 1774630281.532518, 'last_price_update_time': 1774630281.53253, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988450') HTTP/1.1" 204 0
2026-03-27 16:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F99ccf32d1df24d8ca292d58e50b07fb2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/2.jpg not downloaded yet
2026-03-27 16:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F99ccf32d1df24d8ca292d58e50b07fb2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/3.jpg not downloaded yet
2026-03-27 16:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F99ccf32d1df24d8ca292d58e50b07fb2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/4.jpg not downloaded yet
2026-03-27 16:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F99ccf32d1df24d8ca292d58e50b07fb2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/5.jpg not downloaded yet
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F99ccf32d1df24d8ca292d58e50b07fb2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/6.jpg not downloaded yet
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F99ccf32d1df24d8ca292d58e50b07fb2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/7.jpg not downloaded yet
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F99ccf32d1df24d8ca292d58e50b07fb2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/8.jpg not downloaded yet
2026-03-27 16:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de40d0>
2026-03-27 16:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_410e3c51-cb7d-591a-b61b-4f7b5a07a12a/410e3c51-cb7d-591a-b61b-4f7b5a07a12a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfba5d87f15847e7ad656c66104225bd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/4.jpg saved to cache
2026-03-27 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 410e3c51-cb7d-591a-b61b-4f7b5a07a12a
2026-03-27 16:51:21 [ayvens.fr] INFO: Found listing with ID: 1988453
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988453%27 HTTP/1.1" 200 None
2026-03-27 16:51:21 [ayvens.fr] INFO: Scrape type for 1988453: 1
2026-03-27 16:51:21 [ayvens.fr] INFO: Extracting data for car ID: 1988453
2026-03-27 16:51:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0dea24f-89fe-5736-b3ef-9063d38d9030 with identifier: 1988453
2026-03-27 16:51:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0dea24f-89fe-5736-b3ef-9063d38d9030 with scrape type 1
2026-03-27 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b0dea24f-89fe-5736-b3ef-9063d38d9030
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8bf5988b2bc949588a0cab7825423fbe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/1.jpg not downloaded yet
2026-03-27 16:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591446750>
2026-03-27 16:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_410e3c51-cb7d-591a-b61b-4f7b5a07a12a/410e3c51-cb7d-591a-b61b-4f7b5a07a12a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfba5d87f15847e7ad656c66104225bd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/2.jpg saved to cache
2026-03-27 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 410e3c51-cb7d-591a-b61b-4f7b5a07a12a
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591001f90>
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_410e3c51-cb7d-591a-b61b-4f7b5a07a12a/410e3c51-cb7d-591a-b61b-4f7b5a07a12a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfba5d87f15847e7ad656c66104225bd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/3.jpg saved to cache
2026-03-27 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 410e3c51-cb7d-591a-b61b-4f7b5a07a12a
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b3290>
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_410e3c51-cb7d-591a-b61b-4f7b5a07a12a/410e3c51-cb7d-591a-b61b-4f7b5a07a12a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfba5d87f15847e7ad656c66104225bd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/1.jpg saved to cache
2026-03-27 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 410e3c51-cb7d-591a-b61b-4f7b5a07a12a
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8bf5988b2bc949588a0cab7825423fbe%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/2.jpg not downloaded yet
2026-03-27 16:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8bf5988b2bc949588a0cab7825423fbe%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/3.jpg not downloaded yet
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906756d0>
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_410e3c51-cb7d-591a-b61b-4f7b5a07a12a/410e3c51-cb7d-591a-b61b-4f7b5a07a12a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfba5d87f15847e7ad656c66104225bd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/7.jpg saved to cache
2026-03-27 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 410e3c51-cb7d-591a-b61b-4f7b5a07a12a
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e72d0>
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_410e3c51-cb7d-591a-b61b-4f7b5a07a12a/410e3c51-cb7d-591a-b61b-4f7b5a07a12a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfba5d87f15847e7ad656c66104225bd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/6.jpg saved to cache
2026-03-27 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 410e3c51-cb7d-591a-b61b-4f7b5a07a12a
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590af3910>
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_410e3c51-cb7d-591a-b61b-4f7b5a07a12a/410e3c51-cb7d-591a-b61b-4f7b5a07a12a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfba5d87f15847e7ad656c66104225bd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/5.jpg saved to cache
2026-03-27 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 410e3c51-cb7d-591a-b61b-4f7b5a07a12a
2026-03-27 16:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8bf5988b2bc949588a0cab7825423fbe%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/4.jpg not downloaded yet
2026-03-27 16:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8bf5988b2bc949588a0cab7825423fbe%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/5.jpg not downloaded yet
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe1950>
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_410e3c51-cb7d-591a-b61b-4f7b5a07a12a/410e3c51-cb7d-591a-b61b-4f7b5a07a12a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fdfba5d87f15847e7ad656c66104225bd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/8.jpg saved to cache
2026-03-27 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 410e3c51-cb7d-591a-b61b-4f7b5a07a12a
2026-03-27 16:51:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 410e3c51-cb7d-591a-b61b-4f7b5a07a12a, skipping ID generation
2026-03-27 16:51:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 410e3c51-cb7d-591a-b61b-4f7b5a07a12a with scrape type 1
2026-03-27 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 410e3c51-cb7d-591a-b61b-4f7b5a07a12a sending to next pipeline
2026-03-27 16:51:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 410e3c51-cb7d-591a-b61b-4f7b5a07a12a, identifier: 1988451
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8bf5988b2bc949588a0cab7825423fbe%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/6.jpg not downloaded yet
2026-03-27 16:51:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 410e3c51-cb7d-591a-b61b-4f7b5a07a12a with identifier: 1988451
2026-03-27 16:51:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 410e3c51-cb7d-591a-b61b-4f7b5a07a12a with identifier: 1988451
2026-03-27 16:51:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 410e3c51-cb7d-591a-b61b-4f7b5a07a12a with identifier: 1988451 to the API
2026-03-27 16:51:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 146,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '410e3c51-cb7d-591a-b61b-4f7b5a07a12a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'X-TRAIL',
'odometer': 92059,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_410e3c51-cb7d-591a-b61b-4f7b5a07a12a/410e3c51-cb7d-591a-b61b-4f7b5a07a12a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458599,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_410e3c51-cb7d-591a-b61b-4f7b5a07a12a/410e3c51-cb7d-591a-b61b-4f7b5a07a12a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458599,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_410e3c51-cb7d-591a-b61b-4f7b5a07a12a/410e3c51-cb7d-591a-b61b-4f7b5a07a12a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 445847,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_410e3c51-cb7d-591a-b61b-4f7b5a07a12a/410e3c51-cb7d-591a-b61b-4f7b5a07a12a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_410e3c51-cb7d-591a-b61b-4f7b5a07a12a/410e3c51-cb7d-591a-b61b-4f7b5a07a12a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432940,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_410e3c51-cb7d-591a-b61b-4f7b5a07a12a/410e3c51-cb7d-591a-b61b-4f7b5a07a12a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354171,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_410e3c51-cb7d-591a-b61b-4f7b5a07a12a/410e3c51-cb7d-591a-b61b-4f7b5a07a12a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257480,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_410e3c51-cb7d-591a-b61b-4f7b5a07a12a/410e3c51-cb7d-591a-b61b-4f7b5a07a12a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556097,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/dfba5d87f15847e7ad656c66104225bd/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-24',
'seats_number': 7,
'seller_name': None,
'title': 'NISSAN X-TRAIL X-Trail e-4orce 213ch N-Connecta 7 places',
'transmission': 'automatic',
'trim': 'X-Trail e-4orce 213ch N-Connecta 7 places',
'vin': None,
'year': 2023}
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988451%27 HTTP/1.1" 200 None
2026-03-27 16:51:23 [ayvens.fr] INFO: Saving data for 1988451: {'created_time': 1774630283.145487, 'last_price_update_time': 1774630283.145498, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988451') HTTP/1.1" 204 0
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8bf5988b2bc949588a0cab7825423fbe%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/7.jpg not downloaded yet
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b42110>
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44003caf-1c2b-5328-ba7e-51221d03c55b/44003caf-1c2b-5328-ba7e-51221d03c55b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F99ccf32d1df24d8ca292d58e50b07fb2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/1.jpg saved to cache
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44003caf-1c2b-5328-ba7e-51221d03c55b
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe2810>
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44003caf-1c2b-5328-ba7e-51221d03c55b/44003caf-1c2b-5328-ba7e-51221d03c55b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F99ccf32d1df24d8ca292d58e50b07fb2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/4.jpg saved to cache
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44003caf-1c2b-5328-ba7e-51221d03c55b
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b50c10>
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44003caf-1c2b-5328-ba7e-51221d03c55b/44003caf-1c2b-5328-ba7e-51221d03c55b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F99ccf32d1df24d8ca292d58e50b07fb2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/3.jpg saved to cache
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44003caf-1c2b-5328-ba7e-51221d03c55b
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e5090>
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44003caf-1c2b-5328-ba7e-51221d03c55b/44003caf-1c2b-5328-ba7e-51221d03c55b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F99ccf32d1df24d8ca292d58e50b07fb2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/6.jpg saved to cache
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44003caf-1c2b-5328-ba7e-51221d03c55b
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d60110>
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44003caf-1c2b-5328-ba7e-51221d03c55b/44003caf-1c2b-5328-ba7e-51221d03c55b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F99ccf32d1df24d8ca292d58e50b07fb2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/2.jpg saved to cache
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44003caf-1c2b-5328-ba7e-51221d03c55b
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905917d0>
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44003caf-1c2b-5328-ba7e-51221d03c55b/44003caf-1c2b-5328-ba7e-51221d03c55b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F99ccf32d1df24d8ca292d58e50b07fb2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/7.jpg saved to cache
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44003caf-1c2b-5328-ba7e-51221d03c55b
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b50550>
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44003caf-1c2b-5328-ba7e-51221d03c55b/44003caf-1c2b-5328-ba7e-51221d03c55b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F99ccf32d1df24d8ca292d58e50b07fb2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/5.jpg saved to cache
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44003caf-1c2b-5328-ba7e-51221d03c55b
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8bf5988b2bc949588a0cab7825423fbe%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/8.jpg not downloaded yet
2026-03-27 16:51:23 [ayvens.fr] INFO: Found listing with ID: 1988454
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988454%27 HTTP/1.1" 200 None
2026-03-27 16:51:23 [ayvens.fr] INFO: Scrape type for 1988454: 1
2026-03-27 16:51:23 [ayvens.fr] INFO: Extracting data for car ID: 1988454
2026-03-27 16:51:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 115db5e9-6aca-5f61-a9bb-6c97450151b4 with identifier: 1988454
2026-03-27 16:51:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 115db5e9-6aca-5f61-a9bb-6c97450151b4 with scrape type 1
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 115db5e9-6aca-5f61-a9bb-6c97450151b4
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F6d67e4bce69b41f7b95e6148243bdb70%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/1.jpg not downloaded yet
2026-03-27 16:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F6d67e4bce69b41f7b95e6148243bdb70%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/2.jpg not downloaded yet
2026-03-27 16:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F6d67e4bce69b41f7b95e6148243bdb70%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/3.jpg not downloaded yet
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F6d67e4bce69b41f7b95e6148243bdb70%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/4.jpg not downloaded yet
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F6d67e4bce69b41f7b95e6148243bdb70%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/5.jpg not downloaded yet
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F6d67e4bce69b41f7b95e6148243bdb70%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/6.jpg not downloaded yet
2026-03-27 16:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F6d67e4bce69b41f7b95e6148243bdb70%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/7.jpg not downloaded yet
2026-03-27 16:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F6d67e4bce69b41f7b95e6148243bdb70%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/8.jpg not downloaded yet
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068d410>
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dea24f-89fe-5736-b3ef-9063d38d9030/b0dea24f-89fe-5736-b3ef-9063d38d9030_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8bf5988b2bc949588a0cab7825423fbe%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/3.jpg saved to cache
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0dea24f-89fe-5736-b3ef-9063d38d9030
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3d9d0>
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44003caf-1c2b-5328-ba7e-51221d03c55b/44003caf-1c2b-5328-ba7e-51221d03c55b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F99ccf32d1df24d8ca292d58e50b07fb2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/8.jpg saved to cache
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44003caf-1c2b-5328-ba7e-51221d03c55b
2026-03-27 16:51:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44003caf-1c2b-5328-ba7e-51221d03c55b, skipping ID generation
2026-03-27 16:51:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44003caf-1c2b-5328-ba7e-51221d03c55b with scrape type 1
2026-03-27 16:51:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44003caf-1c2b-5328-ba7e-51221d03c55b sending to next pipeline
2026-03-27 16:51:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 44003caf-1c2b-5328-ba7e-51221d03c55b, identifier: 1988452
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066ef50>
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dea24f-89fe-5736-b3ef-9063d38d9030/b0dea24f-89fe-5736-b3ef-9063d38d9030_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8bf5988b2bc949588a0cab7825423fbe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/1.jpg saved to cache
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0dea24f-89fe-5736-b3ef-9063d38d9030
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7ea90>
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dea24f-89fe-5736-b3ef-9063d38d9030/b0dea24f-89fe-5736-b3ef-9063d38d9030_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8bf5988b2bc949588a0cab7825423fbe%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/2.jpg saved to cache
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0dea24f-89fe-5736-b3ef-9063d38d9030
2026-03-27 16:51:24 [ayvens.fr] INFO: Found listing with ID: 1988455
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988455%27 HTTP/1.1" 200 None
2026-03-27 16:51:24 [ayvens.fr] INFO: Scrape type for 1988455: 1
2026-03-27 16:51:24 [ayvens.fr] INFO: Extracting data for car ID: 1988455
2026-03-27 16:51:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4175277c-ac87-5ffb-b9d2-8239fe800cdc with identifier: 1988455
2026-03-27 16:51:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4175277c-ac87-5ffb-b9d2-8239fe800cdc with scrape type 1
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4175277c-ac87-5ffb-b9d2-8239fe800cdc
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feacab53b99af45d9bda74847e296d86f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/1.jpg not downloaded yet
2026-03-27 16:51:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 44003caf-1c2b-5328-ba7e-51221d03c55b with identifier: 1988452
2026-03-27 16:51:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 44003caf-1c2b-5328-ba7e-51221d03c55b with identifier: 1988452
2026-03-27 16:51:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 44003caf-1c2b-5328-ba7e-51221d03c55b with identifier: 1988452 to the API
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 146,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '44003caf-1c2b-5328-ba7e-51221d03c55b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 49937,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44003caf-1c2b-5328-ba7e-51221d03c55b/44003caf-1c2b-5328-ba7e-51221d03c55b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368027,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44003caf-1c2b-5328-ba7e-51221d03c55b/44003caf-1c2b-5328-ba7e-51221d03c55b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368027,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44003caf-1c2b-5328-ba7e-51221d03c55b/44003caf-1c2b-5328-ba7e-51221d03c55b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339607,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44003caf-1c2b-5328-ba7e-51221d03c55b/44003caf-1c2b-5328-ba7e-51221d03c55b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314444,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44003caf-1c2b-5328-ba7e-51221d03c55b/44003caf-1c2b-5328-ba7e-51221d03c55b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350576,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44003caf-1c2b-5328-ba7e-51221d03c55b/44003caf-1c2b-5328-ba7e-51221d03c55b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350303,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44003caf-1c2b-5328-ba7e-51221d03c55b/44003caf-1c2b-5328-ba7e-51221d03c55b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346333,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44003caf-1c2b-5328-ba7e-51221d03c55b/44003caf-1c2b-5328-ba7e-51221d03c55b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478652,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/99ccf32d1df24d8ca292d58e50b07fb2/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-19',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch S&S Active Business',
'transmission': 'manual',
'trim': '3008 1.2 PureTech 130ch S&S Active Business',
'vin': None,
'year': 2020}
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988452%27 HTTP/1.1" 200 None
2026-03-27 16:51:24 [ayvens.fr] INFO: Saving data for 1988452: {'created_time': 1774630284.661077, 'last_price_update_time': 1774630284.661087, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988452') HTTP/1.1" 204 0
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee2810>
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dea24f-89fe-5736-b3ef-9063d38d9030/b0dea24f-89fe-5736-b3ef-9063d38d9030_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8bf5988b2bc949588a0cab7825423fbe%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/5.jpg saved to cache
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0dea24f-89fe-5736-b3ef-9063d38d9030
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ec61d0>
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dea24f-89fe-5736-b3ef-9063d38d9030/b0dea24f-89fe-5736-b3ef-9063d38d9030_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8bf5988b2bc949588a0cab7825423fbe%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/4.jpg saved to cache
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0dea24f-89fe-5736-b3ef-9063d38d9030
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feacab53b99af45d9bda74847e296d86f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/2.jpg not downloaded yet
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feacab53b99af45d9bda74847e296d86f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/3.jpg not downloaded yet
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c2410>
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dea24f-89fe-5736-b3ef-9063d38d9030/b0dea24f-89fe-5736-b3ef-9063d38d9030_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8bf5988b2bc949588a0cab7825423fbe%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/7.jpg saved to cache
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0dea24f-89fe-5736-b3ef-9063d38d9030
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d8c050>
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dea24f-89fe-5736-b3ef-9063d38d9030/b0dea24f-89fe-5736-b3ef-9063d38d9030_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8bf5988b2bc949588a0cab7825423fbe%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/6.jpg saved to cache
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b0dea24f-89fe-5736-b3ef-9063d38d9030
2026-03-27 16:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feacab53b99af45d9bda74847e296d86f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/4.jpg not downloaded yet
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feacab53b99af45d9bda74847e296d86f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/5.jpg not downloaded yet
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feacab53b99af45d9bda74847e296d86f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/6.jpg not downloaded yet
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feacab53b99af45d9bda74847e296d86f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/7.jpg not downloaded yet
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feacab53b99af45d9bda74847e296d86f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/8.jpg not downloaded yet
2026-03-27 16:51:24 [ayvens.fr] INFO: Found listing with ID: 1988456
2026-03-27 16:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988456%27 HTTP/1.1" 200 None
2026-03-27 16:51:25 [ayvens.fr] INFO: Scrape type for 1988456: 1
2026-03-27 16:51:25 [ayvens.fr] INFO: Extracting data for car ID: 1988456
2026-03-27 16:51:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88720236-f7f3-542e-afe1-6a068067a810 with identifier: 1988456
2026-03-27 16:51:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88720236-f7f3-542e-afe1-6a068067a810 with scrape type 1
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 88720236-f7f3-542e-afe1-6a068067a810
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fd4443b46c9e847bba85281ab3d1bbbc6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/1.jpg not downloaded yet
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fd4443b46c9e847bba85281ab3d1bbbc6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/2.jpg not downloaded yet
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fcb010>
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115db5e9-6aca-5f61-a9bb-6c97450151b4/115db5e9-6aca-5f61-a9bb-6c97450151b4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F6d67e4bce69b41f7b95e6148243bdb70%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/1.jpg saved to cache
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 115db5e9-6aca-5f61-a9bb-6c97450151b4
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051e590>
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dea24f-89fe-5736-b3ef-9063d38d9030/b0dea24f-89fe-5736-b3ef-9063d38d9030_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F8bf5988b2bc949588a0cab7825423fbe%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/8.jpg saved to cache
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0dea24f-89fe-5736-b3ef-9063d38d9030
2026-03-27 16:51:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0dea24f-89fe-5736-b3ef-9063d38d9030, skipping ID generation
2026-03-27 16:51:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0dea24f-89fe-5736-b3ef-9063d38d9030 with scrape type 1
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0dea24f-89fe-5736-b3ef-9063d38d9030 sending to next pipeline
2026-03-27 16:51:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b0dea24f-89fe-5736-b3ef-9063d38d9030, identifier: 1988453
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2d1d0>
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115db5e9-6aca-5f61-a9bb-6c97450151b4/115db5e9-6aca-5f61-a9bb-6c97450151b4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F6d67e4bce69b41f7b95e6148243bdb70%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/2.jpg saved to cache
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 115db5e9-6aca-5f61-a9bb-6c97450151b4
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910d0810>
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115db5e9-6aca-5f61-a9bb-6c97450151b4/115db5e9-6aca-5f61-a9bb-6c97450151b4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F6d67e4bce69b41f7b95e6148243bdb70%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/5.jpg saved to cache
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 115db5e9-6aca-5f61-a9bb-6c97450151b4
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e2a10>
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115db5e9-6aca-5f61-a9bb-6c97450151b4/115db5e9-6aca-5f61-a9bb-6c97450151b4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F6d67e4bce69b41f7b95e6148243bdb70%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/6.jpg saved to cache
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 115db5e9-6aca-5f61-a9bb-6c97450151b4
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c0d50>
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115db5e9-6aca-5f61-a9bb-6c97450151b4/115db5e9-6aca-5f61-a9bb-6c97450151b4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F6d67e4bce69b41f7b95e6148243bdb70%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/7.jpg saved to cache
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 115db5e9-6aca-5f61-a9bb-6c97450151b4
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910db9d0>
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115db5e9-6aca-5f61-a9bb-6c97450151b4/115db5e9-6aca-5f61-a9bb-6c97450151b4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F6d67e4bce69b41f7b95e6148243bdb70%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/3.jpg saved to cache
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 115db5e9-6aca-5f61-a9bb-6c97450151b4
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910b1e50>
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115db5e9-6aca-5f61-a9bb-6c97450151b4/115db5e9-6aca-5f61-a9bb-6c97450151b4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F6d67e4bce69b41f7b95e6148243bdb70%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/4.jpg saved to cache
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 115db5e9-6aca-5f61-a9bb-6c97450151b4
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fd4443b46c9e847bba85281ab3d1bbbc6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/3.jpg not downloaded yet
2026-03-27 16:51:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b0dea24f-89fe-5736-b3ef-9063d38d9030 with identifier: 1988453
2026-03-27 16:51:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b0dea24f-89fe-5736-b3ef-9063d38d9030 with identifier: 1988453
2026-03-27 16:51:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b0dea24f-89fe-5736-b3ef-9063d38d9030 with identifier: 1988453 to the API
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'BLEU AVATAR METALLISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'b0dea24f-89fe-5736-b3ef-9063d38d9030',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 73743,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dea24f-89fe-5736-b3ef-9063d38d9030/b0dea24f-89fe-5736-b3ef-9063d38d9030_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457435,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dea24f-89fe-5736-b3ef-9063d38d9030/b0dea24f-89fe-5736-b3ef-9063d38d9030_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457435,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dea24f-89fe-5736-b3ef-9063d38d9030/b0dea24f-89fe-5736-b3ef-9063d38d9030_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408754,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dea24f-89fe-5736-b3ef-9063d38d9030/b0dea24f-89fe-5736-b3ef-9063d38d9030_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343833,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dea24f-89fe-5736-b3ef-9063d38d9030/b0dea24f-89fe-5736-b3ef-9063d38d9030_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335098,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dea24f-89fe-5736-b3ef-9063d38d9030/b0dea24f-89fe-5736-b3ef-9063d38d9030_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360313,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dea24f-89fe-5736-b3ef-9063d38d9030/b0dea24f-89fe-5736-b3ef-9063d38d9030_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210015,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dea24f-89fe-5736-b3ef-9063d38d9030/b0dea24f-89fe-5736-b3ef-9063d38d9030_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307309,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/8bf5988b2bc949588a0cab7825423fbe/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 SW 308 SW 1.2 PureTech 130ch S&S Active Pack EAT8',
'transmission': 'automatic',
'trim': '308 SW 1.2 PureTech 130ch S&S Active Pack EAT8',
'vin': None,
'year': 2023}
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988453%27 HTTP/1.1" 200 None
2026-03-27 16:51:25 [ayvens.fr] INFO: Saving data for 1988453: {'created_time': 1774630285.888651, 'last_price_update_time': 1774630285.88866, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988453') HTTP/1.1" 204 0
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fd4443b46c9e847bba85281ab3d1bbbc6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/4.jpg not downloaded yet
2026-03-27 16:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fd4443b46c9e847bba85281ab3d1bbbc6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/5.jpg not downloaded yet
2026-03-27 16:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fd4443b46c9e847bba85281ab3d1bbbc6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/6.jpg not downloaded yet
2026-03-27 16:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fd4443b46c9e847bba85281ab3d1bbbc6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/7.jpg not downloaded yet
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fd4443b46c9e847bba85281ab3d1bbbc6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/8.jpg not downloaded yet
2026-03-27 16:51:26 [ayvens.fr] INFO: Found listing with ID: 1988457
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988457%27 HTTP/1.1" 200 None
2026-03-27 16:51:26 [ayvens.fr] INFO: Scrape type for 1988457: 1
2026-03-27 16:51:26 [ayvens.fr] INFO: Extracting data for car ID: 1988457
2026-03-27 16:51:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cf636f4-e0ee-59b8-8302-7ca790d8ad24 with identifier: 1988457
2026-03-27 16:51:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cf636f4-e0ee-59b8-8302-7ca790d8ad24 with scrape type 1
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5cf636f4-e0ee-59b8-8302-7ca790d8ad24
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0d9c0d1afada4fb3805c2186a2cc21f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/1.jpg not downloaded yet
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0d9c0d1afada4fb3805c2186a2cc21f8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/2.jpg not downloaded yet
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910a3c90>
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4175277c-ac87-5ffb-b9d2-8239fe800cdc/4175277c-ac87-5ffb-b9d2-8239fe800cdc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feacab53b99af45d9bda74847e296d86f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/1.jpg saved to cache
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4175277c-ac87-5ffb-b9d2-8239fe800cdc
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0d9c0d1afada4fb3805c2186a2cc21f8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/3.jpg not downloaded yet
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c91d0>
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4175277c-ac87-5ffb-b9d2-8239fe800cdc/4175277c-ac87-5ffb-b9d2-8239fe800cdc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feacab53b99af45d9bda74847e296d86f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/4.jpg saved to cache
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4175277c-ac87-5ffb-b9d2-8239fe800cdc
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050d190>
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4175277c-ac87-5ffb-b9d2-8239fe800cdc/4175277c-ac87-5ffb-b9d2-8239fe800cdc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feacab53b99af45d9bda74847e296d86f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/2.jpg saved to cache
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4175277c-ac87-5ffb-b9d2-8239fe800cdc
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066a610>
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4175277c-ac87-5ffb-b9d2-8239fe800cdc/4175277c-ac87-5ffb-b9d2-8239fe800cdc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feacab53b99af45d9bda74847e296d86f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/3.jpg saved to cache
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4175277c-ac87-5ffb-b9d2-8239fe800cdc
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0d9c0d1afada4fb3805c2186a2cc21f8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/4.jpg not downloaded yet
2026-03-27 16:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0d9c0d1afada4fb3805c2186a2cc21f8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/5.jpg not downloaded yet
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59102d2d0>
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4175277c-ac87-5ffb-b9d2-8239fe800cdc/4175277c-ac87-5ffb-b9d2-8239fe800cdc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feacab53b99af45d9bda74847e296d86f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/6.jpg saved to cache
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4175277c-ac87-5ffb-b9d2-8239fe800cdc
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3fdd0>
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115db5e9-6aca-5f61-a9bb-6c97450151b4/115db5e9-6aca-5f61-a9bb-6c97450151b4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F6d67e4bce69b41f7b95e6148243bdb70%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/8.jpg saved to cache
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 115db5e9-6aca-5f61-a9bb-6c97450151b4
2026-03-27 16:51:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 115db5e9-6aca-5f61-a9bb-6c97450151b4, skipping ID generation
2026-03-27 16:51:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 115db5e9-6aca-5f61-a9bb-6c97450151b4 with scrape type 1
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 115db5e9-6aca-5f61-a9bb-6c97450151b4 sending to next pipeline
2026-03-27 16:51:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 115db5e9-6aca-5f61-a9bb-6c97450151b4, identifier: 1988454
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904fdcd0>
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4175277c-ac87-5ffb-b9d2-8239fe800cdc/4175277c-ac87-5ffb-b9d2-8239fe800cdc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feacab53b99af45d9bda74847e296d86f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/5.jpg saved to cache
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4175277c-ac87-5ffb-b9d2-8239fe800cdc
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7dfd0>
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4175277c-ac87-5ffb-b9d2-8239fe800cdc/4175277c-ac87-5ffb-b9d2-8239fe800cdc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feacab53b99af45d9bda74847e296d86f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/7.jpg saved to cache
2026-03-27 16:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4175277c-ac87-5ffb-b9d2-8239fe800cdc
2026-03-27 16:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 115db5e9-6aca-5f61-a9bb-6c97450151b4 with identifier: 1988454
2026-03-27 16:51:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:51:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 115db5e9-6aca-5f61-a9bb-6c97450151b4 with identifier: 1988454
2026-03-27 16:51:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 115db5e9-6aca-5f61-a9bb-6c97450151b4 with identifier: 1988454 to the API
2026-03-27 16:51:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'SKYSCRAPER GRAU METAL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '115db5e9-6aca-5f61-a9bb-6c97450151b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'I4',
'odometer': 119577,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115db5e9-6aca-5f61-a9bb-6c97450151b4/115db5e9-6aca-5f61-a9bb-6c97450151b4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287919,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115db5e9-6aca-5f61-a9bb-6c97450151b4/115db5e9-6aca-5f61-a9bb-6c97450151b4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287919,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115db5e9-6aca-5f61-a9bb-6c97450151b4/115db5e9-6aca-5f61-a9bb-6c97450151b4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328626,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115db5e9-6aca-5f61-a9bb-6c97450151b4/115db5e9-6aca-5f61-a9bb-6c97450151b4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337571,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115db5e9-6aca-5f61-a9bb-6c97450151b4/115db5e9-6aca-5f61-a9bb-6c97450151b4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324984,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115db5e9-6aca-5f61-a9bb-6c97450151b4/115db5e9-6aca-5f61-a9bb-6c97450151b4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299409,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115db5e9-6aca-5f61-a9bb-6c97450151b4/115db5e9-6aca-5f61-a9bb-6c97450151b4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248060,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115db5e9-6aca-5f61-a9bb-6c97450151b4/115db5e9-6aca-5f61-a9bb-6c97450151b4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450844,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/6d67e4bce69b41f7b95e6148243bdb70/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-17',
'seats_number': 5,
'seller_name': None,
'title': 'BMW I4 i4 eDrive35 286ch',
'transmission': 'automatic',
'trim': 'i4 eDrive35 286ch',
'vin': None,
'year': 2023}
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988454%27 HTTP/1.1" 200 None
2026-03-27 16:51:27 [ayvens.fr] INFO: Saving data for 1988454: {'created_time': 1774630287.233029, 'last_price_update_time': 1774630287.23304, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988454') HTTP/1.1" 204 0
2026-03-27 16:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0d9c0d1afada4fb3805c2186a2cc21f8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/6.jpg not downloaded yet
2026-03-27 16:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0d9c0d1afada4fb3805c2186a2cc21f8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/7.jpg not downloaded yet
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4f750>
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88720236-f7f3-542e-afe1-6a068067a810/88720236-f7f3-542e-afe1-6a068067a810_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fd4443b46c9e847bba85281ab3d1bbbc6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/5.jpg saved to cache
2026-03-27 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88720236-f7f3-542e-afe1-6a068067a810
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd0910>
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88720236-f7f3-542e-afe1-6a068067a810/88720236-f7f3-542e-afe1-6a068067a810_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fd4443b46c9e847bba85281ab3d1bbbc6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/7.jpg saved to cache
2026-03-27 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 88720236-f7f3-542e-afe1-6a068067a810
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903cfe90>
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88720236-f7f3-542e-afe1-6a068067a810/88720236-f7f3-542e-afe1-6a068067a810_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fd4443b46c9e847bba85281ab3d1bbbc6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/6.jpg saved to cache
2026-03-27 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 88720236-f7f3-542e-afe1-6a068067a810
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590621c50>
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88720236-f7f3-542e-afe1-6a068067a810/88720236-f7f3-542e-afe1-6a068067a810_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fd4443b46c9e847bba85281ab3d1bbbc6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/2.jpg saved to cache
2026-03-27 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 88720236-f7f3-542e-afe1-6a068067a810
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0d9c0d1afada4fb3805c2186a2cc21f8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/8.jpg not downloaded yet
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911cb590>
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88720236-f7f3-542e-afe1-6a068067a810/88720236-f7f3-542e-afe1-6a068067a810_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fd4443b46c9e847bba85281ab3d1bbbc6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/3.jpg saved to cache
2026-03-27 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88720236-f7f3-542e-afe1-6a068067a810
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068cc90>
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88720236-f7f3-542e-afe1-6a068067a810/88720236-f7f3-542e-afe1-6a068067a810_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fd4443b46c9e847bba85281ab3d1bbbc6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/1.jpg saved to cache
2026-03-27 16:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88720236-f7f3-542e-afe1-6a068067a810
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591480990>
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88720236-f7f3-542e-afe1-6a068067a810/88720236-f7f3-542e-afe1-6a068067a810_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fd4443b46c9e847bba85281ab3d1bbbc6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/4.jpg saved to cache
2026-03-27 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88720236-f7f3-542e-afe1-6a068067a810
2026-03-27 16:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:28 [ayvens.fr] INFO: Found listing with ID: 1988458
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988458%27 HTTP/1.1" 200 None
2026-03-27 16:51:28 [ayvens.fr] INFO: Scrape type for 1988458: 1
2026-03-27 16:51:28 [ayvens.fr] INFO: Extracting data for car ID: 1988458
2026-03-27 16:51:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1703456b-5f2f-5926-b40f-5b01ef957f1b with identifier: 1988458
2026-03-27 16:51:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1703456b-5f2f-5926-b40f-5b01ef957f1b with scrape type 1
2026-03-27 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1703456b-5f2f-5926-b40f-5b01ef957f1b
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F52caee431b674f73b492dace4d4fc2b2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/1.jpg not downloaded yet
2026-03-27 16:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4fe90>
2026-03-27 16:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4175277c-ac87-5ffb-b9d2-8239fe800cdc/4175277c-ac87-5ffb-b9d2-8239fe800cdc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feacab53b99af45d9bda74847e296d86f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/8.jpg saved to cache
2026-03-27 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4175277c-ac87-5ffb-b9d2-8239fe800cdc
2026-03-27 16:51:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4175277c-ac87-5ffb-b9d2-8239fe800cdc, skipping ID generation
2026-03-27 16:51:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4175277c-ac87-5ffb-b9d2-8239fe800cdc with scrape type 1
2026-03-27 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4175277c-ac87-5ffb-b9d2-8239fe800cdc sending to next pipeline
2026-03-27 16:51:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4175277c-ac87-5ffb-b9d2-8239fe800cdc, identifier: 1988455
2026-03-27 16:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4175277c-ac87-5ffb-b9d2-8239fe800cdc with identifier: 1988455
2026-03-27 16:51:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4175277c-ac87-5ffb-b9d2-8239fe800cdc with identifier: 1988455
2026-03-27 16:51:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4175277c-ac87-5ffb-b9d2-8239fe800cdc with identifier: 1988455 to the API
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '4175277c-ac87-5ffb-b9d2-8239fe800cdc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C4',
'odometer': 79706,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4175277c-ac87-5ffb-b9d2-8239fe800cdc/4175277c-ac87-5ffb-b9d2-8239fe800cdc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302487,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4175277c-ac87-5ffb-b9d2-8239fe800cdc/4175277c-ac87-5ffb-b9d2-8239fe800cdc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302487,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4175277c-ac87-5ffb-b9d2-8239fe800cdc/4175277c-ac87-5ffb-b9d2-8239fe800cdc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4175277c-ac87-5ffb-b9d2-8239fe800cdc/4175277c-ac87-5ffb-b9d2-8239fe800cdc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284356,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4175277c-ac87-5ffb-b9d2-8239fe800cdc/4175277c-ac87-5ffb-b9d2-8239fe800cdc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332003,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4175277c-ac87-5ffb-b9d2-8239fe800cdc/4175277c-ac87-5ffb-b9d2-8239fe800cdc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315934,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4175277c-ac87-5ffb-b9d2-8239fe800cdc/4175277c-ac87-5ffb-b9d2-8239fe800cdc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369004,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4175277c-ac87-5ffb-b9d2-8239fe800cdc/4175277c-ac87-5ffb-b9d2-8239fe800cdc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 484768,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eacab53b99af45d9bda74847e296d86f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-16',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C4 C4 PureTech 100ch S&S Live Pack Business',
'transmission': 'manual',
'trim': 'C4 PureTech 100ch S&S Live Pack Business',
'vin': None,
'year': 2021}
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988455%27 HTTP/1.1" 200 None
2026-03-27 16:51:28 [ayvens.fr] INFO: Saving data for 1988455: {'created_time': 1774630288.628522, 'last_price_update_time': 1774630288.628533, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988455') HTTP/1.1" 204 0
2026-03-27 16:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F52caee431b674f73b492dace4d4fc2b2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/2.jpg not downloaded yet
2026-03-27 16:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f611d0>
2026-03-27 16:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88720236-f7f3-542e-afe1-6a068067a810/88720236-f7f3-542e-afe1-6a068067a810_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fd4443b46c9e847bba85281ab3d1bbbc6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/8.jpg saved to cache
2026-03-27 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 88720236-f7f3-542e-afe1-6a068067a810
2026-03-27 16:51:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88720236-f7f3-542e-afe1-6a068067a810, skipping ID generation
2026-03-27 16:51:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88720236-f7f3-542e-afe1-6a068067a810 with scrape type 1
2026-03-27 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88720236-f7f3-542e-afe1-6a068067a810 sending to next pipeline
2026-03-27 16:51:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 88720236-f7f3-542e-afe1-6a068067a810, identifier: 1988456
2026-03-27 16:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F52caee431b674f73b492dace4d4fc2b2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/3.jpg not downloaded yet
2026-03-27 16:51:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 88720236-f7f3-542e-afe1-6a068067a810 with identifier: 1988456
2026-03-27 16:51:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:51:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 88720236-f7f3-542e-afe1-6a068067a810 with identifier: 1988456
2026-03-27 16:51:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 88720236-f7f3-542e-afe1-6a068067a810 with identifier: 1988456 to the API
2026-03-27 16:51:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 175,
'color': 'ROUGE MILLESIME',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '88720236-f7f3-542e-afe1-6a068067a810',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'ESPACE',
'odometer': 71328,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88720236-f7f3-542e-afe1-6a068067a810/88720236-f7f3-542e-afe1-6a068067a810_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368175,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88720236-f7f3-542e-afe1-6a068067a810/88720236-f7f3-542e-afe1-6a068067a810_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368175,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88720236-f7f3-542e-afe1-6a068067a810/88720236-f7f3-542e-afe1-6a068067a810_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352583,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88720236-f7f3-542e-afe1-6a068067a810/88720236-f7f3-542e-afe1-6a068067a810_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347943,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88720236-f7f3-542e-afe1-6a068067a810/88720236-f7f3-542e-afe1-6a068067a810_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365356,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88720236-f7f3-542e-afe1-6a068067a810/88720236-f7f3-542e-afe1-6a068067a810_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355738,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88720236-f7f3-542e-afe1-6a068067a810/88720236-f7f3-542e-afe1-6a068067a810_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316924,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88720236-f7f3-542e-afe1-6a068067a810/88720236-f7f3-542e-afe1-6a068067a810_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367651,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/d4443b46c9e847bba85281ab3d1bbbc6/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-28',
'seats_number': 7,
'seller_name': None,
'title': 'RENAULT ESPACE Espace 2.0 Blue dCi 200ch Initiale Paris EDC',
'transmission': 'automatic',
'trim': 'Espace 2.0 Blue dCi 200ch Initiale Paris EDC',
'vin': None,
'year': 2020}
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988456%27 HTTP/1.1" 200 None
2026-03-27 16:51:29 [ayvens.fr] INFO: Saving data for 1988456: {'created_time': 1774630289.278249, 'last_price_update_time': 1774630289.27826, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988456') HTTP/1.1" 204 0
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b2af50>
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cf636f4-e0ee-59b8-8302-7ca790d8ad24/5cf636f4-e0ee-59b8-8302-7ca790d8ad24_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0d9c0d1afada4fb3805c2186a2cc21f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/1.jpg saved to cache
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5cf636f4-e0ee-59b8-8302-7ca790d8ad24
2026-03-27 16:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F52caee431b674f73b492dace4d4fc2b2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/4.jpg not downloaded yet
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b28790>
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cf636f4-e0ee-59b8-8302-7ca790d8ad24/5cf636f4-e0ee-59b8-8302-7ca790d8ad24_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0d9c0d1afada4fb3805c2186a2cc21f8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/4.jpg saved to cache
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5cf636f4-e0ee-59b8-8302-7ca790d8ad24
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee0f10>
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cf636f4-e0ee-59b8-8302-7ca790d8ad24/5cf636f4-e0ee-59b8-8302-7ca790d8ad24_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0d9c0d1afada4fb3805c2186a2cc21f8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/2.jpg saved to cache
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5cf636f4-e0ee-59b8-8302-7ca790d8ad24
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe0910>
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cf636f4-e0ee-59b8-8302-7ca790d8ad24/5cf636f4-e0ee-59b8-8302-7ca790d8ad24_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0d9c0d1afada4fb3805c2186a2cc21f8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/3.jpg saved to cache
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5cf636f4-e0ee-59b8-8302-7ca790d8ad24
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e8ed90>
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cf636f4-e0ee-59b8-8302-7ca790d8ad24/5cf636f4-e0ee-59b8-8302-7ca790d8ad24_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0d9c0d1afada4fb3805c2186a2cc21f8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/5.jpg saved to cache
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5cf636f4-e0ee-59b8-8302-7ca790d8ad24
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F52caee431b674f73b492dace4d4fc2b2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/5.jpg not downloaded yet
2026-03-27 16:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F52caee431b674f73b492dace4d4fc2b2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/6.jpg not downloaded yet
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b48c10>
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cf636f4-e0ee-59b8-8302-7ca790d8ad24/5cf636f4-e0ee-59b8-8302-7ca790d8ad24_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0d9c0d1afada4fb3805c2186a2cc21f8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/6.jpg saved to cache
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5cf636f4-e0ee-59b8-8302-7ca790d8ad24
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904fe690>
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cf636f4-e0ee-59b8-8302-7ca790d8ad24/5cf636f4-e0ee-59b8-8302-7ca790d8ad24_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0d9c0d1afada4fb3805c2186a2cc21f8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/7.jpg saved to cache
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5cf636f4-e0ee-59b8-8302-7ca790d8ad24
2026-03-27 16:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F52caee431b674f73b492dace4d4fc2b2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/7.jpg not downloaded yet
2026-03-27 16:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f81150>
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cf636f4-e0ee-59b8-8302-7ca790d8ad24/5cf636f4-e0ee-59b8-8302-7ca790d8ad24_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0d9c0d1afada4fb3805c2186a2cc21f8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/8.jpg saved to cache
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5cf636f4-e0ee-59b8-8302-7ca790d8ad24
2026-03-27 16:51:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5cf636f4-e0ee-59b8-8302-7ca790d8ad24, skipping ID generation
2026-03-27 16:51:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cf636f4-e0ee-59b8-8302-7ca790d8ad24 with scrape type 1
2026-03-27 16:51:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5cf636f4-e0ee-59b8-8302-7ca790d8ad24 sending to next pipeline
2026-03-27 16:51:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5cf636f4-e0ee-59b8-8302-7ca790d8ad24, identifier: 1988457
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F52caee431b674f73b492dace4d4fc2b2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/8.jpg not downloaded yet
2026-03-27 16:51:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5cf636f4-e0ee-59b8-8302-7ca790d8ad24 with identifier: 1988457
2026-03-27 16:51:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5cf636f4-e0ee-59b8-8302-7ca790d8ad24 with identifier: 1988457
2026-03-27 16:51:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5cf636f4-e0ee-59b8-8302-7ca790d8ad24 with identifier: 1988457 to the API
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '5cf636f4-e0ee-59b8-8302-7ca790d8ad24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 106605,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf636f4-e0ee-59b8-8302-7ca790d8ad24/5cf636f4-e0ee-59b8-8302-7ca790d8ad24_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440589,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf636f4-e0ee-59b8-8302-7ca790d8ad24/5cf636f4-e0ee-59b8-8302-7ca790d8ad24_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440589,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf636f4-e0ee-59b8-8302-7ca790d8ad24/5cf636f4-e0ee-59b8-8302-7ca790d8ad24_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 463049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf636f4-e0ee-59b8-8302-7ca790d8ad24/5cf636f4-e0ee-59b8-8302-7ca790d8ad24_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389033,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf636f4-e0ee-59b8-8302-7ca790d8ad24/5cf636f4-e0ee-59b8-8302-7ca790d8ad24_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372488,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf636f4-e0ee-59b8-8302-7ca790d8ad24/5cf636f4-e0ee-59b8-8302-7ca790d8ad24_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357379,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf636f4-e0ee-59b8-8302-7ca790d8ad24/5cf636f4-e0ee-59b8-8302-7ca790d8ad24_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269839,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf636f4-e0ee-59b8-8302-7ca790d8ad24/5cf636f4-e0ee-59b8-8302-7ca790d8ad24_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389173,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/0d9c0d1afada4fb3805c2186a2cc21f8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-25',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.5 BlueHDi 130ch S&S Active Business',
'transmission': 'manual',
'trim': '3008 1.5 BlueHDi 130ch S&S Active Business',
'vin': None,
'year': 2021}
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988457%27 HTTP/1.1" 200 None
2026-03-27 16:51:30 [ayvens.fr] INFO: Saving data for 1988457: {'created_time': 1774630290.41787, 'last_price_update_time': 1774630290.41788, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988457') HTTP/1.1" 204 0
2026-03-27 16:51:30 [ayvens.fr] INFO: Found listing with ID: 1988459
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988459%27 HTTP/1.1" 200 None
2026-03-27 16:51:30 [ayvens.fr] INFO: Scrape type for 1988459: 1
2026-03-27 16:51:30 [ayvens.fr] INFO: Extracting data for car ID: 1988459
2026-03-27 16:51:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e with identifier: 1988459
2026-03-27 16:51:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e with scrape type 1
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F2d3bff11ee7e448eaab9b159a89b5e40%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/1.jpg not downloaded yet
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911ca110>
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1703456b-5f2f-5926-b40f-5b01ef957f1b/1703456b-5f2f-5926-b40f-5b01ef957f1b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F52caee431b674f73b492dace4d4fc2b2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/1.jpg saved to cache
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1703456b-5f2f-5926-b40f-5b01ef957f1b
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906231d0>
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1703456b-5f2f-5926-b40f-5b01ef957f1b/1703456b-5f2f-5926-b40f-5b01ef957f1b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F52caee431b674f73b492dace4d4fc2b2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/2.jpg saved to cache
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1703456b-5f2f-5926-b40f-5b01ef957f1b
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F2d3bff11ee7e448eaab9b159a89b5e40%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/2.jpg not downloaded yet
2026-03-27 16:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F2d3bff11ee7e448eaab9b159a89b5e40%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/3.jpg not downloaded yet
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F2d3bff11ee7e448eaab9b159a89b5e40%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/4.jpg not downloaded yet
2026-03-27 16:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F2d3bff11ee7e448eaab9b159a89b5e40%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/5.jpg not downloaded yet
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F2d3bff11ee7e448eaab9b159a89b5e40%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/6.jpg not downloaded yet
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F2d3bff11ee7e448eaab9b159a89b5e40%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/7.jpg not downloaded yet
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F2d3bff11ee7e448eaab9b159a89b5e40%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/8.jpg not downloaded yet
2026-03-27 16:51:30 [ayvens.fr] INFO: Found listing with ID: 1988460
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988460%27 HTTP/1.1" 200 None
2026-03-27 16:51:30 [ayvens.fr] INFO: Scrape type for 1988460: 1
2026-03-27 16:51:30 [ayvens.fr] INFO: Extracting data for car ID: 1988460
2026-03-27 16:51:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce755d5e-c45c-5200-b94b-782c9d7d1cc6 with identifier: 1988460
2026-03-27 16:51:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce755d5e-c45c-5200-b94b-782c9d7d1cc6 with scrape type 1
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ce755d5e-c45c-5200-b94b-782c9d7d1cc6
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F47261cfef80b4c1c850d16de761e01e5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/1.jpg not downloaded yet
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F47261cfef80b4c1c850d16de761e01e5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/2.jpg not downloaded yet
2026-03-27 16:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591196610>
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1703456b-5f2f-5926-b40f-5b01ef957f1b/1703456b-5f2f-5926-b40f-5b01ef957f1b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F52caee431b674f73b492dace4d4fc2b2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/4.jpg saved to cache
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1703456b-5f2f-5926-b40f-5b01ef957f1b
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d6d390>
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1703456b-5f2f-5926-b40f-5b01ef957f1b/1703456b-5f2f-5926-b40f-5b01ef957f1b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F52caee431b674f73b492dace4d4fc2b2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/3.jpg saved to cache
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1703456b-5f2f-5926-b40f-5b01ef957f1b
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f62d90>
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1703456b-5f2f-5926-b40f-5b01ef957f1b/1703456b-5f2f-5926-b40f-5b01ef957f1b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F52caee431b674f73b492dace4d4fc2b2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/5.jpg saved to cache
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1703456b-5f2f-5926-b40f-5b01ef957f1b
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F47261cfef80b4c1c850d16de761e01e5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/3.jpg not downloaded yet
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3bad0>
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1703456b-5f2f-5926-b40f-5b01ef957f1b/1703456b-5f2f-5926-b40f-5b01ef957f1b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F52caee431b674f73b492dace4d4fc2b2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/6.jpg saved to cache
2026-03-27 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1703456b-5f2f-5926-b40f-5b01ef957f1b
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f820d0>
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1703456b-5f2f-5926-b40f-5b01ef957f1b/1703456b-5f2f-5926-b40f-5b01ef957f1b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F52caee431b674f73b492dace4d4fc2b2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/7.jpg saved to cache
2026-03-27 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1703456b-5f2f-5926-b40f-5b01ef957f1b
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F47261cfef80b4c1c850d16de761e01e5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/4.jpg not downloaded yet
2026-03-27 16:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F47261cfef80b4c1c850d16de761e01e5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/5.jpg not downloaded yet
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc7790>
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1703456b-5f2f-5926-b40f-5b01ef957f1b/1703456b-5f2f-5926-b40f-5b01ef957f1b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F52caee431b674f73b492dace4d4fc2b2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/8.jpg saved to cache
2026-03-27 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1703456b-5f2f-5926-b40f-5b01ef957f1b
2026-03-27 16:51:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1703456b-5f2f-5926-b40f-5b01ef957f1b, skipping ID generation
2026-03-27 16:51:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1703456b-5f2f-5926-b40f-5b01ef957f1b with scrape type 1
2026-03-27 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1703456b-5f2f-5926-b40f-5b01ef957f1b sending to next pipeline
2026-03-27 16:51:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1703456b-5f2f-5926-b40f-5b01ef957f1b, identifier: 1988458
2026-03-27 16:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1703456b-5f2f-5926-b40f-5b01ef957f1b with identifier: 1988458
2026-03-27 16:51:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1703456b-5f2f-5926-b40f-5b01ef957f1b with identifier: 1988458
2026-03-27 16:51:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1703456b-5f2f-5926-b40f-5b01ef957f1b with identifier: 1988458 to the API
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 46,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '1703456b-5f2f-5926-b40f-5b01ef957f1b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'JEEP',
'model': 'COMPASS',
'odometer': 66918,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1703456b-5f2f-5926-b40f-5b01ef957f1b/1703456b-5f2f-5926-b40f-5b01ef957f1b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294240,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1703456b-5f2f-5926-b40f-5b01ef957f1b/1703456b-5f2f-5926-b40f-5b01ef957f1b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294240,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1703456b-5f2f-5926-b40f-5b01ef957f1b/1703456b-5f2f-5926-b40f-5b01ef957f1b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339080,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1703456b-5f2f-5926-b40f-5b01ef957f1b/1703456b-5f2f-5926-b40f-5b01ef957f1b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373933,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1703456b-5f2f-5926-b40f-5b01ef957f1b/1703456b-5f2f-5926-b40f-5b01ef957f1b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369998,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1703456b-5f2f-5926-b40f-5b01ef957f1b/1703456b-5f2f-5926-b40f-5b01ef957f1b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294784,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1703456b-5f2f-5926-b40f-5b01ef957f1b/1703456b-5f2f-5926-b40f-5b01ef957f1b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258033,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1703456b-5f2f-5926-b40f-5b01ef957f1b/1703456b-5f2f-5926-b40f-5b01ef957f1b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233716,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/52caee431b674f73b492dace4d4fc2b2/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'JEEP COMPASS Compass 1.3 Turbo T4 240ch PHEV 4xe Trailhawk AT6 eAWD',
'transmission': 'automatic',
'trim': 'Compass 1.3 Turbo T4 240ch PHEV 4xe Trailhawk AT6 eAWD',
'vin': None,
'year': 2022}
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988458%27 HTTP/1.1" 200 None
2026-03-27 16:51:31 [ayvens.fr] INFO: Saving data for 1988458: {'created_time': 1774630291.715147, 'last_price_update_time': 1774630291.715156, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988458') HTTP/1.1" 204 0
2026-03-27 16:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F47261cfef80b4c1c850d16de761e01e5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/6.jpg not downloaded yet
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F47261cfef80b4c1c850d16de761e01e5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/7.jpg not downloaded yet
2026-03-27 16:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a2810>
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e/22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F2d3bff11ee7e448eaab9b159a89b5e40%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/7.jpg saved to cache
2026-03-27 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f83b50>
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e/22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F2d3bff11ee7e448eaab9b159a89b5e40%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/3.jpg saved to cache
2026-03-27 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b48dd0>
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e/22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F2d3bff11ee7e448eaab9b159a89b5e40%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/1.jpg saved to cache
2026-03-27 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911958d0>
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e/22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F2d3bff11ee7e448eaab9b159a89b5e40%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/2.jpg saved to cache
2026-03-27 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F47261cfef80b4c1c850d16de761e01e5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/8.jpg not downloaded yet
2026-03-27 16:51:31 [ayvens.fr] INFO: Found listing with ID: 1988461
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988461%27 HTTP/1.1" 200 None
2026-03-27 16:51:32 [ayvens.fr] INFO: Scrape type for 1988461: 1
2026-03-27 16:51:32 [ayvens.fr] INFO: Extracting data for car ID: 1988461
2026-03-27 16:51:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 269ff6de-3db4-5427-a8c5-012cfdde3e94 with identifier: 1988461
2026-03-27 16:51:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 269ff6de-3db4-5427-a8c5-012cfdde3e94 with scrape type 1
2026-03-27 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 269ff6de-3db4-5427-a8c5-012cfdde3e94
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F1ed1c69925204b2e851c3164f53c4c30%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/1.jpg not downloaded yet
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591195810>
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e/22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F2d3bff11ee7e448eaab9b159a89b5e40%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/4.jpg saved to cache
2026-03-27 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59102f290>
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e/22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F2d3bff11ee7e448eaab9b159a89b5e40%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/5.jpg saved to cache
2026-03-27 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911a5f50>
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e/22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F2d3bff11ee7e448eaab9b159a89b5e40%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/6.jpg saved to cache
2026-03-27 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b67650>
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e/22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F2d3bff11ee7e448eaab9b159a89b5e40%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/8.jpg saved to cache
2026-03-27 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e
2026-03-27 16:51:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e, skipping ID generation
2026-03-27 16:51:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e with scrape type 1
2026-03-27 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e sending to next pipeline
2026-03-27 16:51:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e, identifier: 1988459
2026-03-27 16:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e with identifier: 1988459
2026-03-27 16:51:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e with identifier: 1988459
2026-03-27 16:51:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e with identifier: 1988459 to the API
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308',
'odometer': 104320,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e/22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271661,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e/22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271661,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e/22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383453,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e/22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401289,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e/22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367451,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e/22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352845,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e/22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 241091,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e/22a2a0e2-aab1-5d1c-b4a6-37e2c8d6bf2e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439342,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/2d3bff11ee7e448eaab9b159a89b5e40/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-25',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 308 1.2 PureTech 130ch S&S Allure Business EAT8',
'transmission': 'automatic',
'trim': '308 1.2 PureTech 130ch S&S Allure Business EAT8',
'vin': None,
'year': 2021}
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988459%27 HTTP/1.1" 200 None
2026-03-27 16:51:32 [ayvens.fr] INFO: Saving data for 1988459: {'created_time': 1774630292.715816, 'last_price_update_time': 1774630292.715827, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988459') HTTP/1.1" 204 0
2026-03-27 16:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F1ed1c69925204b2e851c3164f53c4c30%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/2.jpg not downloaded yet
2026-03-27 16:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F1ed1c69925204b2e851c3164f53c4c30%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/3.jpg not downloaded yet
2026-03-27 16:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066fb50>
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce755d5e-c45c-5200-b94b-782c9d7d1cc6/ce755d5e-c45c-5200-b94b-782c9d7d1cc6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F47261cfef80b4c1c850d16de761e01e5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/1.jpg saved to cache
2026-03-27 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce755d5e-c45c-5200-b94b-782c9d7d1cc6
2026-03-27 16:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F1ed1c69925204b2e851c3164f53c4c30%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/4.jpg not downloaded yet
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F1ed1c69925204b2e851c3164f53c4c30%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/5.jpg not downloaded yet
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd1710>
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce755d5e-c45c-5200-b94b-782c9d7d1cc6/ce755d5e-c45c-5200-b94b-782c9d7d1cc6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F47261cfef80b4c1c850d16de761e01e5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/5.jpg saved to cache
2026-03-27 16:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce755d5e-c45c-5200-b94b-782c9d7d1cc6
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905145d0>
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce755d5e-c45c-5200-b94b-782c9d7d1cc6/ce755d5e-c45c-5200-b94b-782c9d7d1cc6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F47261cfef80b4c1c850d16de761e01e5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/4.jpg saved to cache
2026-03-27 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce755d5e-c45c-5200-b94b-782c9d7d1cc6
2026-03-27 16:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c0450>
2026-03-27 16:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce755d5e-c45c-5200-b94b-782c9d7d1cc6/ce755d5e-c45c-5200-b94b-782c9d7d1cc6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F47261cfef80b4c1c850d16de761e01e5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/3.jpg saved to cache
2026-03-27 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ce755d5e-c45c-5200-b94b-782c9d7d1cc6
2026-03-27 16:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f10e50>
2026-03-27 16:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce755d5e-c45c-5200-b94b-782c9d7d1cc6/ce755d5e-c45c-5200-b94b-782c9d7d1cc6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F47261cfef80b4c1c850d16de761e01e5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/7.jpg saved to cache
2026-03-27 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ce755d5e-c45c-5200-b94b-782c9d7d1cc6
2026-03-27 16:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f32050>
2026-03-27 16:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce755d5e-c45c-5200-b94b-782c9d7d1cc6/ce755d5e-c45c-5200-b94b-782c9d7d1cc6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F47261cfef80b4c1c850d16de761e01e5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/2.jpg saved to cache
2026-03-27 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ce755d5e-c45c-5200-b94b-782c9d7d1cc6
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F1ed1c69925204b2e851c3164f53c4c30%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/6.jpg not downloaded yet
2026-03-27 16:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F1ed1c69925204b2e851c3164f53c4c30%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/7.jpg not downloaded yet
2026-03-27 16:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592c2c490>
2026-03-27 16:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce755d5e-c45c-5200-b94b-782c9d7d1cc6/ce755d5e-c45c-5200-b94b-782c9d7d1cc6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F47261cfef80b4c1c850d16de761e01e5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/6.jpg saved to cache
2026-03-27 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ce755d5e-c45c-5200-b94b-782c9d7d1cc6
2026-03-27 16:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F1ed1c69925204b2e851c3164f53c4c30%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/8.jpg not downloaded yet
2026-03-27 16:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:33 [ayvens.fr] INFO: Found listing with ID: 1988462
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988462%27 HTTP/1.1" 200 None
2026-03-27 16:51:33 [ayvens.fr] INFO: Scrape type for 1988462: 1
2026-03-27 16:51:33 [ayvens.fr] INFO: Extracting data for car ID: 1988462
2026-03-27 16:51:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2 with identifier: 1988462
2026-03-27 16:51:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2 with scrape type 1
2026-03-27 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F71761187a7c74d78babeb4b34d99d3af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/1.jpg not downloaded yet
2026-03-27 16:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9f050>
2026-03-27 16:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce755d5e-c45c-5200-b94b-782c9d7d1cc6/ce755d5e-c45c-5200-b94b-782c9d7d1cc6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F47261cfef80b4c1c850d16de761e01e5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/8.jpg saved to cache
2026-03-27 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ce755d5e-c45c-5200-b94b-782c9d7d1cc6
2026-03-27 16:51:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce755d5e-c45c-5200-b94b-782c9d7d1cc6, skipping ID generation
2026-03-27 16:51:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce755d5e-c45c-5200-b94b-782c9d7d1cc6 with scrape type 1
2026-03-27 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce755d5e-c45c-5200-b94b-782c9d7d1cc6 sending to next pipeline
2026-03-27 16:51:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ce755d5e-c45c-5200-b94b-782c9d7d1cc6, identifier: 1988460
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F71761187a7c74d78babeb4b34d99d3af%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/2.jpg not downloaded yet
2026-03-27 16:51:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ce755d5e-c45c-5200-b94b-782c9d7d1cc6 with identifier: 1988460
2026-03-27 16:51:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:51:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ce755d5e-c45c-5200-b94b-782c9d7d1cc6 with identifier: 1988460
2026-03-27 16:51:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ce755d5e-c45c-5200-b94b-782c9d7d1cc6 with identifier: 1988460 to the API
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'BLEU VERTIGO',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'ce755d5e-c45c-5200-b94b-782c9d7d1cc6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 104073,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce755d5e-c45c-5200-b94b-782c9d7d1cc6/ce755d5e-c45c-5200-b94b-782c9d7d1cc6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418100,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce755d5e-c45c-5200-b94b-782c9d7d1cc6/ce755d5e-c45c-5200-b94b-782c9d7d1cc6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418100,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce755d5e-c45c-5200-b94b-782c9d7d1cc6/ce755d5e-c45c-5200-b94b-782c9d7d1cc6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343507,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce755d5e-c45c-5200-b94b-782c9d7d1cc6/ce755d5e-c45c-5200-b94b-782c9d7d1cc6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353057,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce755d5e-c45c-5200-b94b-782c9d7d1cc6/ce755d5e-c45c-5200-b94b-782c9d7d1cc6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245437,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce755d5e-c45c-5200-b94b-782c9d7d1cc6/ce755d5e-c45c-5200-b94b-782c9d7d1cc6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309362,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce755d5e-c45c-5200-b94b-782c9d7d1cc6/ce755d5e-c45c-5200-b94b-782c9d7d1cc6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174602,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce755d5e-c45c-5200-b94b-782c9d7d1cc6/ce755d5e-c45c-5200-b94b-782c9d7d1cc6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297152,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/47261cfef80b4c1c850d16de761e01e5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-25',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.5 BlueHDi 130ch S&S Allure Business EAT8 7cv',
'transmission': 'automatic',
'trim': '2008 1.5 BlueHDi 130ch S&S Allure Business EAT8 7cv',
'vin': None,
'year': 2020}
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988460%27 HTTP/1.1" 200 None
2026-03-27 16:51:33 [ayvens.fr] INFO: Saving data for 1988460: {'created_time': 1774630293.967735, 'last_price_update_time': 1774630293.967749, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988460') HTTP/1.1" 204 0
2026-03-27 16:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F71761187a7c74d78babeb4b34d99d3af%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/3.jpg not downloaded yet
2026-03-27 16:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe2890>
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_269ff6de-3db4-5427-a8c5-012cfdde3e94/269ff6de-3db4-5427-a8c5-012cfdde3e94_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F1ed1c69925204b2e851c3164f53c4c30%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/1.jpg saved to cache
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 269ff6de-3db4-5427-a8c5-012cfdde3e94
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abd9d0>
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_269ff6de-3db4-5427-a8c5-012cfdde3e94/269ff6de-3db4-5427-a8c5-012cfdde3e94_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F1ed1c69925204b2e851c3164f53c4c30%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/2.jpg saved to cache
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 269ff6de-3db4-5427-a8c5-012cfdde3e94
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b49990>
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_269ff6de-3db4-5427-a8c5-012cfdde3e94/269ff6de-3db4-5427-a8c5-012cfdde3e94_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F1ed1c69925204b2e851c3164f53c4c30%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/3.jpg saved to cache
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 269ff6de-3db4-5427-a8c5-012cfdde3e94
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F71761187a7c74d78babeb4b34d99d3af%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/4.jpg not downloaded yet
2026-03-27 16:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F71761187a7c74d78babeb4b34d99d3af%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/5.jpg not downloaded yet
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4ef50>
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_269ff6de-3db4-5427-a8c5-012cfdde3e94/269ff6de-3db4-5427-a8c5-012cfdde3e94_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F1ed1c69925204b2e851c3164f53c4c30%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/4.jpg saved to cache
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 269ff6de-3db4-5427-a8c5-012cfdde3e94
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F71761187a7c74d78babeb4b34d99d3af%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/6.jpg not downloaded yet
2026-03-27 16:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F71761187a7c74d78babeb4b34d99d3af%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/7.jpg not downloaded yet
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6ef90>
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_269ff6de-3db4-5427-a8c5-012cfdde3e94/269ff6de-3db4-5427-a8c5-012cfdde3e94_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F1ed1c69925204b2e851c3164f53c4c30%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/6.jpg saved to cache
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 269ff6de-3db4-5427-a8c5-012cfdde3e94
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911cb290>
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_269ff6de-3db4-5427-a8c5-012cfdde3e94/269ff6de-3db4-5427-a8c5-012cfdde3e94_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F1ed1c69925204b2e851c3164f53c4c30%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/8.jpg saved to cache
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 269ff6de-3db4-5427-a8c5-012cfdde3e94
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d1910>
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_269ff6de-3db4-5427-a8c5-012cfdde3e94/269ff6de-3db4-5427-a8c5-012cfdde3e94_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F1ed1c69925204b2e851c3164f53c4c30%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/7.jpg saved to cache
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 269ff6de-3db4-5427-a8c5-012cfdde3e94
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066fa50>
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_269ff6de-3db4-5427-a8c5-012cfdde3e94/269ff6de-3db4-5427-a8c5-012cfdde3e94_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F1ed1c69925204b2e851c3164f53c4c30%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/5.jpg saved to cache
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 269ff6de-3db4-5427-a8c5-012cfdde3e94
2026-03-27 16:51:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 269ff6de-3db4-5427-a8c5-012cfdde3e94, skipping ID generation
2026-03-27 16:51:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 269ff6de-3db4-5427-a8c5-012cfdde3e94 with scrape type 1
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 269ff6de-3db4-5427-a8c5-012cfdde3e94 sending to next pipeline
2026-03-27 16:51:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 269ff6de-3db4-5427-a8c5-012cfdde3e94, identifier: 1988461
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F71761187a7c74d78babeb4b34d99d3af%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/8.jpg not downloaded yet
2026-03-27 16:51:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 269ff6de-3db4-5427-a8c5-012cfdde3e94 with identifier: 1988461
2026-03-27 16:51:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 269ff6de-3db4-5427-a8c5-012cfdde3e94 with identifier: 1988461
2026-03-27 16:51:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 269ff6de-3db4-5427-a8c5-012cfdde3e94 with identifier: 1988461 to the API
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 32,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '269ff6de-3db4-5427-a8c5-012cfdde3e94',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C5 AIRCROSS',
'odometer': 55111,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_269ff6de-3db4-5427-a8c5-012cfdde3e94/269ff6de-3db4-5427-a8c5-012cfdde3e94_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369989,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_269ff6de-3db4-5427-a8c5-012cfdde3e94/269ff6de-3db4-5427-a8c5-012cfdde3e94_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369989,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_269ff6de-3db4-5427-a8c5-012cfdde3e94/269ff6de-3db4-5427-a8c5-012cfdde3e94_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415702,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_269ff6de-3db4-5427-a8c5-012cfdde3e94/269ff6de-3db4-5427-a8c5-012cfdde3e94_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326898,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_269ff6de-3db4-5427-a8c5-012cfdde3e94/269ff6de-3db4-5427-a8c5-012cfdde3e94_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385512,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_269ff6de-3db4-5427-a8c5-012cfdde3e94/269ff6de-3db4-5427-a8c5-012cfdde3e94_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284448,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_269ff6de-3db4-5427-a8c5-012cfdde3e94/269ff6de-3db4-5427-a8c5-012cfdde3e94_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331298,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_269ff6de-3db4-5427-a8c5-012cfdde3e94/269ff6de-3db4-5427-a8c5-012cfdde3e94_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202762,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/1ed1c69925204b2e851c3164f53c4c30/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-08',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C5 AIRCROSS C5 Aircross Hybrid rechargeable 225ch Shine '
'E-EAT8',
'transmission': 'automatic',
'trim': 'C5 Aircross Hybrid rechargeable 225ch Shine E-EAT8',
'vin': None,
'year': 2022}
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988461%27 HTTP/1.1" 200 None
2026-03-27 16:51:35 [ayvens.fr] INFO: Saving data for 1988461: {'created_time': 1774630295.374273, 'last_price_update_time': 1774630295.374285, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988461') HTTP/1.1" 204 0
2026-03-27 16:51:35 [ayvens.fr] INFO: Found listing with ID: 1988463
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988463%27 HTTP/1.1" 200 None
2026-03-27 16:51:35 [ayvens.fr] INFO: Scrape type for 1988463: 1
2026-03-27 16:51:35 [ayvens.fr] INFO: Extracting data for car ID: 1988463
2026-03-27 16:51:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48a98381-0e98-5f10-8fe6-d7eccba1da87 with identifier: 1988463
2026-03-27 16:51:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48a98381-0e98-5f10-8fe6-d7eccba1da87 with scrape type 1
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 48a98381-0e98-5f10-8fe6-d7eccba1da87
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6377e5a8d15941a5b4f32e4069b0e8b6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/1.jpg not downloaded yet
2026-03-27 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a2cd0>
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2/8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F71761187a7c74d78babeb4b34d99d3af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/1.jpg saved to cache
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6377e5a8d15941a5b4f32e4069b0e8b6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/2.jpg not downloaded yet
2026-03-27 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6377e5a8d15941a5b4f32e4069b0e8b6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/3.jpg not downloaded yet
2026-03-27 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6377e5a8d15941a5b4f32e4069b0e8b6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/4.jpg not downloaded yet
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6377e5a8d15941a5b4f32e4069b0e8b6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/5.jpg not downloaded yet
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a1c50>
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2/8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F71761187a7c74d78babeb4b34d99d3af%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/2.jpg saved to cache
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d04d0>
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2/8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F71761187a7c74d78babeb4b34d99d3af%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/3.jpg saved to cache
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6377e5a8d15941a5b4f32e4069b0e8b6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/6.jpg not downloaded yet
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6377e5a8d15941a5b4f32e4069b0e8b6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/7.jpg not downloaded yet
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d83ad0>
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2/8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F71761187a7c74d78babeb4b34d99d3af%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/4.jpg saved to cache
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b36550>
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2/8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F71761187a7c74d78babeb4b34d99d3af%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/5.jpg saved to cache
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6e8d0>
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2/8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F71761187a7c74d78babeb4b34d99d3af%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/6.jpg saved to cache
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6377e5a8d15941a5b4f32e4069b0e8b6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/8.jpg not downloaded yet
2026-03-27 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:35 [ayvens.fr] INFO: Found listing with ID: 1988464
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988464%27 HTTP/1.1" 200 None
2026-03-27 16:51:35 [ayvens.fr] INFO: Scrape type for 1988464: 1
2026-03-27 16:51:35 [ayvens.fr] INFO: Extracting data for car ID: 1988464
2026-03-27 16:51:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8b4c533-4c4c-5e40-a70a-36759785ad73 with identifier: 1988464
2026-03-27 16:51:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8b4c533-4c4c-5e40-a70a-36759785ad73 with scrape type 1
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a8b4c533-4c4c-5e40-a70a-36759785ad73
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F7d0a2ca532144973b33dc55436bee560%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/1.jpg not downloaded yet
2026-03-27 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F7d0a2ca532144973b33dc55436bee560%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/2.jpg not downloaded yet
2026-03-27 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F7d0a2ca532144973b33dc55436bee560%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/3.jpg not downloaded yet
2026-03-27 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F7d0a2ca532144973b33dc55436bee560%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/4.jpg not downloaded yet
2026-03-27 16:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F7d0a2ca532144973b33dc55436bee560%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/5.jpg not downloaded yet
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F7d0a2ca532144973b33dc55436bee560%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/6.jpg not downloaded yet
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b34290>
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2/8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F71761187a7c74d78babeb4b34d99d3af%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/7.jpg saved to cache
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F7d0a2ca532144973b33dc55436bee560%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/7.jpg not downloaded yet
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F7d0a2ca532144973b33dc55436bee560%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/8.jpg not downloaded yet
2026-03-27 16:51:36 [ayvens.fr] INFO: Found listing with ID: 1988465
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988465%27 HTTP/1.1" 200 None
2026-03-27 16:51:36 [ayvens.fr] INFO: Scrape type for 1988465: 1
2026-03-27 16:51:36 [ayvens.fr] INFO: Extracting data for car ID: 1988465
2026-03-27 16:51:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a997a20d-a741-534e-96b8-89c78da3b936 with identifier: 1988465
2026-03-27 16:51:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a997a20d-a741-534e-96b8-89c78da3b936 with scrape type 1
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a997a20d-a741-534e-96b8-89c78da3b936
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fc94339e6bf454105bf7490af79ecbe9d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/1.jpg not downloaded yet
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b40610>
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48a98381-0e98-5f10-8fe6-d7eccba1da87/48a98381-0e98-5f10-8fe6-d7eccba1da87_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6377e5a8d15941a5b4f32e4069b0e8b6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/1.jpg saved to cache
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48a98381-0e98-5f10-8fe6-d7eccba1da87
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ec6610>
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2/8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F71761187a7c74d78babeb4b34d99d3af%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/8.jpg saved to cache
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2
2026-03-27 16:51:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2, skipping ID generation
2026-03-27 16:51:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2 with scrape type 1
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2 sending to next pipeline
2026-03-27 16:51:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2, identifier: 1988462
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904d6950>
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48a98381-0e98-5f10-8fe6-d7eccba1da87/48a98381-0e98-5f10-8fe6-d7eccba1da87_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6377e5a8d15941a5b4f32e4069b0e8b6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/2.jpg saved to cache
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 48a98381-0e98-5f10-8fe6-d7eccba1da87
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592c39f10>
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48a98381-0e98-5f10-8fe6-d7eccba1da87/48a98381-0e98-5f10-8fe6-d7eccba1da87_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6377e5a8d15941a5b4f32e4069b0e8b6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/3.jpg saved to cache
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 48a98381-0e98-5f10-8fe6-d7eccba1da87
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d47510>
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48a98381-0e98-5f10-8fe6-d7eccba1da87/48a98381-0e98-5f10-8fe6-d7eccba1da87_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6377e5a8d15941a5b4f32e4069b0e8b6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/4.jpg saved to cache
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 48a98381-0e98-5f10-8fe6-d7eccba1da87
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b58f50>
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48a98381-0e98-5f10-8fe6-d7eccba1da87/48a98381-0e98-5f10-8fe6-d7eccba1da87_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6377e5a8d15941a5b4f32e4069b0e8b6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/5.jpg saved to cache
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 48a98381-0e98-5f10-8fe6-d7eccba1da87
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de6250>
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48a98381-0e98-5f10-8fe6-d7eccba1da87/48a98381-0e98-5f10-8fe6-d7eccba1da87_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6377e5a8d15941a5b4f32e4069b0e8b6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/6.jpg saved to cache
2026-03-27 16:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 48a98381-0e98-5f10-8fe6-d7eccba1da87
2026-03-27 16:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2 with identifier: 1988462
2026-03-27 16:51:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2 with identifier: 1988462
2026-03-27 16:51:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2 with identifier: 1988462 to the API
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'STONIC',
'odometer': 39785,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2/8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331618,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2/8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331618,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2/8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 259812,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2/8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2/8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288186,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2/8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333673,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2/8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385844,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2/8e7f3e70-daa9-5038-ab2d-d1664a8ab8d2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314831,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/71761187a7c74d78babeb4b34d99d3af/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'KIA STONIC Stonic 1.0 T-GDi 120ch MHEV Active Business iBVM6',
'transmission': 'manual',
'trim': 'Stonic 1.0 T-GDi 120ch MHEV Active Business iBVM6',
'vin': None,
'year': 2022}
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988462%27 HTTP/1.1" 200 None
2026-03-27 16:51:37 [ayvens.fr] INFO: Saving data for 1988462: {'created_time': 1774630297.043271, 'last_price_update_time': 1774630297.043283, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988462') HTTP/1.1" 204 0
2026-03-27 16:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fc94339e6bf454105bf7490af79ecbe9d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/2.jpg not downloaded yet
2026-03-27 16:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fc94339e6bf454105bf7490af79ecbe9d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/3.jpg not downloaded yet
2026-03-27 16:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590afffd0>
2026-03-27 16:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48a98381-0e98-5f10-8fe6-d7eccba1da87/48a98381-0e98-5f10-8fe6-d7eccba1da87_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6377e5a8d15941a5b4f32e4069b0e8b6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/8.jpg saved to cache
2026-03-27 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 48a98381-0e98-5f10-8fe6-d7eccba1da87
2026-03-27 16:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fc94339e6bf454105bf7490af79ecbe9d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/4.jpg not downloaded yet
2026-03-27 16:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fc94339e6bf454105bf7490af79ecbe9d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/5.jpg not downloaded yet
2026-03-27 16:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068e3d0>
2026-03-27 16:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b4c533-4c4c-5e40-a70a-36759785ad73/a8b4c533-4c4c-5e40-a70a-36759785ad73_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F7d0a2ca532144973b33dc55436bee560%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/3.jpg saved to cache
2026-03-27 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8b4c533-4c4c-5e40-a70a-36759785ad73
2026-03-27 16:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d76390>
2026-03-27 16:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b4c533-4c4c-5e40-a70a-36759785ad73/a8b4c533-4c4c-5e40-a70a-36759785ad73_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F7d0a2ca532144973b33dc55436bee560%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/2.jpg saved to cache
2026-03-27 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8b4c533-4c4c-5e40-a70a-36759785ad73
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fc94339e6bf454105bf7490af79ecbe9d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/6.jpg not downloaded yet
2026-03-27 16:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c3310>
2026-03-27 16:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48a98381-0e98-5f10-8fe6-d7eccba1da87/48a98381-0e98-5f10-8fe6-d7eccba1da87_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F6377e5a8d15941a5b4f32e4069b0e8b6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/7.jpg saved to cache
2026-03-27 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 48a98381-0e98-5f10-8fe6-d7eccba1da87
2026-03-27 16:51:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48a98381-0e98-5f10-8fe6-d7eccba1da87, skipping ID generation
2026-03-27 16:51:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48a98381-0e98-5f10-8fe6-d7eccba1da87 with scrape type 1
2026-03-27 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48a98381-0e98-5f10-8fe6-d7eccba1da87 sending to next pipeline
2026-03-27 16:51:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 48a98381-0e98-5f10-8fe6-d7eccba1da87, identifier: 1988463
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fc94339e6bf454105bf7490af79ecbe9d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/7.jpg not downloaded yet
2026-03-27 16:51:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 48a98381-0e98-5f10-8fe6-d7eccba1da87 with identifier: 1988463
2026-03-27 16:51:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:51:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 48a98381-0e98-5f10-8fe6-d7eccba1da87 with identifier: 1988463
2026-03-27 16:51:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 48a98381-0e98-5f10-8fe6-d7eccba1da87 with identifier: 1988463 to the API
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'TEAL BLUE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/diesel',
'id': '48a98381-0e98-5f10-8fe6-d7eccba1da87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'TUCSON',
'odometer': 85489,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a98381-0e98-5f10-8fe6-d7eccba1da87/48a98381-0e98-5f10-8fe6-d7eccba1da87_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 455939,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a98381-0e98-5f10-8fe6-d7eccba1da87/48a98381-0e98-5f10-8fe6-d7eccba1da87_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 455939,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a98381-0e98-5f10-8fe6-d7eccba1da87/48a98381-0e98-5f10-8fe6-d7eccba1da87_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450920,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a98381-0e98-5f10-8fe6-d7eccba1da87/48a98381-0e98-5f10-8fe6-d7eccba1da87_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387594,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a98381-0e98-5f10-8fe6-d7eccba1da87/48a98381-0e98-5f10-8fe6-d7eccba1da87_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304601,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a98381-0e98-5f10-8fe6-d7eccba1da87/48a98381-0e98-5f10-8fe6-d7eccba1da87_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328922,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a98381-0e98-5f10-8fe6-d7eccba1da87/48a98381-0e98-5f10-8fe6-d7eccba1da87_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334348,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a98381-0e98-5f10-8fe6-d7eccba1da87/48a98381-0e98-5f10-8fe6-d7eccba1da87_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326325,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/6377e5a8d15941a5b4f32e4069b0e8b6/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-08',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI TUCSON Tucson 1.6 CRDI 136ch Hybrid 48V Creative DCT7',
'transmission': 'automatic',
'trim': 'Tucson 1.6 CRDI 136ch Hybrid 48V Creative DCT7',
'vin': None,
'year': 2022}
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988463%27 HTTP/1.1" 200 None
2026-03-27 16:51:37 [ayvens.fr] INFO: Saving data for 1988463: {'created_time': 1774630297.948217, 'last_price_update_time': 1774630297.948231, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988463') HTTP/1.1" 204 0
2026-03-27 16:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e14410>
2026-03-27 16:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b4c533-4c4c-5e40-a70a-36759785ad73/a8b4c533-4c4c-5e40-a70a-36759785ad73_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F7d0a2ca532144973b33dc55436bee560%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/1.jpg saved to cache
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8b4c533-4c4c-5e40-a70a-36759785ad73
2026-03-27 16:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2f490>
2026-03-27 16:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b4c533-4c4c-5e40-a70a-36759785ad73/a8b4c533-4c4c-5e40-a70a-36759785ad73_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F7d0a2ca532144973b33dc55436bee560%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/6.jpg saved to cache
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a8b4c533-4c4c-5e40-a70a-36759785ad73
2026-03-27 16:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59063c190>
2026-03-27 16:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b4c533-4c4c-5e40-a70a-36759785ad73/a8b4c533-4c4c-5e40-a70a-36759785ad73_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F7d0a2ca532144973b33dc55436bee560%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/4.jpg saved to cache
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8b4c533-4c4c-5e40-a70a-36759785ad73
2026-03-27 16:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d80990>
2026-03-27 16:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b4c533-4c4c-5e40-a70a-36759785ad73/a8b4c533-4c4c-5e40-a70a-36759785ad73_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F7d0a2ca532144973b33dc55436bee560%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/5.jpg saved to cache
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8b4c533-4c4c-5e40-a70a-36759785ad73
2026-03-27 16:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fc94339e6bf454105bf7490af79ecbe9d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/8.jpg not downloaded yet
2026-03-27 16:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:38 [ayvens.fr] INFO: Found listing with ID: 1988466
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988466%27 HTTP/1.1" 200 None
2026-03-27 16:51:38 [ayvens.fr] INFO: Scrape type for 1988466: 1
2026-03-27 16:51:38 [ayvens.fr] INFO: Extracting data for car ID: 1988466
2026-03-27 16:51:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a with identifier: 1988466
2026-03-27 16:51:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a with scrape type 1
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F85fb7c9f68aa4232b81149ea2f1e8ea2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/1.jpg not downloaded yet
2026-03-27 16:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F85fb7c9f68aa4232b81149ea2f1e8ea2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/2.jpg not downloaded yet
2026-03-27 16:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F85fb7c9f68aa4232b81149ea2f1e8ea2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/3.jpg not downloaded yet
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F85fb7c9f68aa4232b81149ea2f1e8ea2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/4.jpg not downloaded yet
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F85fb7c9f68aa4232b81149ea2f1e8ea2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/5.jpg not downloaded yet
2026-03-27 16:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dff610>
2026-03-27 16:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b4c533-4c4c-5e40-a70a-36759785ad73/a8b4c533-4c4c-5e40-a70a-36759785ad73_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F7d0a2ca532144973b33dc55436bee560%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/8.jpg saved to cache
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a8b4c533-4c4c-5e40-a70a-36759785ad73
2026-03-27 16:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd2950>
2026-03-27 16:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b4c533-4c4c-5e40-a70a-36759785ad73/a8b4c533-4c4c-5e40-a70a-36759785ad73_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F7d0a2ca532144973b33dc55436bee560%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/7.jpg saved to cache
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a8b4c533-4c4c-5e40-a70a-36759785ad73
2026-03-27 16:51:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8b4c533-4c4c-5e40-a70a-36759785ad73, skipping ID generation
2026-03-27 16:51:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8b4c533-4c4c-5e40-a70a-36759785ad73 with scrape type 1
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8b4c533-4c4c-5e40-a70a-36759785ad73 sending to next pipeline
2026-03-27 16:51:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a8b4c533-4c4c-5e40-a70a-36759785ad73, identifier: 1988464
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F85fb7c9f68aa4232b81149ea2f1e8ea2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/6.jpg not downloaded yet
2026-03-27 16:51:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a8b4c533-4c4c-5e40-a70a-36759785ad73 with identifier: 1988464
2026-03-27 16:51:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:51:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a8b4c533-4c4c-5e40-a70a-36759785ad73 with identifier: 1988464
2026-03-27 16:51:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a8b4c533-4c4c-5e40-a70a-36759785ad73 with identifier: 1988464 to the API
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 32,
'color': 'CRISTAL PEARL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'a8b4c533-4c4c-5e40-a70a-36759785ad73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'DS AUTOMOBILES',
'model': 'DS7',
'odometer': 76887,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b4c533-4c4c-5e40-a70a-36759785ad73/a8b4c533-4c4c-5e40-a70a-36759785ad73_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351409,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b4c533-4c4c-5e40-a70a-36759785ad73/a8b4c533-4c4c-5e40-a70a-36759785ad73_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351409,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b4c533-4c4c-5e40-a70a-36759785ad73/a8b4c533-4c4c-5e40-a70a-36759785ad73_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335809,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b4c533-4c4c-5e40-a70a-36759785ad73/a8b4c533-4c4c-5e40-a70a-36759785ad73_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374009,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b4c533-4c4c-5e40-a70a-36759785ad73/a8b4c533-4c4c-5e40-a70a-36759785ad73_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375050,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b4c533-4c4c-5e40-a70a-36759785ad73/a8b4c533-4c4c-5e40-a70a-36759785ad73_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319710,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b4c533-4c4c-5e40-a70a-36759785ad73/a8b4c533-4c4c-5e40-a70a-36759785ad73_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 232497,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b4c533-4c4c-5e40-a70a-36759785ad73/a8b4c533-4c4c-5e40-a70a-36759785ad73_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309520,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/7d0a2ca532144973b33dc55436bee560/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'DS AUTOMOBILES DS7 DS 7 Crossback E-TENSE 4x4 300ch Rivoli',
'transmission': 'automatic',
'trim': 'DS 7 Crossback E-TENSE 4x4 300ch Rivoli',
'vin': None,
'year': 2022}
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988464%27 HTTP/1.1" 200 None
2026-03-27 16:51:38 [ayvens.fr] INFO: Saving data for 1988464: {'created_time': 1774630298.969902, 'last_price_update_time': 1774630298.969915, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988464') HTTP/1.1" 204 0
2026-03-27 16:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F85fb7c9f68aa4232b81149ea2f1e8ea2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/7.jpg not downloaded yet
2026-03-27 16:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F85fb7c9f68aa4232b81149ea2f1e8ea2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/8.jpg not downloaded yet
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905b0c50>
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a997a20d-a741-534e-96b8-89c78da3b936/a997a20d-a741-534e-96b8-89c78da3b936_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fc94339e6bf454105bf7490af79ecbe9d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/4.jpg saved to cache
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a997a20d-a741-534e-96b8-89c78da3b936
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590518450>
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a997a20d-a741-534e-96b8-89c78da3b936/a997a20d-a741-534e-96b8-89c78da3b936_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fc94339e6bf454105bf7490af79ecbe9d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/1.jpg saved to cache
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a997a20d-a741-534e-96b8-89c78da3b936
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f60b50>
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a997a20d-a741-534e-96b8-89c78da3b936/a997a20d-a741-534e-96b8-89c78da3b936_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fc94339e6bf454105bf7490af79ecbe9d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/2.jpg saved to cache
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a997a20d-a741-534e-96b8-89c78da3b936
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911bb1d0>
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a997a20d-a741-534e-96b8-89c78da3b936/a997a20d-a741-534e-96b8-89c78da3b936_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fc94339e6bf454105bf7490af79ecbe9d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/3.jpg saved to cache
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a997a20d-a741-534e-96b8-89c78da3b936
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f339d0>
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a997a20d-a741-534e-96b8-89c78da3b936/a997a20d-a741-534e-96b8-89c78da3b936_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fc94339e6bf454105bf7490af79ecbe9d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/5.jpg saved to cache
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a997a20d-a741-534e-96b8-89c78da3b936
2026-03-27 16:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:39 [ayvens.fr] INFO: Found listing with ID: 1988467
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988467%27 HTTP/1.1" 200 None
2026-03-27 16:51:39 [ayvens.fr] INFO: Scrape type for 1988467: 1
2026-03-27 16:51:39 [ayvens.fr] INFO: Extracting data for car ID: 1988467
2026-03-27 16:51:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b67517c2-7589-5cff-958b-d8e1f97df745 with identifier: 1988467
2026-03-27 16:51:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b67517c2-7589-5cff-958b-d8e1f97df745 with scrape type 1
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b67517c2-7589-5cff-958b-d8e1f97df745
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Faef8e21ee8fa43d18cd1a82c0b151f7b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/1.jpg not downloaded yet
2026-03-27 16:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f624d0>
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a997a20d-a741-534e-96b8-89c78da3b936/a997a20d-a741-534e-96b8-89c78da3b936_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fc94339e6bf454105bf7490af79ecbe9d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/6.jpg saved to cache
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a997a20d-a741-534e-96b8-89c78da3b936
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591051590>
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a997a20d-a741-534e-96b8-89c78da3b936/a997a20d-a741-534e-96b8-89c78da3b936_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fc94339e6bf454105bf7490af79ecbe9d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/7.jpg saved to cache
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a997a20d-a741-534e-96b8-89c78da3b936
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591196510>
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a997a20d-a741-534e-96b8-89c78da3b936/a997a20d-a741-534e-96b8-89c78da3b936_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fc94339e6bf454105bf7490af79ecbe9d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/8.jpg saved to cache
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a997a20d-a741-534e-96b8-89c78da3b936
2026-03-27 16:51:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a997a20d-a741-534e-96b8-89c78da3b936, skipping ID generation
2026-03-27 16:51:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a997a20d-a741-534e-96b8-89c78da3b936 with scrape type 1
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a997a20d-a741-534e-96b8-89c78da3b936 sending to next pipeline
2026-03-27 16:51:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a997a20d-a741-534e-96b8-89c78da3b936, identifier: 1988465
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Faef8e21ee8fa43d18cd1a82c0b151f7b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/2.jpg not downloaded yet
2026-03-27 16:51:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a997a20d-a741-534e-96b8-89c78da3b936 with identifier: 1988465
2026-03-27 16:51:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:51:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a997a20d-a741-534e-96b8-89c78da3b936 with identifier: 1988465
2026-03-27 16:51:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a997a20d-a741-534e-96b8-89c78da3b936 with identifier: 1988465 to the API
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'GRIS TERRA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/diesel',
'id': 'a997a20d-a741-534e-96b8-89c78da3b936',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'A4',
'odometer': 129428,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a997a20d-a741-534e-96b8-89c78da3b936/a997a20d-a741-534e-96b8-89c78da3b936_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403528,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a997a20d-a741-534e-96b8-89c78da3b936/a997a20d-a741-534e-96b8-89c78da3b936_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403528,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a997a20d-a741-534e-96b8-89c78da3b936/a997a20d-a741-534e-96b8-89c78da3b936_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432437,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a997a20d-a741-534e-96b8-89c78da3b936/a997a20d-a741-534e-96b8-89c78da3b936_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 234610,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a997a20d-a741-534e-96b8-89c78da3b936/a997a20d-a741-534e-96b8-89c78da3b936_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348465,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a997a20d-a741-534e-96b8-89c78da3b936/a997a20d-a741-534e-96b8-89c78da3b936_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332889,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a997a20d-a741-534e-96b8-89c78da3b936/a997a20d-a741-534e-96b8-89c78da3b936_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233481,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a997a20d-a741-534e-96b8-89c78da3b936/a997a20d-a741-534e-96b8-89c78da3b936_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222300,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/c94339e6bf454105bf7490af79ecbe9d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-26',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI A4 A4 Avant 30 TDI 136ch Business line S tronic 7',
'transmission': 'automatic',
'trim': 'A4 Avant 30 TDI 136ch Business line S tronic 7',
'vin': None,
'year': 2020}
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988465%27 HTTP/1.1" 200 None
2026-03-27 16:51:40 [ayvens.fr] INFO: Saving data for 1988465: {'created_time': 1774630300.035166, 'last_price_update_time': 1774630300.035176, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988465') HTTP/1.1" 204 0
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Faef8e21ee8fa43d18cd1a82c0b151f7b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/3.jpg not downloaded yet
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910eefd0>
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a/e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F85fb7c9f68aa4232b81149ea2f1e8ea2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/1.jpg saved to cache
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591053d50>
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a/e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F85fb7c9f68aa4232b81149ea2f1e8ea2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/2.jpg saved to cache
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e14510>
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a/e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F85fb7c9f68aa4232b81149ea2f1e8ea2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/3.jpg saved to cache
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e4150>
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a/e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F85fb7c9f68aa4232b81149ea2f1e8ea2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/4.jpg saved to cache
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a
2026-03-27 16:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Faef8e21ee8fa43d18cd1a82c0b151f7b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/4.jpg not downloaded yet
2026-03-27 16:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Faef8e21ee8fa43d18cd1a82c0b151f7b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/5.jpg not downloaded yet
2026-03-27 16:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Faef8e21ee8fa43d18cd1a82c0b151f7b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/6.jpg not downloaded yet
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Faef8e21ee8fa43d18cd1a82c0b151f7b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/7.jpg not downloaded yet
2026-03-27 16:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Faef8e21ee8fa43d18cd1a82c0b151f7b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/8.jpg not downloaded yet
2026-03-27 16:51:40 [ayvens.fr] INFO: Found listing with ID: 1988468
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988468%27 HTTP/1.1" 200 None
2026-03-27 16:51:40 [ayvens.fr] INFO: Scrape type for 1988468: 1
2026-03-27 16:51:40 [ayvens.fr] INFO: Extracting data for car ID: 1988468
2026-03-27 16:51:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b5cd7be-ea15-5093-9e21-8971c08fef70 with identifier: 1988468
2026-03-27 16:51:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b5cd7be-ea15-5093-9e21-8971c08fef70 with scrape type 1
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6b5cd7be-ea15-5093-9e21-8971c08fef70
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb1dd39b86a9649b6b8aa8f10c227d249%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/1.jpg not downloaded yet
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb1dd39b86a9649b6b8aa8f10c227d249%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/2.jpg not downloaded yet
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dda1d0>
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a/e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F85fb7c9f68aa4232b81149ea2f1e8ea2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/5.jpg saved to cache
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910c1950>
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a/e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F85fb7c9f68aa4232b81149ea2f1e8ea2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/6.jpg saved to cache
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb1dd39b86a9649b6b8aa8f10c227d249%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/3.jpg not downloaded yet
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb1dd39b86a9649b6b8aa8f10c227d249%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/4.jpg not downloaded yet
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b496d0>
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a/e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F85fb7c9f68aa4232b81149ea2f1e8ea2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/7.jpg saved to cache
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b49810>
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a/e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F85fb7c9f68aa4232b81149ea2f1e8ea2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/8.jpg saved to cache
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a
2026-03-27 16:51:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a, skipping ID generation
2026-03-27 16:51:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a with scrape type 1
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a sending to next pipeline
2026-03-27 16:51:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a, identifier: 1988466
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d95f10>
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b67517c2-7589-5cff-958b-d8e1f97df745/b67517c2-7589-5cff-958b-d8e1f97df745_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Faef8e21ee8fa43d18cd1a82c0b151f7b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/1.jpg saved to cache
2026-03-27 16:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b67517c2-7589-5cff-958b-d8e1f97df745
2026-03-27 16:51:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a with identifier: 1988466
2026-03-27 16:51:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a with identifier: 1988466
2026-03-27 16:51:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a with identifier: 1988466 to the API
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': 'BOSSA NOVA WHITE',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 24537,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a/e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305126,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a/e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305126,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a/e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312885,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a/e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335547,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a/e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327687,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a/e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297119,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a/e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326287,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a/e522fdc6-a8e4-5c09-ab18-aaa8ec291f3a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294645,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/85fb7c9f68aa4232b81149ea2f1e8ea2/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 1.0 70ch BSG S&S Cult',
'transmission': 'manual',
'trim': '500 1.0 70ch BSG S&S Cult',
'vin': None,
'year': 2022}
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988466%27 HTTP/1.1" 200 None
2026-03-27 16:51:41 [ayvens.fr] INFO: Saving data for 1988466: {'created_time': 1774630301.332498, 'last_price_update_time': 1774630301.332508, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988466') HTTP/1.1" 204 0
2026-03-27 16:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb1dd39b86a9649b6b8aa8f10c227d249%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/5.jpg not downloaded yet
2026-03-27 16:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb1dd39b86a9649b6b8aa8f10c227d249%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/6.jpg not downloaded yet
2026-03-27 16:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb1dd39b86a9649b6b8aa8f10c227d249%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/7.jpg not downloaded yet
2026-03-27 16:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb1dd39b86a9649b6b8aa8f10c227d249%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/8.jpg not downloaded yet
2026-03-27 16:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:41 [ayvens.fr] INFO: Found listing with ID: 1988469
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988469%27 HTTP/1.1" 200 None
2026-03-27 16:51:41 [ayvens.fr] INFO: Scrape type for 1988469: 1
2026-03-27 16:51:41 [ayvens.fr] INFO: Extracting data for car ID: 1988469
2026-03-27 16:51:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa440e2d-aea4-53c8-b6e9-193bcf13a66a with identifier: 1988469
2026-03-27 16:51:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa440e2d-aea4-53c8-b6e9-193bcf13a66a with scrape type 1
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item aa440e2d-aea4-53c8-b6e9-193bcf13a66a
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd557b7cce4ff488f8881b5411bf035c1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/1.jpg not downloaded yet
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd557b7cce4ff488f8881b5411bf035c1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/2.jpg not downloaded yet
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f33d50>
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b67517c2-7589-5cff-958b-d8e1f97df745/b67517c2-7589-5cff-958b-d8e1f97df745_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Faef8e21ee8fa43d18cd1a82c0b151f7b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/2.jpg saved to cache
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b67517c2-7589-5cff-958b-d8e1f97df745
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591053490>
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b67517c2-7589-5cff-958b-d8e1f97df745/b67517c2-7589-5cff-958b-d8e1f97df745_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Faef8e21ee8fa43d18cd1a82c0b151f7b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/7.jpg saved to cache
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b67517c2-7589-5cff-958b-d8e1f97df745
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd557b7cce4ff488f8881b5411bf035c1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/3.jpg not downloaded yet
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d80c50>
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b67517c2-7589-5cff-958b-d8e1f97df745/b67517c2-7589-5cff-958b-d8e1f97df745_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Faef8e21ee8fa43d18cd1a82c0b151f7b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/6.jpg saved to cache
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b67517c2-7589-5cff-958b-d8e1f97df745
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe08d0>
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b67517c2-7589-5cff-958b-d8e1f97df745/b67517c2-7589-5cff-958b-d8e1f97df745_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Faef8e21ee8fa43d18cd1a82c0b151f7b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/8.jpg saved to cache
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b67517c2-7589-5cff-958b-d8e1f97df745
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b51210>
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b67517c2-7589-5cff-958b-d8e1f97df745/b67517c2-7589-5cff-958b-d8e1f97df745_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Faef8e21ee8fa43d18cd1a82c0b151f7b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/5.jpg saved to cache
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b67517c2-7589-5cff-958b-d8e1f97df745
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd557b7cce4ff488f8881b5411bf035c1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/4.jpg not downloaded yet
2026-03-27 16:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd557b7cce4ff488f8881b5411bf035c1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/5.jpg not downloaded yet
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d46390>
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5cd7be-ea15-5093-9e21-8971c08fef70/6b5cd7be-ea15-5093-9e21-8971c08fef70_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb1dd39b86a9649b6b8aa8f10c227d249%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/1.jpg saved to cache
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b5cd7be-ea15-5093-9e21-8971c08fef70
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911ed150>
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b67517c2-7589-5cff-958b-d8e1f97df745/b67517c2-7589-5cff-958b-d8e1f97df745_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Faef8e21ee8fa43d18cd1a82c0b151f7b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/4.jpg saved to cache
2026-03-27 16:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b67517c2-7589-5cff-958b-d8e1f97df745
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5a0507e50>
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b67517c2-7589-5cff-958b-d8e1f97df745/b67517c2-7589-5cff-958b-d8e1f97df745_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Faef8e21ee8fa43d18cd1a82c0b151f7b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/3.jpg saved to cache
2026-03-27 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b67517c2-7589-5cff-958b-d8e1f97df745
2026-03-27 16:51:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b67517c2-7589-5cff-958b-d8e1f97df745, skipping ID generation
2026-03-27 16:51:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b67517c2-7589-5cff-958b-d8e1f97df745 with scrape type 1
2026-03-27 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b67517c2-7589-5cff-958b-d8e1f97df745 sending to next pipeline
2026-03-27 16:51:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b67517c2-7589-5cff-958b-d8e1f97df745, identifier: 1988467
2026-03-27 16:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b67517c2-7589-5cff-958b-d8e1f97df745 with identifier: 1988467
2026-03-27 16:51:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b67517c2-7589-5cff-958b-d8e1f97df745 with identifier: 1988467
2026-03-27 16:51:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b67517c2-7589-5cff-958b-d8e1f97df745 with identifier: 1988467 to the API
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'b67517c2-7589-5cff-958b-d8e1f97df745',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308',
'odometer': 61987,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b67517c2-7589-5cff-958b-d8e1f97df745/b67517c2-7589-5cff-958b-d8e1f97df745_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564125,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b67517c2-7589-5cff-958b-d8e1f97df745/b67517c2-7589-5cff-958b-d8e1f97df745_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564125,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b67517c2-7589-5cff-958b-d8e1f97df745/b67517c2-7589-5cff-958b-d8e1f97df745_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 542061,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b67517c2-7589-5cff-958b-d8e1f97df745/b67517c2-7589-5cff-958b-d8e1f97df745_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544185,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b67517c2-7589-5cff-958b-d8e1f97df745/b67517c2-7589-5cff-958b-d8e1f97df745_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339741,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b67517c2-7589-5cff-958b-d8e1f97df745/b67517c2-7589-5cff-958b-d8e1f97df745_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289071,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b67517c2-7589-5cff-958b-d8e1f97df745/b67517c2-7589-5cff-958b-d8e1f97df745_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233844,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b67517c2-7589-5cff-958b-d8e1f97df745/b67517c2-7589-5cff-958b-d8e1f97df745_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323060,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/aef8e21ee8fa43d18cd1a82c0b151f7b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-29',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 308 1.2 PureTech 130ch S&S GT Pack EAT8',
'transmission': 'automatic',
'trim': '308 1.2 PureTech 130ch S&S GT Pack EAT8',
'vin': None,
'year': 2022}
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988467%27 HTTP/1.1" 200 None
2026-03-27 16:51:42 [ayvens.fr] INFO: Saving data for 1988467: {'created_time': 1774630302.464514, 'last_price_update_time': 1774630302.464525, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988467') HTTP/1.1" 204 0
2026-03-27 16:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd557b7cce4ff488f8881b5411bf035c1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/6.jpg not downloaded yet
2026-03-27 16:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd557b7cce4ff488f8881b5411bf035c1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/7.jpg not downloaded yet
2026-03-27 16:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904ff090>
2026-03-27 16:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5cd7be-ea15-5093-9e21-8971c08fef70/6b5cd7be-ea15-5093-9e21-8971c08fef70_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb1dd39b86a9649b6b8aa8f10c227d249%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/2.jpg saved to cache
2026-03-27 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b5cd7be-ea15-5093-9e21-8971c08fef70
2026-03-27 16:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f83f90>
2026-03-27 16:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5cd7be-ea15-5093-9e21-8971c08fef70/6b5cd7be-ea15-5093-9e21-8971c08fef70_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb1dd39b86a9649b6b8aa8f10c227d249%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/4.jpg saved to cache
2026-03-27 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b5cd7be-ea15-5093-9e21-8971c08fef70
2026-03-27 16:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910a0a10>
2026-03-27 16:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5cd7be-ea15-5093-9e21-8971c08fef70/6b5cd7be-ea15-5093-9e21-8971c08fef70_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb1dd39b86a9649b6b8aa8f10c227d249%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/3.jpg saved to cache
2026-03-27 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b5cd7be-ea15-5093-9e21-8971c08fef70
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd557b7cce4ff488f8881b5411bf035c1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/8.jpg not downloaded yet
2026-03-27 16:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:42 [ayvens.fr] INFO: Found listing with ID: 1988470
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988470%27 HTTP/1.1" 200 None
2026-03-27 16:51:42 [ayvens.fr] INFO: Scrape type for 1988470: 1
2026-03-27 16:51:42 [ayvens.fr] INFO: Extracting data for car ID: 1988470
2026-03-27 16:51:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc95d8c7-e769-5f95-bb7b-d99c9987b17c with identifier: 1988470
2026-03-27 16:51:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc95d8c7-e769-5f95-bb7b-d99c9987b17c with scrape type 1
2026-03-27 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item cc95d8c7-e769-5f95-bb7b-d99c9987b17c
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5fb8e689a5d04844aebb8d51e2f26f87%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/1.jpg not downloaded yet
2026-03-27 16:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f83390>
2026-03-27 16:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5cd7be-ea15-5093-9e21-8971c08fef70/6b5cd7be-ea15-5093-9e21-8971c08fef70_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb1dd39b86a9649b6b8aa8f10c227d249%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/5.jpg saved to cache
2026-03-27 16:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b5cd7be-ea15-5093-9e21-8971c08fef70
2026-03-27 16:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efe390>
2026-03-27 16:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5cd7be-ea15-5093-9e21-8971c08fef70/6b5cd7be-ea15-5093-9e21-8971c08fef70_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb1dd39b86a9649b6b8aa8f10c227d249%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/7.jpg saved to cache
2026-03-27 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b5cd7be-ea15-5093-9e21-8971c08fef70
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590620190>
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5cd7be-ea15-5093-9e21-8971c08fef70/6b5cd7be-ea15-5093-9e21-8971c08fef70_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb1dd39b86a9649b6b8aa8f10c227d249%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/6.jpg saved to cache
2026-03-27 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b5cd7be-ea15-5093-9e21-8971c08fef70
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065ded0>
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa440e2d-aea4-53c8-b6e9-193bcf13a66a/aa440e2d-aea4-53c8-b6e9-193bcf13a66a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd557b7cce4ff488f8881b5411bf035c1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/1.jpg saved to cache
2026-03-27 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa440e2d-aea4-53c8-b6e9-193bcf13a66a
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906232d0>
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5cd7be-ea15-5093-9e21-8971c08fef70/6b5cd7be-ea15-5093-9e21-8971c08fef70_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fb1dd39b86a9649b6b8aa8f10c227d249%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/8.jpg saved to cache
2026-03-27 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b5cd7be-ea15-5093-9e21-8971c08fef70
2026-03-27 16:51:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b5cd7be-ea15-5093-9e21-8971c08fef70, skipping ID generation
2026-03-27 16:51:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b5cd7be-ea15-5093-9e21-8971c08fef70 with scrape type 1
2026-03-27 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b5cd7be-ea15-5093-9e21-8971c08fef70 sending to next pipeline
2026-03-27 16:51:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6b5cd7be-ea15-5093-9e21-8971c08fef70, identifier: 1988468
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5fb8e689a5d04844aebb8d51e2f26f87%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/2.jpg not downloaded yet
2026-03-27 16:51:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6b5cd7be-ea15-5093-9e21-8971c08fef70 with identifier: 1988468
2026-03-27 16:51:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6b5cd7be-ea15-5093-9e21-8971c08fef70 with identifier: 1988468
2026-03-27 16:51:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6b5cd7be-ea15-5093-9e21-8971c08fef70 with identifier: 1988468 to the API
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 25,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '6b5cd7be-ea15-5093-9e21-8971c08fef70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 120240,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5cd7be-ea15-5093-9e21-8971c08fef70/6b5cd7be-ea15-5093-9e21-8971c08fef70_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5cd7be-ea15-5093-9e21-8971c08fef70/6b5cd7be-ea15-5093-9e21-8971c08fef70_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307049,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5cd7be-ea15-5093-9e21-8971c08fef70/6b5cd7be-ea15-5093-9e21-8971c08fef70_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280906,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5cd7be-ea15-5093-9e21-8971c08fef70/6b5cd7be-ea15-5093-9e21-8971c08fef70_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297414,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5cd7be-ea15-5093-9e21-8971c08fef70/6b5cd7be-ea15-5093-9e21-8971c08fef70_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343272,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5cd7be-ea15-5093-9e21-8971c08fef70/6b5cd7be-ea15-5093-9e21-8971c08fef70_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314845,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5cd7be-ea15-5093-9e21-8971c08fef70/6b5cd7be-ea15-5093-9e21-8971c08fef70_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347556,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5cd7be-ea15-5093-9e21-8971c08fef70/6b5cd7be-ea15-5093-9e21-8971c08fef70_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341814,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/b1dd39b86a9649b6b8aa8f10c227d249/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-27',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 SW 308 SW PHEV 180ch Active Pack e-EAT8',
'transmission': 'automatic',
'trim': '308 SW PHEV 180ch Active Pack e-EAT8',
'vin': None,
'year': 2022}
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988468%27 HTTP/1.1" 200 None
2026-03-27 16:51:43 [ayvens.fr] INFO: Saving data for 1988468: {'created_time': 1774630303.70853, 'last_price_update_time': 1774630303.708543, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988468') HTTP/1.1" 204 0
2026-03-27 16:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5fb8e689a5d04844aebb8d51e2f26f87%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/3.jpg not downloaded yet
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0c8d0>
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa440e2d-aea4-53c8-b6e9-193bcf13a66a/aa440e2d-aea4-53c8-b6e9-193bcf13a66a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd557b7cce4ff488f8881b5411bf035c1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/2.jpg saved to cache
2026-03-27 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa440e2d-aea4-53c8-b6e9-193bcf13a66a
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5fb8e689a5d04844aebb8d51e2f26f87%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/4.jpg not downloaded yet
2026-03-27 16:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5fb8e689a5d04844aebb8d51e2f26f87%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/5.jpg not downloaded yet
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5fb8e689a5d04844aebb8d51e2f26f87%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/6.jpg not downloaded yet
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc6750>
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa440e2d-aea4-53c8-b6e9-193bcf13a66a/aa440e2d-aea4-53c8-b6e9-193bcf13a66a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd557b7cce4ff488f8881b5411bf035c1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/3.jpg saved to cache
2026-03-27 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa440e2d-aea4-53c8-b6e9-193bcf13a66a
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910a3bd0>
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa440e2d-aea4-53c8-b6e9-193bcf13a66a/aa440e2d-aea4-53c8-b6e9-193bcf13a66a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd557b7cce4ff488f8881b5411bf035c1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/4.jpg saved to cache
2026-03-27 16:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa440e2d-aea4-53c8-b6e9-193bcf13a66a
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df55d0>
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa440e2d-aea4-53c8-b6e9-193bcf13a66a/aa440e2d-aea4-53c8-b6e9-193bcf13a66a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd557b7cce4ff488f8881b5411bf035c1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/5.jpg saved to cache
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa440e2d-aea4-53c8-b6e9-193bcf13a66a
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5fb8e689a5d04844aebb8d51e2f26f87%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/7.jpg not downloaded yet
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5fb8e689a5d04844aebb8d51e2f26f87%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/8.jpg not downloaded yet
2026-03-27 16:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904cbc50>
2026-03-27 16:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa440e2d-aea4-53c8-b6e9-193bcf13a66a/aa440e2d-aea4-53c8-b6e9-193bcf13a66a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd557b7cce4ff488f8881b5411bf035c1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/6.jpg saved to cache
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa440e2d-aea4-53c8-b6e9-193bcf13a66a
2026-03-27 16:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5936b4450>
2026-03-27 16:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa440e2d-aea4-53c8-b6e9-193bcf13a66a/aa440e2d-aea4-53c8-b6e9-193bcf13a66a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd557b7cce4ff488f8881b5411bf035c1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/7.jpg saved to cache
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa440e2d-aea4-53c8-b6e9-193bcf13a66a
2026-03-27 16:51:44 [ayvens.fr] INFO: Found listing with ID: 1988471
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988471%27 HTTP/1.1" 200 None
2026-03-27 16:51:44 [ayvens.fr] INFO: Scrape type for 1988471: 1
2026-03-27 16:51:44 [ayvens.fr] INFO: Extracting data for car ID: 1988471
2026-03-27 16:51:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e001d13c-1932-5171-b69a-610cc715422c with identifier: 1988471
2026-03-27 16:51:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e001d13c-1932-5171-b69a-610cc715422c with scrape type 1
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e001d13c-1932-5171-b69a-610cc715422c
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd2e9a44b671e415888159e03b48ea849%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/1.jpg not downloaded yet
2026-03-27 16:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd2e9a44b671e415888159e03b48ea849%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/2.jpg not downloaded yet
2026-03-27 16:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd2e9a44b671e415888159e03b48ea849%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/3.jpg not downloaded yet
2026-03-27 16:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd2e9a44b671e415888159e03b48ea849%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/4.jpg not downloaded yet
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd2e9a44b671e415888159e03b48ea849%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/5.jpg not downloaded yet
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd2e9a44b671e415888159e03b48ea849%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/6.jpg not downloaded yet
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd2e9a44b671e415888159e03b48ea849%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/7.jpg not downloaded yet
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd2e9a44b671e415888159e03b48ea849%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/8.jpg not downloaded yet
2026-03-27 16:51:44 [ayvens.fr] INFO: Found listing with ID: 1988472
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988472%27 HTTP/1.1" 200 None
2026-03-27 16:51:44 [ayvens.fr] INFO: Scrape type for 1988472: 1
2026-03-27 16:51:44 [ayvens.fr] INFO: Extracting data for car ID: 1988472
2026-03-27 16:51:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfde0eee-069c-5120-99fa-6e879f745eb3 with identifier: 1988472
2026-03-27 16:51:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfde0eee-069c-5120-99fa-6e879f745eb3 with scrape type 1
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item bfde0eee-069c-5120-99fa-6e879f745eb3
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F79bac5309a1e45a2919e9f130229ada4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/1.jpg not downloaded yet
2026-03-27 16:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910edd90>
2026-03-27 16:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa440e2d-aea4-53c8-b6e9-193bcf13a66a/aa440e2d-aea4-53c8-b6e9-193bcf13a66a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd557b7cce4ff488f8881b5411bf035c1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/8.jpg saved to cache
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa440e2d-aea4-53c8-b6e9-193bcf13a66a
2026-03-27 16:51:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa440e2d-aea4-53c8-b6e9-193bcf13a66a, skipping ID generation
2026-03-27 16:51:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa440e2d-aea4-53c8-b6e9-193bcf13a66a with scrape type 1
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa440e2d-aea4-53c8-b6e9-193bcf13a66a sending to next pipeline
2026-03-27 16:51:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: aa440e2d-aea4-53c8-b6e9-193bcf13a66a, identifier: 1988469
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F79bac5309a1e45a2919e9f130229ada4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/2.jpg not downloaded yet
2026-03-27 16:51:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: aa440e2d-aea4-53c8-b6e9-193bcf13a66a with identifier: 1988469
2026-03-27 16:51:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: aa440e2d-aea4-53c8-b6e9-193bcf13a66a with identifier: 1988469
2026-03-27 16:51:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: aa440e2d-aea4-53c8-b6e9-193bcf13a66a with identifier: 1988469 to the API
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'aa440e2d-aea4-53c8-b6e9-193bcf13a66a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 73360,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa440e2d-aea4-53c8-b6e9-193bcf13a66a/aa440e2d-aea4-53c8-b6e9-193bcf13a66a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304978,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa440e2d-aea4-53c8-b6e9-193bcf13a66a/aa440e2d-aea4-53c8-b6e9-193bcf13a66a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304978,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa440e2d-aea4-53c8-b6e9-193bcf13a66a/aa440e2d-aea4-53c8-b6e9-193bcf13a66a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343520,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa440e2d-aea4-53c8-b6e9-193bcf13a66a/aa440e2d-aea4-53c8-b6e9-193bcf13a66a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350822,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa440e2d-aea4-53c8-b6e9-193bcf13a66a/aa440e2d-aea4-53c8-b6e9-193bcf13a66a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352059,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa440e2d-aea4-53c8-b6e9-193bcf13a66a/aa440e2d-aea4-53c8-b6e9-193bcf13a66a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306073,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa440e2d-aea4-53c8-b6e9-193bcf13a66a/aa440e2d-aea4-53c8-b6e9-193bcf13a66a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263275,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa440e2d-aea4-53c8-b6e9-193bcf13a66a/aa440e2d-aea4-53c8-b6e9-193bcf13a66a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371616,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d557b7cce4ff488f8881b5411bf035c1/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-20',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.2 PureTech 110ch Allure Business S&S 5p',
'transmission': 'manual',
'trim': '208 1.2 PureTech 110ch Allure Business S&S 5p',
'vin': None,
'year': 2017}
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988469%27 HTTP/1.1" 200 None
2026-03-27 16:51:44 [ayvens.fr] INFO: Saving data for 1988469: {'created_time': 1774630304.965742, 'last_price_update_time': 1774630304.965753, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988469') HTTP/1.1" 204 0
2026-03-27 16:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911a4410>
2026-03-27 16:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc95d8c7-e769-5f95-bb7b-d99c9987b17c/cc95d8c7-e769-5f95-bb7b-d99c9987b17c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5fb8e689a5d04844aebb8d51e2f26f87%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/3.jpg saved to cache
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc95d8c7-e769-5f95-bb7b-d99c9987b17c
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590657790>
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc95d8c7-e769-5f95-bb7b-d99c9987b17c/cc95d8c7-e769-5f95-bb7b-d99c9987b17c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5fb8e689a5d04844aebb8d51e2f26f87%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/4.jpg saved to cache
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc95d8c7-e769-5f95-bb7b-d99c9987b17c
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b420d0>
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc95d8c7-e769-5f95-bb7b-d99c9987b17c/cc95d8c7-e769-5f95-bb7b-d99c9987b17c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5fb8e689a5d04844aebb8d51e2f26f87%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/2.jpg saved to cache
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc95d8c7-e769-5f95-bb7b-d99c9987b17c
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa1c50>
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc95d8c7-e769-5f95-bb7b-d99c9987b17c/cc95d8c7-e769-5f95-bb7b-d99c9987b17c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5fb8e689a5d04844aebb8d51e2f26f87%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/1.jpg saved to cache
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc95d8c7-e769-5f95-bb7b-d99c9987b17c
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e08290>
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc95d8c7-e769-5f95-bb7b-d99c9987b17c/cc95d8c7-e769-5f95-bb7b-d99c9987b17c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5fb8e689a5d04844aebb8d51e2f26f87%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/5.jpg saved to cache
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc95d8c7-e769-5f95-bb7b-d99c9987b17c
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b40390>
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc95d8c7-e769-5f95-bb7b-d99c9987b17c/cc95d8c7-e769-5f95-bb7b-d99c9987b17c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5fb8e689a5d04844aebb8d51e2f26f87%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/6.jpg saved to cache
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc95d8c7-e769-5f95-bb7b-d99c9987b17c
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F79bac5309a1e45a2919e9f130229ada4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/3.jpg not downloaded yet
2026-03-27 16:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F79bac5309a1e45a2919e9f130229ada4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/4.jpg not downloaded yet
2026-03-27 16:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F79bac5309a1e45a2919e9f130229ada4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/5.jpg not downloaded yet
2026-03-27 16:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F79bac5309a1e45a2919e9f130229ada4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/6.jpg not downloaded yet
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F79bac5309a1e45a2919e9f130229ada4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/7.jpg not downloaded yet
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F79bac5309a1e45a2919e9f130229ada4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/8.jpg not downloaded yet
2026-03-27 16:51:45 [ayvens.fr] INFO: Found listing with ID: 1988473
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988473%27 HTTP/1.1" 200 None
2026-03-27 16:51:45 [ayvens.fr] INFO: Scrape type for 1988473: 1
2026-03-27 16:51:45 [ayvens.fr] INFO: Extracting data for car ID: 1988473
2026-03-27 16:51:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2525f819-9178-5eff-9012-2284321150ba with identifier: 1988473
2026-03-27 16:51:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2525f819-9178-5eff-9012-2284321150ba with scrape type 1
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 2525f819-9178-5eff-9012-2284321150ba
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe1d10d16e9d4418b9410ad1997973854%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/1.jpg not downloaded yet
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe1d10d16e9d4418b9410ad1997973854%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/2.jpg not downloaded yet
2026-03-27 16:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591181ed0>
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc95d8c7-e769-5f95-bb7b-d99c9987b17c/cc95d8c7-e769-5f95-bb7b-d99c9987b17c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5fb8e689a5d04844aebb8d51e2f26f87%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/7.jpg saved to cache
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc95d8c7-e769-5f95-bb7b-d99c9987b17c
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904fe550>
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc95d8c7-e769-5f95-bb7b-d99c9987b17c/cc95d8c7-e769-5f95-bb7b-d99c9987b17c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F5fb8e689a5d04844aebb8d51e2f26f87%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/8.jpg saved to cache
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc95d8c7-e769-5f95-bb7b-d99c9987b17c
2026-03-27 16:51:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc95d8c7-e769-5f95-bb7b-d99c9987b17c, skipping ID generation
2026-03-27 16:51:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc95d8c7-e769-5f95-bb7b-d99c9987b17c with scrape type 1
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc95d8c7-e769-5f95-bb7b-d99c9987b17c sending to next pipeline
2026-03-27 16:51:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: cc95d8c7-e769-5f95-bb7b-d99c9987b17c, identifier: 1988470
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe1d10d16e9d4418b9410ad1997973854%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/3.jpg not downloaded yet
2026-03-27 16:51:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: cc95d8c7-e769-5f95-bb7b-d99c9987b17c with identifier: 1988470
2026-03-27 16:51:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: cc95d8c7-e769-5f95-bb7b-d99c9987b17c with identifier: 1988470
2026-03-27 16:51:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: cc95d8c7-e769-5f95-bb7b-d99c9987b17c with identifier: 1988470 to the API
2026-03-27 16:51:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'cc95d8c7-e769-5f95-bb7b-d99c9987b17c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'C-HR',
'odometer': 70324,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc95d8c7-e769-5f95-bb7b-d99c9987b17c/cc95d8c7-e769-5f95-bb7b-d99c9987b17c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 486393,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc95d8c7-e769-5f95-bb7b-d99c9987b17c/cc95d8c7-e769-5f95-bb7b-d99c9987b17c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 486393,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc95d8c7-e769-5f95-bb7b-d99c9987b17c/cc95d8c7-e769-5f95-bb7b-d99c9987b17c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439505,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc95d8c7-e769-5f95-bb7b-d99c9987b17c/cc95d8c7-e769-5f95-bb7b-d99c9987b17c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400472,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc95d8c7-e769-5f95-bb7b-d99c9987b17c/cc95d8c7-e769-5f95-bb7b-d99c9987b17c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342069,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc95d8c7-e769-5f95-bb7b-d99c9987b17c/cc95d8c7-e769-5f95-bb7b-d99c9987b17c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327305,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc95d8c7-e769-5f95-bb7b-d99c9987b17c/cc95d8c7-e769-5f95-bb7b-d99c9987b17c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332309,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc95d8c7-e769-5f95-bb7b-d99c9987b17c/cc95d8c7-e769-5f95-bb7b-d99c9987b17c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268801,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/5fb8e689a5d04844aebb8d51e2f26f87/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-01',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA C-HR C-HR 1.8 Hybride 122ch Dynamic Business E-CVT + '
'Programme Beyond Zero Academy',
'transmission': 'automatic',
'trim': 'C-HR 1.8 Hybride 122ch Dynamic Business E-CVT + Programme Beyond '
'Zero Academy',
'vin': None,
'year': 2023}
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988470%27 HTTP/1.1" 200 None
2026-03-27 16:51:46 [ayvens.fr] INFO: Saving data for 1988470: {'created_time': 1774630306.271094, 'last_price_update_time': 1774630306.271106, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988470') HTTP/1.1" 204 0
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe1d10d16e9d4418b9410ad1997973854%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/4.jpg not downloaded yet
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3b310>
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e001d13c-1932-5171-b69a-610cc715422c/e001d13c-1932-5171-b69a-610cc715422c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd2e9a44b671e415888159e03b48ea849%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/6.jpg saved to cache
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e001d13c-1932-5171-b69a-610cc715422c
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b3f90>
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e001d13c-1932-5171-b69a-610cc715422c/e001d13c-1932-5171-b69a-610cc715422c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd2e9a44b671e415888159e03b48ea849%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/5.jpg saved to cache
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e001d13c-1932-5171-b69a-610cc715422c
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590528650>
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e001d13c-1932-5171-b69a-610cc715422c/e001d13c-1932-5171-b69a-610cc715422c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd2e9a44b671e415888159e03b48ea849%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/1.jpg saved to cache
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e001d13c-1932-5171-b69a-610cc715422c
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b13d0>
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e001d13c-1932-5171-b69a-610cc715422c/e001d13c-1932-5171-b69a-610cc715422c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd2e9a44b671e415888159e03b48ea849%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/2.jpg saved to cache
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e001d13c-1932-5171-b69a-610cc715422c
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905aaa50>
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e001d13c-1932-5171-b69a-610cc715422c/e001d13c-1932-5171-b69a-610cc715422c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd2e9a44b671e415888159e03b48ea849%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/4.jpg saved to cache
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e001d13c-1932-5171-b69a-610cc715422c
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e0c90>
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e001d13c-1932-5171-b69a-610cc715422c/e001d13c-1932-5171-b69a-610cc715422c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd2e9a44b671e415888159e03b48ea849%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/3.jpg saved to cache
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e001d13c-1932-5171-b69a-610cc715422c
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59062c210>
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfde0eee-069c-5120-99fa-6e879f745eb3/bfde0eee-069c-5120-99fa-6e879f745eb3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F79bac5309a1e45a2919e9f130229ada4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/1.jpg saved to cache
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bfde0eee-069c-5120-99fa-6e879f745eb3
2026-03-27 16:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe1d10d16e9d4418b9410ad1997973854%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/5.jpg not downloaded yet
2026-03-27 16:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe1d10d16e9d4418b9410ad1997973854%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/6.jpg not downloaded yet
2026-03-27 16:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe1d10d16e9d4418b9410ad1997973854%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/7.jpg not downloaded yet
2026-03-27 16:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe1d10d16e9d4418b9410ad1997973854%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/8.jpg not downloaded yet
2026-03-27 16:51:46 [ayvens.fr] INFO: Found listing with ID: 1988474
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988474%27 HTTP/1.1" 200 None
2026-03-27 16:51:46 [ayvens.fr] INFO: Scrape type for 1988474: 1
2026-03-27 16:51:46 [ayvens.fr] INFO: Extracting data for car ID: 1988474
2026-03-27 16:51:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d576976-0675-5088-a308-71a3dcb0adaf with identifier: 1988474
2026-03-27 16:51:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d576976-0675-5088-a308-71a3dcb0adaf with scrape type 1
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 2d576976-0675-5088-a308-71a3dcb0adaf
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70ea1157b197454f8474ee00c2527fc8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/1.jpg not downloaded yet
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70ea1157b197454f8474ee00c2527fc8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/2.jpg not downloaded yet
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70ea1157b197454f8474ee00c2527fc8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/3.jpg not downloaded yet
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590528e10>
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e001d13c-1932-5171-b69a-610cc715422c/e001d13c-1932-5171-b69a-610cc715422c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd2e9a44b671e415888159e03b48ea849%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/7.jpg saved to cache
2026-03-27 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e001d13c-1932-5171-b69a-610cc715422c
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70ea1157b197454f8474ee00c2527fc8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/4.jpg not downloaded yet
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4d710>
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfde0eee-069c-5120-99fa-6e879f745eb3/bfde0eee-069c-5120-99fa-6e879f745eb3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F79bac5309a1e45a2919e9f130229ada4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/2.jpg saved to cache
2026-03-27 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bfde0eee-069c-5120-99fa-6e879f745eb3
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd2290>
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfde0eee-069c-5120-99fa-6e879f745eb3/bfde0eee-069c-5120-99fa-6e879f745eb3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F79bac5309a1e45a2919e9f130229ada4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/6.jpg saved to cache
2026-03-27 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bfde0eee-069c-5120-99fa-6e879f745eb3
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903ce110>
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfde0eee-069c-5120-99fa-6e879f745eb3/bfde0eee-069c-5120-99fa-6e879f745eb3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F79bac5309a1e45a2919e9f130229ada4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/4.jpg saved to cache
2026-03-27 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bfde0eee-069c-5120-99fa-6e879f745eb3
2026-03-27 16:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70ea1157b197454f8474ee00c2527fc8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/5.jpg not downloaded yet
2026-03-27 16:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fc8fd0>
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfde0eee-069c-5120-99fa-6e879f745eb3/bfde0eee-069c-5120-99fa-6e879f745eb3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F79bac5309a1e45a2919e9f130229ada4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/3.jpg saved to cache
2026-03-27 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bfde0eee-069c-5120-99fa-6e879f745eb3
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b77050>
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfde0eee-069c-5120-99fa-6e879f745eb3/bfde0eee-069c-5120-99fa-6e879f745eb3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F79bac5309a1e45a2919e9f130229ada4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/7.jpg saved to cache
2026-03-27 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bfde0eee-069c-5120-99fa-6e879f745eb3
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590510a90>
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfde0eee-069c-5120-99fa-6e879f745eb3/bfde0eee-069c-5120-99fa-6e879f745eb3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F79bac5309a1e45a2919e9f130229ada4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/5.jpg saved to cache
2026-03-27 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bfde0eee-069c-5120-99fa-6e879f745eb3
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910ed410>
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e001d13c-1932-5171-b69a-610cc715422c/e001d13c-1932-5171-b69a-610cc715422c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fd2e9a44b671e415888159e03b48ea849%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/8.jpg saved to cache
2026-03-27 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e001d13c-1932-5171-b69a-610cc715422c
2026-03-27 16:51:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e001d13c-1932-5171-b69a-610cc715422c, skipping ID generation
2026-03-27 16:51:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e001d13c-1932-5171-b69a-610cc715422c with scrape type 1
2026-03-27 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e001d13c-1932-5171-b69a-610cc715422c sending to next pipeline
2026-03-27 16:51:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e001d13c-1932-5171-b69a-610cc715422c, identifier: 1988471
2026-03-27 16:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70ea1157b197454f8474ee00c2527fc8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/6.jpg not downloaded yet
2026-03-27 16:51:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e001d13c-1932-5171-b69a-610cc715422c with identifier: 1988471
2026-03-27 16:51:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e001d13c-1932-5171-b69a-610cc715422c with identifier: 1988471
2026-03-27 16:51:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e001d13c-1932-5171-b69a-610cc715422c with identifier: 1988471 to the API
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'e001d13c-1932-5171-b69a-610cc715422c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 55559,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e001d13c-1932-5171-b69a-610cc715422c/e001d13c-1932-5171-b69a-610cc715422c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 475402,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e001d13c-1932-5171-b69a-610cc715422c/e001d13c-1932-5171-b69a-610cc715422c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 475402,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e001d13c-1932-5171-b69a-610cc715422c/e001d13c-1932-5171-b69a-610cc715422c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 500188,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e001d13c-1932-5171-b69a-610cc715422c/e001d13c-1932-5171-b69a-610cc715422c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419048,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e001d13c-1932-5171-b69a-610cc715422c/e001d13c-1932-5171-b69a-610cc715422c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381275,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e001d13c-1932-5171-b69a-610cc715422c/e001d13c-1932-5171-b69a-610cc715422c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352417,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e001d13c-1932-5171-b69a-610cc715422c/e001d13c-1932-5171-b69a-610cc715422c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255888,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e001d13c-1932-5171-b69a-610cc715422c/e001d13c-1932-5171-b69a-610cc715422c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541207,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/d2e9a44b671e415888159e03b48ea849/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-17',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.5 BlueHDi 130ch S&S Allure Pack EAT8',
'transmission': 'automatic',
'trim': '2008 1.5 BlueHDi 130ch S&S Allure Pack EAT8',
'vin': None,
'year': 2022}
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988471%27 HTTP/1.1" 200 None
2026-03-27 16:51:48 [ayvens.fr] INFO: Saving data for 1988471: {'created_time': 1774630308.276062, 'last_price_update_time': 1774630308.276074, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988471') HTTP/1.1" 204 0
2026-03-27 16:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70ea1157b197454f8474ee00c2527fc8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/7.jpg not downloaded yet
2026-03-27 16:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fcb810>
2026-03-27 16:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfde0eee-069c-5120-99fa-6e879f745eb3/bfde0eee-069c-5120-99fa-6e879f745eb3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F79bac5309a1e45a2919e9f130229ada4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/8.jpg saved to cache
2026-03-27 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bfde0eee-069c-5120-99fa-6e879f745eb3
2026-03-27 16:51:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bfde0eee-069c-5120-99fa-6e879f745eb3, skipping ID generation
2026-03-27 16:51:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfde0eee-069c-5120-99fa-6e879f745eb3 with scrape type 1
2026-03-27 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bfde0eee-069c-5120-99fa-6e879f745eb3 sending to next pipeline
2026-03-27 16:51:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: bfde0eee-069c-5120-99fa-6e879f745eb3, identifier: 1988472
2026-03-27 16:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59069fe50>
2026-03-27 16:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2525f819-9178-5eff-9012-2284321150ba/2525f819-9178-5eff-9012-2284321150ba_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe1d10d16e9d4418b9410ad1997973854%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/5.jpg saved to cache
2026-03-27 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2525f819-9178-5eff-9012-2284321150ba
2026-03-27 16:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: bfde0eee-069c-5120-99fa-6e879f745eb3 with identifier: 1988472
2026-03-27 16:51:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: bfde0eee-069c-5120-99fa-6e879f745eb3 with identifier: 1988472
2026-03-27 16:51:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: bfde0eee-069c-5120-99fa-6e879f745eb3 with identifier: 1988472 to the API
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': 'bfde0eee-069c-5120-99fa-6e879f745eb3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'E-SOUL',
'odometer': 95730,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfde0eee-069c-5120-99fa-6e879f745eb3/bfde0eee-069c-5120-99fa-6e879f745eb3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294307,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfde0eee-069c-5120-99fa-6e879f745eb3/bfde0eee-069c-5120-99fa-6e879f745eb3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294307,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfde0eee-069c-5120-99fa-6e879f745eb3/bfde0eee-069c-5120-99fa-6e879f745eb3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307359,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfde0eee-069c-5120-99fa-6e879f745eb3/bfde0eee-069c-5120-99fa-6e879f745eb3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272427,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfde0eee-069c-5120-99fa-6e879f745eb3/bfde0eee-069c-5120-99fa-6e879f745eb3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409291,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfde0eee-069c-5120-99fa-6e879f745eb3/bfde0eee-069c-5120-99fa-6e879f745eb3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304905,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfde0eee-069c-5120-99fa-6e879f745eb3/bfde0eee-069c-5120-99fa-6e879f745eb3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290022,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfde0eee-069c-5120-99fa-6e879f745eb3/bfde0eee-069c-5120-99fa-6e879f745eb3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381909,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/79bac5309a1e45a2919e9f130229ada4/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-24',
'seats_number': 5,
'seller_name': None,
'title': 'KIA E-SOUL e-Soul e-Design Business 204ch',
'transmission': 'automatic',
'trim': 'e-Soul e-Design Business 204ch',
'vin': None,
'year': 2020}
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988472%27 HTTP/1.1" 200 None
2026-03-27 16:51:48 [ayvens.fr] INFO: Saving data for 1988472: {'created_time': 1774630308.905963, 'last_price_update_time': 1774630308.905974, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988472') HTTP/1.1" 204 0
2026-03-27 16:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70ea1157b197454f8474ee00c2527fc8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/8.jpg not downloaded yet
2026-03-27 16:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c2550>
2026-03-27 16:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2525f819-9178-5eff-9012-2284321150ba/2525f819-9178-5eff-9012-2284321150ba_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe1d10d16e9d4418b9410ad1997973854%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/4.jpg saved to cache
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2525f819-9178-5eff-9012-2284321150ba
2026-03-27 16:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:49 [ayvens.fr] INFO: Found listing with ID: 1988475
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988475%27 HTTP/1.1" 200 None
2026-03-27 16:51:49 [ayvens.fr] INFO: Scrape type for 1988475: 1
2026-03-27 16:51:49 [ayvens.fr] INFO: Extracting data for car ID: 1988475
2026-03-27 16:51:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0c8d464-a245-5503-a528-344787d1df0b with identifier: 1988475
2026-03-27 16:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0c8d464-a245-5503-a528-344787d1df0b with scrape type 1
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a0c8d464-a245-5503-a528-344787d1df0b
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3ccdd8dcdacf418081e875bda7fe9cab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/1.jpg not downloaded yet
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59069f6d0>
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2525f819-9178-5eff-9012-2284321150ba/2525f819-9178-5eff-9012-2284321150ba_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe1d10d16e9d4418b9410ad1997973854%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/1.jpg saved to cache
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2525f819-9178-5eff-9012-2284321150ba
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fab210>
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2525f819-9178-5eff-9012-2284321150ba/2525f819-9178-5eff-9012-2284321150ba_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe1d10d16e9d4418b9410ad1997973854%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/3.jpg saved to cache
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2525f819-9178-5eff-9012-2284321150ba
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f31e10>
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2525f819-9178-5eff-9012-2284321150ba/2525f819-9178-5eff-9012-2284321150ba_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe1d10d16e9d4418b9410ad1997973854%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/7.jpg saved to cache
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2525f819-9178-5eff-9012-2284321150ba
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59063e390>
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2525f819-9178-5eff-9012-2284321150ba/2525f819-9178-5eff-9012-2284321150ba_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe1d10d16e9d4418b9410ad1997973854%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/6.jpg saved to cache
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2525f819-9178-5eff-9012-2284321150ba
2026-03-27 16:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3ccdd8dcdacf418081e875bda7fe9cab%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/2.jpg not downloaded yet
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b40210>
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2525f819-9178-5eff-9012-2284321150ba/2525f819-9178-5eff-9012-2284321150ba_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe1d10d16e9d4418b9410ad1997973854%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/2.jpg saved to cache
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2525f819-9178-5eff-9012-2284321150ba
2026-03-27 16:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3ccdd8dcdacf418081e875bda7fe9cab%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/3.jpg not downloaded yet
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dafe50>
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2525f819-9178-5eff-9012-2284321150ba/2525f819-9178-5eff-9012-2284321150ba_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe1d10d16e9d4418b9410ad1997973854%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/8.jpg saved to cache
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2525f819-9178-5eff-9012-2284321150ba
2026-03-27 16:51:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2525f819-9178-5eff-9012-2284321150ba, skipping ID generation
2026-03-27 16:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2525f819-9178-5eff-9012-2284321150ba with scrape type 1
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2525f819-9178-5eff-9012-2284321150ba sending to next pipeline
2026-03-27 16:51:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 2525f819-9178-5eff-9012-2284321150ba, identifier: 1988473
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f63250>
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d576976-0675-5088-a308-71a3dcb0adaf/2d576976-0675-5088-a308-71a3dcb0adaf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70ea1157b197454f8474ee00c2527fc8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/1.jpg saved to cache
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d576976-0675-5088-a308-71a3dcb0adaf
2026-03-27 16:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 2525f819-9178-5eff-9012-2284321150ba with identifier: 1988473
2026-03-27 16:51:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 2525f819-9178-5eff-9012-2284321150ba with identifier: 1988473
2026-03-27 16:51:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 2525f819-9178-5eff-9012-2284321150ba with identifier: 1988473 to the API
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'GRIS ACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '2525f819-9178-5eff-9012-2284321150ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 103445,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2525f819-9178-5eff-9012-2284321150ba/2525f819-9178-5eff-9012-2284321150ba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 445613,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2525f819-9178-5eff-9012-2284321150ba/2525f819-9178-5eff-9012-2284321150ba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 445613,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2525f819-9178-5eff-9012-2284321150ba/2525f819-9178-5eff-9012-2284321150ba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433118,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2525f819-9178-5eff-9012-2284321150ba/2525f819-9178-5eff-9012-2284321150ba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353254,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2525f819-9178-5eff-9012-2284321150ba/2525f819-9178-5eff-9012-2284321150ba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361186,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2525f819-9178-5eff-9012-2284321150ba/2525f819-9178-5eff-9012-2284321150ba_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380325,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2525f819-9178-5eff-9012-2284321150ba/2525f819-9178-5eff-9012-2284321150ba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316765,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2525f819-9178-5eff-9012-2284321150ba/2525f819-9178-5eff-9012-2284321150ba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319566,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e1d10d16e9d4418b9410ad1997973854/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-25',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 1.5 BlueHDi 100ch S&S Feel Business E6.d',
'transmission': 'manual',
'trim': 'C3 1.5 BlueHDi 100ch S&S Feel Business E6.d',
'vin': None,
'year': 2021}
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988473%27 HTTP/1.1" 200 None
2026-03-27 16:51:49 [ayvens.fr] INFO: Saving data for 1988473: {'created_time': 1774630309.944003, 'last_price_update_time': 1774630309.944018, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988473') HTTP/1.1" 204 0
2026-03-27 16:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3ccdd8dcdacf418081e875bda7fe9cab%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/4.jpg not downloaded yet
2026-03-27 16:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b23390>
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d576976-0675-5088-a308-71a3dcb0adaf/2d576976-0675-5088-a308-71a3dcb0adaf_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70ea1157b197454f8474ee00c2527fc8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/2.jpg saved to cache
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d576976-0675-5088-a308-71a3dcb0adaf
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df5990>
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d576976-0675-5088-a308-71a3dcb0adaf/2d576976-0675-5088-a308-71a3dcb0adaf_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70ea1157b197454f8474ee00c2527fc8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/4.jpg saved to cache
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d576976-0675-5088-a308-71a3dcb0adaf
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910a2a50>
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d576976-0675-5088-a308-71a3dcb0adaf/2d576976-0675-5088-a308-71a3dcb0adaf_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70ea1157b197454f8474ee00c2527fc8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/3.jpg saved to cache
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d576976-0675-5088-a308-71a3dcb0adaf
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3ccdd8dcdacf418081e875bda7fe9cab%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/5.jpg not downloaded yet
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f62490>
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d576976-0675-5088-a308-71a3dcb0adaf/2d576976-0675-5088-a308-71a3dcb0adaf_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70ea1157b197454f8474ee00c2527fc8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/5.jpg saved to cache
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d576976-0675-5088-a308-71a3dcb0adaf
2026-03-27 16:51:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3ccdd8dcdacf418081e875bda7fe9cab%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/6.jpg not downloaded yet
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590eff6d0>
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d576976-0675-5088-a308-71a3dcb0adaf/2d576976-0675-5088-a308-71a3dcb0adaf_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70ea1157b197454f8474ee00c2527fc8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/7.jpg saved to cache
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d576976-0675-5088-a308-71a3dcb0adaf
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dff490>
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d576976-0675-5088-a308-71a3dcb0adaf/2d576976-0675-5088-a308-71a3dcb0adaf_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70ea1157b197454f8474ee00c2527fc8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/6.jpg saved to cache
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d576976-0675-5088-a308-71a3dcb0adaf
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3ccdd8dcdacf418081e875bda7fe9cab%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/7.jpg not downloaded yet
2026-03-27 16:51:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906696d0>
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d576976-0675-5088-a308-71a3dcb0adaf/2d576976-0675-5088-a308-71a3dcb0adaf_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F70ea1157b197454f8474ee00c2527fc8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/8.jpg saved to cache
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d576976-0675-5088-a308-71a3dcb0adaf
2026-03-27 16:51:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d576976-0675-5088-a308-71a3dcb0adaf, skipping ID generation
2026-03-27 16:51:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d576976-0675-5088-a308-71a3dcb0adaf with scrape type 1
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d576976-0675-5088-a308-71a3dcb0adaf sending to next pipeline
2026-03-27 16:51:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 2d576976-0675-5088-a308-71a3dcb0adaf, identifier: 1988474
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d400d0>
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c8d464-a245-5503-a528-344787d1df0b/a0c8d464-a245-5503-a528-344787d1df0b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3ccdd8dcdacf418081e875bda7fe9cab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/1.jpg saved to cache
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0c8d464-a245-5503-a528-344787d1df0b
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3ccdd8dcdacf418081e875bda7fe9cab%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/8.jpg not downloaded yet
2026-03-27 16:51:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 2d576976-0675-5088-a308-71a3dcb0adaf with identifier: 1988474
2026-03-27 16:51:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 2d576976-0675-5088-a308-71a3dcb0adaf with identifier: 1988474
2026-03-27 16:51:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 2d576976-0675-5088-a308-71a3dcb0adaf with identifier: 1988474 to the API
2026-03-27 16:51:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '2d576976-0675-5088-a308-71a3dcb0adaf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 100049,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d576976-0675-5088-a308-71a3dcb0adaf/2d576976-0675-5088-a308-71a3dcb0adaf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298644,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d576976-0675-5088-a308-71a3dcb0adaf/2d576976-0675-5088-a308-71a3dcb0adaf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298644,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d576976-0675-5088-a308-71a3dcb0adaf/2d576976-0675-5088-a308-71a3dcb0adaf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336544,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d576976-0675-5088-a308-71a3dcb0adaf/2d576976-0675-5088-a308-71a3dcb0adaf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243868,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d576976-0675-5088-a308-71a3dcb0adaf/2d576976-0675-5088-a308-71a3dcb0adaf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410813,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d576976-0675-5088-a308-71a3dcb0adaf/2d576976-0675-5088-a308-71a3dcb0adaf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282434,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d576976-0675-5088-a308-71a3dcb0adaf/2d576976-0675-5088-a308-71a3dcb0adaf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251142,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d576976-0675-5088-a308-71a3dcb0adaf/2d576976-0675-5088-a308-71a3dcb0adaf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300313,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/70ea1157b197454f8474ee00c2527fc8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-22',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.5 BlueHDi 110ch S&S Active',
'transmission': 'manual',
'trim': '2008 1.5 BlueHDi 110ch S&S Active',
'vin': None,
'year': 2022}
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988474%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [ayvens.fr] INFO: Saving data for 1988474: {'created_time': 1774630311.104497, 'last_price_update_time': 1774630311.104508, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988474') HTTP/1.1" 204 0
2026-03-27 16:51:51 [ayvens.fr] INFO: Found listing with ID: 1988476
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988476%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [ayvens.fr] INFO: Scrape type for 1988476: 1
2026-03-27 16:51:51 [ayvens.fr] INFO: Extracting data for car ID: 1988476
2026-03-27 16:51:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97cb6530-98f9-5f76-a849-c52c15fcb331 with identifier: 1988476
2026-03-27 16:51:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97cb6530-98f9-5f76-a849-c52c15fcb331 with scrape type 1
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 97cb6530-98f9-5f76-a849-c52c15fcb331
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa5d94c656043442ba3be345084ec1892%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/1.jpg not downloaded yet
2026-03-27 16:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b2bc10>
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c8d464-a245-5503-a528-344787d1df0b/a0c8d464-a245-5503-a528-344787d1df0b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3ccdd8dcdacf418081e875bda7fe9cab%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/2.jpg saved to cache
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0c8d464-a245-5503-a528-344787d1df0b
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa5d94c656043442ba3be345084ec1892%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/2.jpg not downloaded yet
2026-03-27 16:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa5d94c656043442ba3be345084ec1892%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/3.jpg not downloaded yet
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa5d94c656043442ba3be345084ec1892%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/4.jpg not downloaded yet
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa5d94c656043442ba3be345084ec1892%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/5.jpg not downloaded yet
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa5d94c656043442ba3be345084ec1892%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/6.jpg not downloaded yet
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59064f790>
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c8d464-a245-5503-a528-344787d1df0b/a0c8d464-a245-5503-a528-344787d1df0b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3ccdd8dcdacf418081e875bda7fe9cab%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/3.jpg saved to cache
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0c8d464-a245-5503-a528-344787d1df0b
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df6710>
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c8d464-a245-5503-a528-344787d1df0b/a0c8d464-a245-5503-a528-344787d1df0b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3ccdd8dcdacf418081e875bda7fe9cab%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/4.jpg saved to cache
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0c8d464-a245-5503-a528-344787d1df0b
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa5d94c656043442ba3be345084ec1892%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/7.jpg not downloaded yet
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa5d94c656043442ba3be345084ec1892%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/8.jpg not downloaded yet
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904d4690>
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c8d464-a245-5503-a528-344787d1df0b/a0c8d464-a245-5503-a528-344787d1df0b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3ccdd8dcdacf418081e875bda7fe9cab%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/5.jpg saved to cache
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0c8d464-a245-5503-a528-344787d1df0b
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590677dd0>
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c8d464-a245-5503-a528-344787d1df0b/a0c8d464-a245-5503-a528-344787d1df0b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3ccdd8dcdacf418081e875bda7fe9cab%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/6.jpg saved to cache
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0c8d464-a245-5503-a528-344787d1df0b
2026-03-27 16:51:51 [ayvens.fr] INFO: Found listing with ID: 1988477
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988477%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [ayvens.fr] INFO: Scrape type for 1988477: 1
2026-03-27 16:51:51 [ayvens.fr] INFO: Extracting data for car ID: 1988477
2026-03-27 16:51:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6920f032-dbcc-54cb-bb5e-26b45dd93b58 with identifier: 1988477
2026-03-27 16:51:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6920f032-dbcc-54cb-bb5e-26b45dd93b58 with scrape type 1
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6920f032-dbcc-54cb-bb5e-26b45dd93b58
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fe09f68f7ab294d7fa2cb5d9beab0e788%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/1.jpg not downloaded yet
2026-03-27 16:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fe09f68f7ab294d7fa2cb5d9beab0e788%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/2.jpg not downloaded yet
2026-03-27 16:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fe09f68f7ab294d7fa2cb5d9beab0e788%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/3.jpg not downloaded yet
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fe09f68f7ab294d7fa2cb5d9beab0e788%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/4.jpg not downloaded yet
2026-03-27 16:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fe09f68f7ab294d7fa2cb5d9beab0e788%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/5.jpg not downloaded yet
2026-03-27 16:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fe09f68f7ab294d7fa2cb5d9beab0e788%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/6.jpg not downloaded yet
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fe09f68f7ab294d7fa2cb5d9beab0e788%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/7.jpg not downloaded yet
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fe09f68f7ab294d7fa2cb5d9beab0e788%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/8.jpg not downloaded yet
2026-03-27 16:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:51 [ayvens.fr] INFO: Found listing with ID: 1988478
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988478%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [ayvens.fr] INFO: Scrape type for 1988478: 1
2026-03-27 16:51:51 [ayvens.fr] INFO: Extracting data for car ID: 1988478
2026-03-27 16:51:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf8b5abd-5363-52d3-bd81-e4f153f83682 with identifier: 1988478
2026-03-27 16:51:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf8b5abd-5363-52d3-bd81-e4f153f83682 with scrape type 1
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item bf8b5abd-5363-52d3-bd81-e4f153f83682
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F247a6fd5c6514f5fa1a33c8834a6020b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/1.jpg not downloaded yet
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b1aa50>
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c8d464-a245-5503-a528-344787d1df0b/a0c8d464-a245-5503-a528-344787d1df0b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3ccdd8dcdacf418081e875bda7fe9cab%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/8.jpg saved to cache
2026-03-27 16:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0c8d464-a245-5503-a528-344787d1df0b
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abdc50>
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c8d464-a245-5503-a528-344787d1df0b/a0c8d464-a245-5503-a528-344787d1df0b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F3ccdd8dcdacf418081e875bda7fe9cab%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/7.jpg saved to cache
2026-03-27 16:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0c8d464-a245-5503-a528-344787d1df0b
2026-03-27 16:51:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0c8d464-a245-5503-a528-344787d1df0b, skipping ID generation
2026-03-27 16:51:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0c8d464-a245-5503-a528-344787d1df0b with scrape type 1
2026-03-27 16:51:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0c8d464-a245-5503-a528-344787d1df0b sending to next pipeline
2026-03-27 16:51:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a0c8d464-a245-5503-a528-344787d1df0b, identifier: 1988475
2026-03-27 16:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c1cd0>
2026-03-27 16:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97cb6530-98f9-5f76-a849-c52c15fcb331/97cb6530-98f9-5f76-a849-c52c15fcb331_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa5d94c656043442ba3be345084ec1892%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/2.jpg saved to cache
2026-03-27 16:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97cb6530-98f9-5f76-a849-c52c15fcb331
2026-03-27 16:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066f410>
2026-03-27 16:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97cb6530-98f9-5f76-a849-c52c15fcb331/97cb6530-98f9-5f76-a849-c52c15fcb331_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa5d94c656043442ba3be345084ec1892%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/1.jpg saved to cache
2026-03-27 16:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97cb6530-98f9-5f76-a849-c52c15fcb331
2026-03-27 16:51:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a0c8d464-a245-5503-a528-344787d1df0b with identifier: 1988475
2026-03-27 16:51:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a0c8d464-a245-5503-a528-344787d1df0b with identifier: 1988475
2026-03-27 16:51:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a0c8d464-a245-5503-a528-344787d1df0b with identifier: 1988475 to the API
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'a0c8d464-a245-5503-a528-344787d1df0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 37547,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c8d464-a245-5503-a528-344787d1df0b/a0c8d464-a245-5503-a528-344787d1df0b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320689,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c8d464-a245-5503-a528-344787d1df0b/a0c8d464-a245-5503-a528-344787d1df0b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320689,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c8d464-a245-5503-a528-344787d1df0b/a0c8d464-a245-5503-a528-344787d1df0b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332633,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c8d464-a245-5503-a528-344787d1df0b/a0c8d464-a245-5503-a528-344787d1df0b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315208,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c8d464-a245-5503-a528-344787d1df0b/a0c8d464-a245-5503-a528-344787d1df0b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372823,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c8d464-a245-5503-a528-344787d1df0b/a0c8d464-a245-5503-a528-344787d1df0b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319847,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c8d464-a245-5503-a528-344787d1df0b/a0c8d464-a245-5503-a528-344787d1df0b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358039,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c8d464-a245-5503-a528-344787d1df0b/a0c8d464-a245-5503-a528-344787d1df0b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377308,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/3ccdd8dcdacf418081e875bda7fe9cab/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-01',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch S&S Active Business',
'transmission': 'manual',
'trim': '3008 1.2 PureTech 130ch S&S Active Business',
'vin': None,
'year': 2021}
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988475%27 HTTP/1.1" 200 None
2026-03-27 16:51:52 [ayvens.fr] INFO: Saving data for 1988475: {'created_time': 1774630312.726717, 'last_price_update_time': 1774630312.726733, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988475') HTTP/1.1" 204 0
2026-03-27 16:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F247a6fd5c6514f5fa1a33c8834a6020b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/2.jpg not downloaded yet
2026-03-27 16:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe08d0>
2026-03-27 16:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97cb6530-98f9-5f76-a849-c52c15fcb331/97cb6530-98f9-5f76-a849-c52c15fcb331_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa5d94c656043442ba3be345084ec1892%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/4.jpg saved to cache
2026-03-27 16:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97cb6530-98f9-5f76-a849-c52c15fcb331
2026-03-27 16:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b500d0>
2026-03-27 16:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97cb6530-98f9-5f76-a849-c52c15fcb331/97cb6530-98f9-5f76-a849-c52c15fcb331_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa5d94c656043442ba3be345084ec1892%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/3.jpg saved to cache
2026-03-27 16:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97cb6530-98f9-5f76-a849-c52c15fcb331
2026-03-27 16:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F247a6fd5c6514f5fa1a33c8834a6020b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/3.jpg not downloaded yet
2026-03-27 16:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe2050>
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97cb6530-98f9-5f76-a849-c52c15fcb331/97cb6530-98f9-5f76-a849-c52c15fcb331_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa5d94c656043442ba3be345084ec1892%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/5.jpg saved to cache
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97cb6530-98f9-5f76-a849-c52c15fcb331
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b06e10>
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97cb6530-98f9-5f76-a849-c52c15fcb331/97cb6530-98f9-5f76-a849-c52c15fcb331_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa5d94c656043442ba3be345084ec1892%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/6.jpg saved to cache
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97cb6530-98f9-5f76-a849-c52c15fcb331
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590db8950>
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97cb6530-98f9-5f76-a849-c52c15fcb331/97cb6530-98f9-5f76-a849-c52c15fcb331_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa5d94c656043442ba3be345084ec1892%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/7.jpg saved to cache
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97cb6530-98f9-5f76-a849-c52c15fcb331
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4ebd0>
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6920f032-dbcc-54cb-bb5e-26b45dd93b58/6920f032-dbcc-54cb-bb5e-26b45dd93b58_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fe09f68f7ab294d7fa2cb5d9beab0e788%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/1.jpg saved to cache
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6920f032-dbcc-54cb-bb5e-26b45dd93b58
2026-03-27 16:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F247a6fd5c6514f5fa1a33c8834a6020b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/4.jpg not downloaded yet
2026-03-27 16:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F247a6fd5c6514f5fa1a33c8834a6020b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/5.jpg not downloaded yet
2026-03-27 16:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906940d0>
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6920f032-dbcc-54cb-bb5e-26b45dd93b58/6920f032-dbcc-54cb-bb5e-26b45dd93b58_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fe09f68f7ab294d7fa2cb5d9beab0e788%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/2.jpg saved to cache
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6920f032-dbcc-54cb-bb5e-26b45dd93b58
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068de50>
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6920f032-dbcc-54cb-bb5e-26b45dd93b58/6920f032-dbcc-54cb-bb5e-26b45dd93b58_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fe09f68f7ab294d7fa2cb5d9beab0e788%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/7.jpg saved to cache
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6920f032-dbcc-54cb-bb5e-26b45dd93b58
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F247a6fd5c6514f5fa1a33c8834a6020b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/6.jpg not downloaded yet
2026-03-27 16:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F247a6fd5c6514f5fa1a33c8834a6020b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/7.jpg not downloaded yet
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d0bd0>
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6920f032-dbcc-54cb-bb5e-26b45dd93b58/6920f032-dbcc-54cb-bb5e-26b45dd93b58_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fe09f68f7ab294d7fa2cb5d9beab0e788%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/4.jpg saved to cache
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6920f032-dbcc-54cb-bb5e-26b45dd93b58
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591002210>
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6920f032-dbcc-54cb-bb5e-26b45dd93b58/6920f032-dbcc-54cb-bb5e-26b45dd93b58_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fe09f68f7ab294d7fa2cb5d9beab0e788%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/5.jpg saved to cache
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6920f032-dbcc-54cb-bb5e-26b45dd93b58
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066af10>
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6920f032-dbcc-54cb-bb5e-26b45dd93b58/6920f032-dbcc-54cb-bb5e-26b45dd93b58_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fe09f68f7ab294d7fa2cb5d9beab0e788%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/3.jpg saved to cache
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6920f032-dbcc-54cb-bb5e-26b45dd93b58
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fca110>
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6920f032-dbcc-54cb-bb5e-26b45dd93b58/6920f032-dbcc-54cb-bb5e-26b45dd93b58_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fe09f68f7ab294d7fa2cb5d9beab0e788%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/6.jpg saved to cache
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6920f032-dbcc-54cb-bb5e-26b45dd93b58
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590592c90>
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97cb6530-98f9-5f76-a849-c52c15fcb331/97cb6530-98f9-5f76-a849-c52c15fcb331_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa5d94c656043442ba3be345084ec1892%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/8.jpg saved to cache
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97cb6530-98f9-5f76-a849-c52c15fcb331
2026-03-27 16:51:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97cb6530-98f9-5f76-a849-c52c15fcb331, skipping ID generation
2026-03-27 16:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97cb6530-98f9-5f76-a849-c52c15fcb331 with scrape type 1
2026-03-27 16:51:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97cb6530-98f9-5f76-a849-c52c15fcb331 sending to next pipeline
2026-03-27 16:51:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 97cb6530-98f9-5f76-a849-c52c15fcb331, identifier: 1988476
2026-03-27 16:51:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 97cb6530-98f9-5f76-a849-c52c15fcb331 with identifier: 1988476
2026-03-27 16:51:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 97cb6530-98f9-5f76-a849-c52c15fcb331 with identifier: 1988476
2026-03-27 16:51:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 97cb6530-98f9-5f76-a849-c52c15fcb331 with identifier: 1988476 to the API
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '97cb6530-98f9-5f76-a849-c52c15fcb331',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 76195,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97cb6530-98f9-5f76-a849-c52c15fcb331/97cb6530-98f9-5f76-a849-c52c15fcb331_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97cb6530-98f9-5f76-a849-c52c15fcb331/97cb6530-98f9-5f76-a849-c52c15fcb331_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97cb6530-98f9-5f76-a849-c52c15fcb331/97cb6530-98f9-5f76-a849-c52c15fcb331_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291094,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97cb6530-98f9-5f76-a849-c52c15fcb331/97cb6530-98f9-5f76-a849-c52c15fcb331_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321660,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97cb6530-98f9-5f76-a849-c52c15fcb331/97cb6530-98f9-5f76-a849-c52c15fcb331_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375777,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97cb6530-98f9-5f76-a849-c52c15fcb331/97cb6530-98f9-5f76-a849-c52c15fcb331_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325604,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97cb6530-98f9-5f76-a849-c52c15fcb331/97cb6530-98f9-5f76-a849-c52c15fcb331_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285009,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97cb6530-98f9-5f76-a849-c52c15fcb331/97cb6530-98f9-5f76-a849-c52c15fcb331_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 494255,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a5d94c656043442ba3be345084ec1892/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-25',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 SW 308 SW 1.5 BlueHDi 130ch S&S Active Business',
'transmission': 'manual',
'trim': '308 SW 1.5 BlueHDi 130ch S&S Active Business',
'vin': None,
'year': 2021}
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988476%27 HTTP/1.1" 200 None
2026-03-27 16:51:54 [ayvens.fr] INFO: Saving data for 1988476: {'created_time': 1774630314.378996, 'last_price_update_time': 1774630314.379008, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988476') HTTP/1.1" 204 0
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F247a6fd5c6514f5fa1a33c8834a6020b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/8.jpg not downloaded yet
2026-03-27 16:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7e510>
2026-03-27 16:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6920f032-dbcc-54cb-bb5e-26b45dd93b58/6920f032-dbcc-54cb-bb5e-26b45dd93b58_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fe09f68f7ab294d7fa2cb5d9beab0e788%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/8.jpg saved to cache
2026-03-27 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6920f032-dbcc-54cb-bb5e-26b45dd93b58
2026-03-27 16:51:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6920f032-dbcc-54cb-bb5e-26b45dd93b58, skipping ID generation
2026-03-27 16:51:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6920f032-dbcc-54cb-bb5e-26b45dd93b58 with scrape type 1
2026-03-27 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6920f032-dbcc-54cb-bb5e-26b45dd93b58 sending to next pipeline
2026-03-27 16:51:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6920f032-dbcc-54cb-bb5e-26b45dd93b58, identifier: 1988477
2026-03-27 16:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590694450>
2026-03-27 16:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8b5abd-5363-52d3-bd81-e4f153f83682/bf8b5abd-5363-52d3-bd81-e4f153f83682_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F247a6fd5c6514f5fa1a33c8834a6020b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/1.jpg saved to cache
2026-03-27 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf8b5abd-5363-52d3-bd81-e4f153f83682
2026-03-27 16:51:54 [ayvens.fr] INFO: Found listing with ID: 1988479
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988479%27 HTTP/1.1" 200 None
2026-03-27 16:51:54 [ayvens.fr] INFO: Scrape type for 1988479: 1
2026-03-27 16:51:54 [ayvens.fr] INFO: Extracting data for car ID: 1988479
2026-03-27 16:51:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df9c5491-5e22-50f0-856e-477a225a4f72 with identifier: 1988479
2026-03-27 16:51:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df9c5491-5e22-50f0-856e-477a225a4f72 with scrape type 1
2026-03-27 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item df9c5491-5e22-50f0-856e-477a225a4f72
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F841147726cb74d0592a6db998d3a405f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/1.jpg not downloaded yet
2026-03-27 16:51:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6920f032-dbcc-54cb-bb5e-26b45dd93b58 with identifier: 1988477
2026-03-27 16:51:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6920f032-dbcc-54cb-bb5e-26b45dd93b58 with identifier: 1988477
2026-03-27 16:51:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6920f032-dbcc-54cb-bb5e-26b45dd93b58 with identifier: 1988477 to the API
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '6920f032-dbcc-54cb-bb5e-26b45dd93b58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'MOKKA',
'odometer': 58704,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6920f032-dbcc-54cb-bb5e-26b45dd93b58/6920f032-dbcc-54cb-bb5e-26b45dd93b58_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6920f032-dbcc-54cb-bb5e-26b45dd93b58/6920f032-dbcc-54cb-bb5e-26b45dd93b58_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6920f032-dbcc-54cb-bb5e-26b45dd93b58/6920f032-dbcc-54cb-bb5e-26b45dd93b58_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357963,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6920f032-dbcc-54cb-bb5e-26b45dd93b58/6920f032-dbcc-54cb-bb5e-26b45dd93b58_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319403,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6920f032-dbcc-54cb-bb5e-26b45dd93b58/6920f032-dbcc-54cb-bb5e-26b45dd93b58_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364252,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6920f032-dbcc-54cb-bb5e-26b45dd93b58/6920f032-dbcc-54cb-bb5e-26b45dd93b58_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331033,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6920f032-dbcc-54cb-bb5e-26b45dd93b58/6920f032-dbcc-54cb-bb5e-26b45dd93b58_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186528,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6920f032-dbcc-54cb-bb5e-26b45dd93b58/6920f032-dbcc-54cb-bb5e-26b45dd93b58_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333657,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/e09f68f7ab294d7fa2cb5d9beab0e788/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-08',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL MOKKA Mokka 1.5 D 110ch GS Line',
'transmission': 'manual',
'trim': 'Mokka 1.5 D 110ch GS Line',
'vin': None,
'year': 2021}
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988477%27 HTTP/1.1" 200 None
2026-03-27 16:51:55 [ayvens.fr] INFO: Saving data for 1988477: {'created_time': 1774630315.051346, 'last_price_update_time': 1774630315.051357, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988477') HTTP/1.1" 204 0
2026-03-27 16:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F841147726cb74d0592a6db998d3a405f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/2.jpg not downloaded yet
2026-03-27 16:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F841147726cb74d0592a6db998d3a405f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/3.jpg not downloaded yet
2026-03-27 16:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F841147726cb74d0592a6db998d3a405f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/4.jpg not downloaded yet
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F841147726cb74d0592a6db998d3a405f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/5.jpg not downloaded yet
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F841147726cb74d0592a6db998d3a405f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/6.jpg not downloaded yet
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F841147726cb74d0592a6db998d3a405f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/7.jpg not downloaded yet
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F841147726cb74d0592a6db998d3a405f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/8.jpg not downloaded yet
2026-03-27 16:51:55 [ayvens.fr] INFO: Found listing with ID: 1988480
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988480%27 HTTP/1.1" 200 None
2026-03-27 16:51:55 [ayvens.fr] INFO: Scrape type for 1988480: 1
2026-03-27 16:51:55 [ayvens.fr] INFO: Extracting data for car ID: 1988480
2026-03-27 16:51:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 018f690a-4dc2-5d0e-b118-494bd8ba9911 with identifier: 1988480
2026-03-27 16:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 018f690a-4dc2-5d0e-b118-494bd8ba9911 with scrape type 1
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 018f690a-4dc2-5d0e-b118-494bd8ba9911
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fba7c67b834184dc2ba65ef428d088570%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/1.jpg not downloaded yet
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f33d50>
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8b5abd-5363-52d3-bd81-e4f153f83682/bf8b5abd-5363-52d3-bd81-e4f153f83682_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F247a6fd5c6514f5fa1a33c8834a6020b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/2.jpg saved to cache
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf8b5abd-5363-52d3-bd81-e4f153f83682
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e2e50>
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8b5abd-5363-52d3-bd81-e4f153f83682/bf8b5abd-5363-52d3-bd81-e4f153f83682_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F247a6fd5c6514f5fa1a33c8834a6020b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/3.jpg saved to cache
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf8b5abd-5363-52d3-bd81-e4f153f83682
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b367d0>
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8b5abd-5363-52d3-bd81-e4f153f83682/bf8b5abd-5363-52d3-bd81-e4f153f83682_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F247a6fd5c6514f5fa1a33c8834a6020b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/4.jpg saved to cache
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf8b5abd-5363-52d3-bd81-e4f153f83682
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fba7c67b834184dc2ba65ef428d088570%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/2.jpg not downloaded yet
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e3e10>
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8b5abd-5363-52d3-bd81-e4f153f83682/bf8b5abd-5363-52d3-bd81-e4f153f83682_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F247a6fd5c6514f5fa1a33c8834a6020b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/5.jpg saved to cache
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf8b5abd-5363-52d3-bd81-e4f153f83682
2026-03-27 16:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fba7c67b834184dc2ba65ef428d088570%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/3.jpg not downloaded yet
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904d5d10>
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8b5abd-5363-52d3-bd81-e4f153f83682/bf8b5abd-5363-52d3-bd81-e4f153f83682_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F247a6fd5c6514f5fa1a33c8834a6020b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/6.jpg saved to cache
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bf8b5abd-5363-52d3-bd81-e4f153f83682
2026-03-27 16:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fba7c67b834184dc2ba65ef428d088570%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/4.jpg not downloaded yet
2026-03-27 16:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fba7c67b834184dc2ba65ef428d088570%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/5.jpg not downloaded yet
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fba7c67b834184dc2ba65ef428d088570%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/6.jpg not downloaded yet
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911b8110>
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8b5abd-5363-52d3-bd81-e4f153f83682/bf8b5abd-5363-52d3-bd81-e4f153f83682_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F247a6fd5c6514f5fa1a33c8834a6020b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/8.jpg saved to cache
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bf8b5abd-5363-52d3-bd81-e4f153f83682
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2fd50>
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8b5abd-5363-52d3-bd81-e4f153f83682/bf8b5abd-5363-52d3-bd81-e4f153f83682_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F247a6fd5c6514f5fa1a33c8834a6020b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/7.jpg saved to cache
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bf8b5abd-5363-52d3-bd81-e4f153f83682
2026-03-27 16:51:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf8b5abd-5363-52d3-bd81-e4f153f83682, skipping ID generation
2026-03-27 16:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf8b5abd-5363-52d3-bd81-e4f153f83682 with scrape type 1
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf8b5abd-5363-52d3-bd81-e4f153f83682 sending to next pipeline
2026-03-27 16:51:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: bf8b5abd-5363-52d3-bd81-e4f153f83682, identifier: 1988478
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fba7c67b834184dc2ba65ef428d088570%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/7.jpg not downloaded yet
2026-03-27 16:51:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: bf8b5abd-5363-52d3-bd81-e4f153f83682 with identifier: 1988478
2026-03-27 16:51:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: bf8b5abd-5363-52d3-bd81-e4f153f83682 with identifier: 1988478
2026-03-27 16:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: bf8b5abd-5363-52d3-bd81-e4f153f83682 with identifier: 1988478 to the API
2026-03-27 16:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 167,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'bf8b5abd-5363-52d3-bd81-e4f153f83682',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC40',
'odometer': 95628,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8b5abd-5363-52d3-bd81-e4f153f83682/bf8b5abd-5363-52d3-bd81-e4f153f83682_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335108,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8b5abd-5363-52d3-bd81-e4f153f83682/bf8b5abd-5363-52d3-bd81-e4f153f83682_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335108,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8b5abd-5363-52d3-bd81-e4f153f83682/bf8b5abd-5363-52d3-bd81-e4f153f83682_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402531,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8b5abd-5363-52d3-bd81-e4f153f83682/bf8b5abd-5363-52d3-bd81-e4f153f83682_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315803,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8b5abd-5363-52d3-bd81-e4f153f83682/bf8b5abd-5363-52d3-bd81-e4f153f83682_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342355,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8b5abd-5363-52d3-bd81-e4f153f83682/bf8b5abd-5363-52d3-bd81-e4f153f83682_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282269,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8b5abd-5363-52d3-bd81-e4f153f83682/bf8b5abd-5363-52d3-bd81-e4f153f83682_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213918,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8b5abd-5363-52d3-bd81-e4f153f83682/bf8b5abd-5363-52d3-bd81-e4f153f83682_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168434,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/247a6fd5c6514f5fa1a33c8834a6020b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-17',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC40 XC40 T3 163ch R-Design Geartronic 8',
'transmission': 'automatic',
'trim': 'XC40 T3 163ch R-Design Geartronic 8',
'vin': None,
'year': 2021}
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988478%27 HTTP/1.1" 200 None
2026-03-27 16:51:56 [ayvens.fr] INFO: Saving data for 1988478: {'created_time': 1774630316.344238, 'last_price_update_time': 1774630316.34425, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988478') HTTP/1.1" 204 0
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fba7c67b834184dc2ba65ef428d088570%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/8.jpg not downloaded yet
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfe050>
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9c5491-5e22-50f0-856e-477a225a4f72/df9c5491-5e22-50f0-856e-477a225a4f72_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F841147726cb74d0592a6db998d3a405f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/3.jpg saved to cache
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df9c5491-5e22-50f0-856e-477a225a4f72
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59120ad90>
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9c5491-5e22-50f0-856e-477a225a4f72/df9c5491-5e22-50f0-856e-477a225a4f72_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F841147726cb74d0592a6db998d3a405f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/4.jpg saved to cache
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df9c5491-5e22-50f0-856e-477a225a4f72
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591106d50>
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9c5491-5e22-50f0-856e-477a225a4f72/df9c5491-5e22-50f0-856e-477a225a4f72_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F841147726cb74d0592a6db998d3a405f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/1.jpg saved to cache
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df9c5491-5e22-50f0-856e-477a225a4f72
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591115e50>
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9c5491-5e22-50f0-856e-477a225a4f72/df9c5491-5e22-50f0-856e-477a225a4f72_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F841147726cb74d0592a6db998d3a405f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/5.jpg saved to cache
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df9c5491-5e22-50f0-856e-477a225a4f72
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6f710>
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9c5491-5e22-50f0-856e-477a225a4f72/df9c5491-5e22-50f0-856e-477a225a4f72_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F841147726cb74d0592a6db998d3a405f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/6.jpg saved to cache
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df9c5491-5e22-50f0-856e-477a225a4f72
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591208cd0>
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9c5491-5e22-50f0-856e-477a225a4f72/df9c5491-5e22-50f0-856e-477a225a4f72_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F841147726cb74d0592a6db998d3a405f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/2.jpg saved to cache
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df9c5491-5e22-50f0-856e-477a225a4f72
2026-03-27 16:51:56 [ayvens.fr] INFO: Found listing with ID: 1988481
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988481%27 HTTP/1.1" 200 None
2026-03-27 16:51:56 [ayvens.fr] INFO: Scrape type for 1988481: 1
2026-03-27 16:51:56 [ayvens.fr] INFO: Extracting data for car ID: 1988481
2026-03-27 16:51:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11901a73-46ae-5bf0-8d0d-cdeeda8eee5c with identifier: 1988481
2026-03-27 16:51:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11901a73-46ae-5bf0-8d0d-cdeeda8eee5c with scrape type 1
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 11901a73-46ae-5bf0-8d0d-cdeeda8eee5c
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1821b67c89bc481e84926ba205f1304c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/1.jpg not downloaded yet
2026-03-27 16:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1821b67c89bc481e84926ba205f1304c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/2.jpg not downloaded yet
2026-03-27 16:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1821b67c89bc481e84926ba205f1304c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/3.jpg not downloaded yet
2026-03-27 16:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1821b67c89bc481e84926ba205f1304c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/4.jpg not downloaded yet
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1821b67c89bc481e84926ba205f1304c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/5.jpg not downloaded yet
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1821b67c89bc481e84926ba205f1304c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/6.jpg not downloaded yet
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1821b67c89bc481e84926ba205f1304c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/7.jpg not downloaded yet
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1821b67c89bc481e84926ba205f1304c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/8.jpg not downloaded yet
2026-03-27 16:51:56 [ayvens.fr] INFO: Found listing with ID: 1988482
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988482%27 HTTP/1.1" 200 None
2026-03-27 16:51:56 [ayvens.fr] INFO: Scrape type for 1988482: 1
2026-03-27 16:51:56 [ayvens.fr] INFO: Extracting data for car ID: 1988482
2026-03-27 16:51:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a1cc07c-5c83-56c3-bafd-778eb545934d with identifier: 1988482
2026-03-27 16:51:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a1cc07c-5c83-56c3-bafd-778eb545934d with scrape type 1
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 9a1cc07c-5c83-56c3-bafd-778eb545934d
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc5a0b2d7b8f4401fa301da167fac2c9c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/1.jpg not downloaded yet
2026-03-27 16:51:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903dcc90>
2026-03-27 16:51:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9c5491-5e22-50f0-856e-477a225a4f72/df9c5491-5e22-50f0-856e-477a225a4f72_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F841147726cb74d0592a6db998d3a405f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/7.jpg saved to cache
2026-03-27 16:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df9c5491-5e22-50f0-856e-477a225a4f72
2026-03-27 16:51:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2fe10>
2026-03-27 16:51:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9c5491-5e22-50f0-856e-477a225a4f72/df9c5491-5e22-50f0-856e-477a225a4f72_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F841147726cb74d0592a6db998d3a405f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/8.jpg saved to cache
2026-03-27 16:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df9c5491-5e22-50f0-856e-477a225a4f72
2026-03-27 16:51:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df9c5491-5e22-50f0-856e-477a225a4f72, skipping ID generation
2026-03-27 16:51:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df9c5491-5e22-50f0-856e-477a225a4f72 with scrape type 1
2026-03-27 16:51:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df9c5491-5e22-50f0-856e-477a225a4f72 sending to next pipeline
2026-03-27 16:51:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: df9c5491-5e22-50f0-856e-477a225a4f72, identifier: 1988479
2026-03-27 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc5a0b2d7b8f4401fa301da167fac2c9c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/2.jpg not downloaded yet
2026-03-27 16:51:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: df9c5491-5e22-50f0-856e-477a225a4f72 with identifier: 1988479
2026-03-27 16:51:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: df9c5491-5e22-50f0-856e-477a225a4f72 with identifier: 1988479
2026-03-27 16:51:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: df9c5491-5e22-50f0-856e-477a225a4f72 with identifier: 1988479 to the API
2026-03-27 16:51:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:51:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:51:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 108,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'df9c5491-5e22-50f0-856e-477a225a4f72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'ARKANA',
'odometer': 52523,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9c5491-5e22-50f0-856e-477a225a4f72/df9c5491-5e22-50f0-856e-477a225a4f72_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342463,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9c5491-5e22-50f0-856e-477a225a4f72/df9c5491-5e22-50f0-856e-477a225a4f72_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342463,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9c5491-5e22-50f0-856e-477a225a4f72/df9c5491-5e22-50f0-856e-477a225a4f72_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311426,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9c5491-5e22-50f0-856e-477a225a4f72/df9c5491-5e22-50f0-856e-477a225a4f72_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313059,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9c5491-5e22-50f0-856e-477a225a4f72/df9c5491-5e22-50f0-856e-477a225a4f72_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386151,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9c5491-5e22-50f0-856e-477a225a4f72/df9c5491-5e22-50f0-856e-477a225a4f72_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365297,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9c5491-5e22-50f0-856e-477a225a4f72/df9c5491-5e22-50f0-856e-477a225a4f72_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276052,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9c5491-5e22-50f0-856e-477a225a4f72/df9c5491-5e22-50f0-856e-477a225a4f72_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383467,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/841147726cb74d0592a6db998d3a405f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-23',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT ARKANA Arkana 1.6 E-Tech 145ch RS Line',
'transmission': 'automatic',
'trim': 'Arkana 1.6 E-Tech 145ch RS Line',
'vin': None,
'year': 2022}
2026-03-27 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988479%27 HTTP/1.1" 200 None
2026-03-27 16:51:58 [ayvens.fr] INFO: Saving data for 1988479: {'created_time': 1774630318.806149, 'last_price_update_time': 1774630318.80616, 'auction_closing_time': 1774969200.0}
2026-03-27 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988479') HTTP/1.1" 204 0
2026-03-27 16:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911ce550>
2026-03-27 16:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_018f690a-4dc2-5d0e-b118-494bd8ba9911/018f690a-4dc2-5d0e-b118-494bd8ba9911_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fba7c67b834184dc2ba65ef428d088570%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/4.jpg saved to cache
2026-03-27 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 018f690a-4dc2-5d0e-b118-494bd8ba9911
2026-03-27 16:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa22d0>
2026-03-27 16:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_018f690a-4dc2-5d0e-b118-494bd8ba9911/018f690a-4dc2-5d0e-b118-494bd8ba9911_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fba7c67b834184dc2ba65ef428d088570%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/1.jpg saved to cache
2026-03-27 16:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 018f690a-4dc2-5d0e-b118-494bd8ba9911
2026-03-27 16:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abb850>
2026-03-27 16:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_018f690a-4dc2-5d0e-b118-494bd8ba9911/018f690a-4dc2-5d0e-b118-494bd8ba9911_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fba7c67b834184dc2ba65ef428d088570%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/3.jpg saved to cache
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 018f690a-4dc2-5d0e-b118-494bd8ba9911
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910d8f50>
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_018f690a-4dc2-5d0e-b118-494bd8ba9911/018f690a-4dc2-5d0e-b118-494bd8ba9911_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fba7c67b834184dc2ba65ef428d088570%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/2.jpg saved to cache
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 018f690a-4dc2-5d0e-b118-494bd8ba9911
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4b310>
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_018f690a-4dc2-5d0e-b118-494bd8ba9911/018f690a-4dc2-5d0e-b118-494bd8ba9911_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fba7c67b834184dc2ba65ef428d088570%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/6.jpg saved to cache
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 018f690a-4dc2-5d0e-b118-494bd8ba9911
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b50390>
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_018f690a-4dc2-5d0e-b118-494bd8ba9911/018f690a-4dc2-5d0e-b118-494bd8ba9911_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fba7c67b834184dc2ba65ef428d088570%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/5.jpg saved to cache
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 018f690a-4dc2-5d0e-b118-494bd8ba9911
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc5a0b2d7b8f4401fa301da167fac2c9c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/3.jpg not downloaded yet
2026-03-27 16:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc5a0b2d7b8f4401fa301da167fac2c9c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/4.jpg not downloaded yet
2026-03-27 16:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc5a0b2d7b8f4401fa301da167fac2c9c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/5.jpg not downloaded yet
2026-03-27 16:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc5a0b2d7b8f4401fa301da167fac2c9c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/6.jpg not downloaded yet
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc5a0b2d7b8f4401fa301da167fac2c9c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/7.jpg not downloaded yet
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc5a0b2d7b8f4401fa301da167fac2c9c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/8.jpg not downloaded yet
2026-03-27 16:51:59 [ayvens.fr] INFO: Found listing with ID: 1988483
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988483%27 HTTP/1.1" 200 None
2026-03-27 16:51:59 [ayvens.fr] INFO: Scrape type for 1988483: 1
2026-03-27 16:51:59 [ayvens.fr] INFO: Extracting data for car ID: 1988483
2026-03-27 16:51:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b32b7030-899f-5369-a550-300f7afd5a6b with identifier: 1988483
2026-03-27 16:51:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b32b7030-899f-5369-a550-300f7afd5a6b with scrape type 1
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b32b7030-899f-5369-a550-300f7afd5a6b
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff0c09d48601d43dcb546dfc7998c4d9d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/1.jpg not downloaded yet
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff0c09d48601d43dcb546dfc7998c4d9d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/2.jpg not downloaded yet
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d80490>
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_018f690a-4dc2-5d0e-b118-494bd8ba9911/018f690a-4dc2-5d0e-b118-494bd8ba9911_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fba7c67b834184dc2ba65ef428d088570%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/7.jpg saved to cache
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 018f690a-4dc2-5d0e-b118-494bd8ba9911
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff0c09d48601d43dcb546dfc7998c4d9d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/3.jpg not downloaded yet
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d795d0>
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_018f690a-4dc2-5d0e-b118-494bd8ba9911/018f690a-4dc2-5d0e-b118-494bd8ba9911_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252Fba7c67b834184dc2ba65ef428d088570%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/8.jpg saved to cache
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 018f690a-4dc2-5d0e-b118-494bd8ba9911
2026-03-27 16:51:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 018f690a-4dc2-5d0e-b118-494bd8ba9911, skipping ID generation
2026-03-27 16:51:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 018f690a-4dc2-5d0e-b118-494bd8ba9911 with scrape type 1
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 018f690a-4dc2-5d0e-b118-494bd8ba9911 sending to next pipeline
2026-03-27 16:51:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 018f690a-4dc2-5d0e-b118-494bd8ba9911, identifier: 1988480
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592c2cc50>
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11901a73-46ae-5bf0-8d0d-cdeeda8eee5c/11901a73-46ae-5bf0-8d0d-cdeeda8eee5c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1821b67c89bc481e84926ba205f1304c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/6.jpg saved to cache
2026-03-27 16:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 11901a73-46ae-5bf0-8d0d-cdeeda8eee5c
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b059d0>
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11901a73-46ae-5bf0-8d0d-cdeeda8eee5c/11901a73-46ae-5bf0-8d0d-cdeeda8eee5c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1821b67c89bc481e84926ba205f1304c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/5.jpg saved to cache
2026-03-27 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 11901a73-46ae-5bf0-8d0d-cdeeda8eee5c
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff0c09d48601d43dcb546dfc7998c4d9d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/4.jpg not downloaded yet
2026-03-27 16:52:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 018f690a-4dc2-5d0e-b118-494bd8ba9911 with identifier: 1988480
2026-03-27 16:52:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 018f690a-4dc2-5d0e-b118-494bd8ba9911 with identifier: 1988480
2026-03-27 16:52:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 018f690a-4dc2-5d0e-b118-494bd8ba9911 with identifier: 1988480 to the API
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 84,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '018f690a-4dc2-5d0e-b118-494bd8ba9911',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS HYBRID',
'odometer': 58989,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_018f690a-4dc2-5d0e-b118-494bd8ba9911/018f690a-4dc2-5d0e-b118-494bd8ba9911_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478541,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_018f690a-4dc2-5d0e-b118-494bd8ba9911/018f690a-4dc2-5d0e-b118-494bd8ba9911_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478541,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_018f690a-4dc2-5d0e-b118-494bd8ba9911/018f690a-4dc2-5d0e-b118-494bd8ba9911_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 495450,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_018f690a-4dc2-5d0e-b118-494bd8ba9911/018f690a-4dc2-5d0e-b118-494bd8ba9911_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453134,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_018f690a-4dc2-5d0e-b118-494bd8ba9911/018f690a-4dc2-5d0e-b118-494bd8ba9911_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410475,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_018f690a-4dc2-5d0e-b118-494bd8ba9911/018f690a-4dc2-5d0e-b118-494bd8ba9911_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375247,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_018f690a-4dc2-5d0e-b118-494bd8ba9911/018f690a-4dc2-5d0e-b118-494bd8ba9911_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300046,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_018f690a-4dc2-5d0e-b118-494bd8ba9911/018f690a-4dc2-5d0e-b118-494bd8ba9911_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302402,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/ba7c67b834184dc2ba65ef428d088570/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-24',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA YARIS HYBRID Yaris 100h France Business 5p',
'transmission': 'automatic',
'trim': 'Yaris 100h France Business 5p',
'vin': None,
'year': 2019}
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988480%27 HTTP/1.1" 200 None
2026-03-27 16:52:00 [ayvens.fr] INFO: Saving data for 1988480: {'created_time': 1774630320.436758, 'last_price_update_time': 1774630320.436769, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988480') HTTP/1.1" 204 0
2026-03-27 16:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff0c09d48601d43dcb546dfc7998c4d9d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/5.jpg not downloaded yet
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b68850>
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11901a73-46ae-5bf0-8d0d-cdeeda8eee5c/11901a73-46ae-5bf0-8d0d-cdeeda8eee5c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1821b67c89bc481e84926ba205f1304c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/1.jpg saved to cache
2026-03-27 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11901a73-46ae-5bf0-8d0d-cdeeda8eee5c
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590621090>
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11901a73-46ae-5bf0-8d0d-cdeeda8eee5c/11901a73-46ae-5bf0-8d0d-cdeeda8eee5c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1821b67c89bc481e84926ba205f1304c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/2.jpg saved to cache
2026-03-27 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 11901a73-46ae-5bf0-8d0d-cdeeda8eee5c
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dbac50>
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11901a73-46ae-5bf0-8d0d-cdeeda8eee5c/11901a73-46ae-5bf0-8d0d-cdeeda8eee5c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1821b67c89bc481e84926ba205f1304c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/4.jpg saved to cache
2026-03-27 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 11901a73-46ae-5bf0-8d0d-cdeeda8eee5c
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b2dd0>
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11901a73-46ae-5bf0-8d0d-cdeeda8eee5c/11901a73-46ae-5bf0-8d0d-cdeeda8eee5c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1821b67c89bc481e84926ba205f1304c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/3.jpg saved to cache
2026-03-27 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 11901a73-46ae-5bf0-8d0d-cdeeda8eee5c
2026-03-27 16:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff0c09d48601d43dcb546dfc7998c4d9d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/6.jpg not downloaded yet
2026-03-27 16:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff0c09d48601d43dcb546dfc7998c4d9d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/7.jpg not downloaded yet
2026-03-27 16:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591482b50>
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11901a73-46ae-5bf0-8d0d-cdeeda8eee5c/11901a73-46ae-5bf0-8d0d-cdeeda8eee5c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1821b67c89bc481e84926ba205f1304c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/7.jpg saved to cache
2026-03-27 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 11901a73-46ae-5bf0-8d0d-cdeeda8eee5c
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d12d0>
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11901a73-46ae-5bf0-8d0d-cdeeda8eee5c/11901a73-46ae-5bf0-8d0d-cdeeda8eee5c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F1821b67c89bc481e84926ba205f1304c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/8.jpg saved to cache
2026-03-27 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 11901a73-46ae-5bf0-8d0d-cdeeda8eee5c
2026-03-27 16:52:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11901a73-46ae-5bf0-8d0d-cdeeda8eee5c, skipping ID generation
2026-03-27 16:52:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11901a73-46ae-5bf0-8d0d-cdeeda8eee5c with scrape type 1
2026-03-27 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11901a73-46ae-5bf0-8d0d-cdeeda8eee5c sending to next pipeline
2026-03-27 16:52:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 11901a73-46ae-5bf0-8d0d-cdeeda8eee5c, identifier: 1988481
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff0c09d48601d43dcb546dfc7998c4d9d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/8.jpg not downloaded yet
2026-03-27 16:52:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 11901a73-46ae-5bf0-8d0d-cdeeda8eee5c with identifier: 1988481
2026-03-27 16:52:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 11901a73-46ae-5bf0-8d0d-cdeeda8eee5c with identifier: 1988481
2026-03-27 16:52:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 11901a73-46ae-5bf0-8d0d-cdeeda8eee5c with identifier: 1988481 to the API
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '11901a73-46ae-5bf0-8d0d-cdeeda8eee5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 117019,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11901a73-46ae-5bf0-8d0d-cdeeda8eee5c/11901a73-46ae-5bf0-8d0d-cdeeda8eee5c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458413,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11901a73-46ae-5bf0-8d0d-cdeeda8eee5c/11901a73-46ae-5bf0-8d0d-cdeeda8eee5c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458413,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11901a73-46ae-5bf0-8d0d-cdeeda8eee5c/11901a73-46ae-5bf0-8d0d-cdeeda8eee5c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425564,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11901a73-46ae-5bf0-8d0d-cdeeda8eee5c/11901a73-46ae-5bf0-8d0d-cdeeda8eee5c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 462810,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11901a73-46ae-5bf0-8d0d-cdeeda8eee5c/11901a73-46ae-5bf0-8d0d-cdeeda8eee5c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347384,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11901a73-46ae-5bf0-8d0d-cdeeda8eee5c/11901a73-46ae-5bf0-8d0d-cdeeda8eee5c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361468,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11901a73-46ae-5bf0-8d0d-cdeeda8eee5c/11901a73-46ae-5bf0-8d0d-cdeeda8eee5c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246802,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11901a73-46ae-5bf0-8d0d-cdeeda8eee5c/11901a73-46ae-5bf0-8d0d-cdeeda8eee5c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226031,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/1821b67c89bc481e84926ba205f1304c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-18',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 230ch HEV GT-Line Premium BVA6 4x2',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 230ch HEV GT-Line Premium BVA6 4x2',
'vin': None,
'year': 2022}
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988481%27 HTTP/1.1" 200 None
2026-03-27 16:52:01 [ayvens.fr] INFO: Saving data for 1988481: {'created_time': 1774630321.330488, 'last_price_update_time': 1774630321.330501, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988481') HTTP/1.1" 204 0
2026-03-27 16:52:01 [ayvens.fr] INFO: Found listing with ID: 1988484
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988484%27 HTTP/1.1" 200 None
2026-03-27 16:52:01 [ayvens.fr] INFO: Scrape type for 1988484: 1
2026-03-27 16:52:01 [ayvens.fr] INFO: Extracting data for car ID: 1988484
2026-03-27 16:52:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e14c72d4-af2d-50a4-962f-b2beb10dd138 with identifier: 1988484
2026-03-27 16:52:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e14c72d4-af2d-50a4-962f-b2beb10dd138 with scrape type 1
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e14c72d4-af2d-50a4-962f-b2beb10dd138
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F30a3b6749e1a4e27b642db90369749a5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/1.jpg not downloaded yet
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe3250>
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1cc07c-5c83-56c3-bafd-778eb545934d/9a1cc07c-5c83-56c3-bafd-778eb545934d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc5a0b2d7b8f4401fa301da167fac2c9c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/4.jpg saved to cache
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a1cc07c-5c83-56c3-bafd-778eb545934d
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b53c10>
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1cc07c-5c83-56c3-bafd-778eb545934d/9a1cc07c-5c83-56c3-bafd-778eb545934d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc5a0b2d7b8f4401fa301da167fac2c9c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/1.jpg saved to cache
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a1cc07c-5c83-56c3-bafd-778eb545934d
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b21c90>
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1cc07c-5c83-56c3-bafd-778eb545934d/9a1cc07c-5c83-56c3-bafd-778eb545934d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc5a0b2d7b8f4401fa301da167fac2c9c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/2.jpg saved to cache
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a1cc07c-5c83-56c3-bafd-778eb545934d
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa3590>
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1cc07c-5c83-56c3-bafd-778eb545934d/9a1cc07c-5c83-56c3-bafd-778eb545934d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc5a0b2d7b8f4401fa301da167fac2c9c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/6.jpg saved to cache
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a1cc07c-5c83-56c3-bafd-778eb545934d
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590518cd0>
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1cc07c-5c83-56c3-bafd-778eb545934d/9a1cc07c-5c83-56c3-bafd-778eb545934d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc5a0b2d7b8f4401fa301da167fac2c9c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/5.jpg saved to cache
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a1cc07c-5c83-56c3-bafd-778eb545934d
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905178d0>
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1cc07c-5c83-56c3-bafd-778eb545934d/9a1cc07c-5c83-56c3-bafd-778eb545934d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc5a0b2d7b8f4401fa301da167fac2c9c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/3.jpg saved to cache
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a1cc07c-5c83-56c3-bafd-778eb545934d
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F30a3b6749e1a4e27b642db90369749a5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/2.jpg not downloaded yet
2026-03-27 16:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F30a3b6749e1a4e27b642db90369749a5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/3.jpg not downloaded yet
2026-03-27 16:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F30a3b6749e1a4e27b642db90369749a5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/4.jpg not downloaded yet
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F30a3b6749e1a4e27b642db90369749a5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/5.jpg not downloaded yet
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F30a3b6749e1a4e27b642db90369749a5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/6.jpg not downloaded yet
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F30a3b6749e1a4e27b642db90369749a5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/7.jpg not downloaded yet
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F30a3b6749e1a4e27b642db90369749a5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/8.jpg not downloaded yet
2026-03-27 16:52:01 [ayvens.fr] INFO: Found listing with ID: 1988485
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988485%27 HTTP/1.1" 200 None
2026-03-27 16:52:01 [ayvens.fr] INFO: Scrape type for 1988485: 1
2026-03-27 16:52:01 [ayvens.fr] INFO: Extracting data for car ID: 1988485
2026-03-27 16:52:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a835300a-c98a-58d5-9923-6582c81bba59 with identifier: 1988485
2026-03-27 16:52:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a835300a-c98a-58d5-9923-6582c81bba59 with scrape type 1
2026-03-27 16:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a835300a-c98a-58d5-9923-6582c81bba59
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd0ea5d7c247f4cb99b98ec0774837f8d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/1.jpg not downloaded yet
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591182850>
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1cc07c-5c83-56c3-bafd-778eb545934d/9a1cc07c-5c83-56c3-bafd-778eb545934d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc5a0b2d7b8f4401fa301da167fac2c9c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/7.jpg saved to cache
2026-03-27 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a1cc07c-5c83-56c3-bafd-778eb545934d
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d6fa90>
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b32b7030-899f-5369-a550-300f7afd5a6b/b32b7030-899f-5369-a550-300f7afd5a6b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff0c09d48601d43dcb546dfc7998c4d9d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/4.jpg saved to cache
2026-03-27 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b32b7030-899f-5369-a550-300f7afd5a6b
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd0ea5d7c247f4cb99b98ec0774837f8d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/2.jpg not downloaded yet
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e07d0>
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b32b7030-899f-5369-a550-300f7afd5a6b/b32b7030-899f-5369-a550-300f7afd5a6b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff0c09d48601d43dcb546dfc7998c4d9d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/3.jpg saved to cache
2026-03-27 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b32b7030-899f-5369-a550-300f7afd5a6b
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b6b1d0>
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b32b7030-899f-5369-a550-300f7afd5a6b/b32b7030-899f-5369-a550-300f7afd5a6b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff0c09d48601d43dcb546dfc7998c4d9d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/2.jpg saved to cache
2026-03-27 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b32b7030-899f-5369-a550-300f7afd5a6b
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df4150>
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1cc07c-5c83-56c3-bafd-778eb545934d/9a1cc07c-5c83-56c3-bafd-778eb545934d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fc5a0b2d7b8f4401fa301da167fac2c9c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/8.jpg saved to cache
2026-03-27 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a1cc07c-5c83-56c3-bafd-778eb545934d
2026-03-27 16:52:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a1cc07c-5c83-56c3-bafd-778eb545934d, skipping ID generation
2026-03-27 16:52:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a1cc07c-5c83-56c3-bafd-778eb545934d with scrape type 1
2026-03-27 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a1cc07c-5c83-56c3-bafd-778eb545934d sending to next pipeline
2026-03-27 16:52:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9a1cc07c-5c83-56c3-bafd-778eb545934d, identifier: 1988482
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59069fad0>
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b32b7030-899f-5369-a550-300f7afd5a6b/b32b7030-899f-5369-a550-300f7afd5a6b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff0c09d48601d43dcb546dfc7998c4d9d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/1.jpg saved to cache
2026-03-27 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b32b7030-899f-5369-a550-300f7afd5a6b
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b50c50>
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b32b7030-899f-5369-a550-300f7afd5a6b/b32b7030-899f-5369-a550-300f7afd5a6b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff0c09d48601d43dcb546dfc7998c4d9d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/5.jpg saved to cache
2026-03-27 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b32b7030-899f-5369-a550-300f7afd5a6b
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df4f90>
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b32b7030-899f-5369-a550-300f7afd5a6b/b32b7030-899f-5369-a550-300f7afd5a6b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff0c09d48601d43dcb546dfc7998c4d9d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/6.jpg saved to cache
2026-03-27 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b32b7030-899f-5369-a550-300f7afd5a6b
2026-03-27 16:52:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd0ea5d7c247f4cb99b98ec0774837f8d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/3.jpg not downloaded yet
2026-03-27 16:52:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9a1cc07c-5c83-56c3-bafd-778eb545934d with identifier: 1988482
2026-03-27 16:52:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:52:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9a1cc07c-5c83-56c3-bafd-778eb545934d with identifier: 1988482
2026-03-27 16:52:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9a1cc07c-5c83-56c3-bafd-778eb545934d with identifier: 1988482 to the API
2026-03-27 16:52:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'GRIS CLAIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '9a1cc07c-5c83-56c3-bafd-778eb545934d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 83825,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1cc07c-5c83-56c3-bafd-778eb545934d/9a1cc07c-5c83-56c3-bafd-778eb545934d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 462554,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1cc07c-5c83-56c3-bafd-778eb545934d/9a1cc07c-5c83-56c3-bafd-778eb545934d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 462554,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1cc07c-5c83-56c3-bafd-778eb545934d/9a1cc07c-5c83-56c3-bafd-778eb545934d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 495478,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1cc07c-5c83-56c3-bafd-778eb545934d/9a1cc07c-5c83-56c3-bafd-778eb545934d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351695,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1cc07c-5c83-56c3-bafd-778eb545934d/9a1cc07c-5c83-56c3-bafd-778eb545934d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401846,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1cc07c-5c83-56c3-bafd-778eb545934d/9a1cc07c-5c83-56c3-bafd-778eb545934d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416864,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1cc07c-5c83-56c3-bafd-778eb545934d/9a1cc07c-5c83-56c3-bafd-778eb545934d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305805,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1cc07c-5c83-56c3-bafd-778eb545934d/9a1cc07c-5c83-56c3-bafd-778eb545934d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496133,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/c5a0b2d7b8f4401fa301da167fac2c9c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-09',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.2 PureTech 100ch S&S Active Business',
'transmission': 'manual',
'trim': '208 1.2 PureTech 100ch S&S Active Business',
'vin': None,
'year': 2021}
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988482%27 HTTP/1.1" 200 None
2026-03-27 16:52:03 [ayvens.fr] INFO: Saving data for 1988482: {'created_time': 1774630323.273656, 'last_price_update_time': 1774630323.273667, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988482') HTTP/1.1" 204 0
2026-03-27 16:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd0ea5d7c247f4cb99b98ec0774837f8d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/4.jpg not downloaded yet
2026-03-27 16:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd0ea5d7c247f4cb99b98ec0774837f8d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/5.jpg not downloaded yet
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905b1c50>
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e14c72d4-af2d-50a4-962f-b2beb10dd138/e14c72d4-af2d-50a4-962f-b2beb10dd138_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F30a3b6749e1a4e27b642db90369749a5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/1.jpg saved to cache
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e14c72d4-af2d-50a4-962f-b2beb10dd138
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd0ea5d7c247f4cb99b98ec0774837f8d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/6.jpg not downloaded yet
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd0ea5d7c247f4cb99b98ec0774837f8d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/7.jpg not downloaded yet
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b2ad90>
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b32b7030-899f-5369-a550-300f7afd5a6b/b32b7030-899f-5369-a550-300f7afd5a6b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff0c09d48601d43dcb546dfc7998c4d9d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/7.jpg saved to cache
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b32b7030-899f-5369-a550-300f7afd5a6b
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b1ab90>
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e14c72d4-af2d-50a4-962f-b2beb10dd138/e14c72d4-af2d-50a4-962f-b2beb10dd138_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F30a3b6749e1a4e27b642db90369749a5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/2.jpg saved to cache
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e14c72d4-af2d-50a4-962f-b2beb10dd138
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd0ea5d7c247f4cb99b98ec0774837f8d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/8.jpg not downloaded yet
2026-03-27 16:52:03 [ayvens.fr] INFO: Found listing with ID: 1988486
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988486%27 HTTP/1.1" 200 None
2026-03-27 16:52:03 [ayvens.fr] INFO: Scrape type for 1988486: 1
2026-03-27 16:52:03 [ayvens.fr] INFO: Extracting data for car ID: 1988486
2026-03-27 16:52:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db82709d-e64d-5f9d-bf96-2b062a02b7e4 with identifier: 1988486
2026-03-27 16:52:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db82709d-e64d-5f9d-bf96-2b062a02b7e4 with scrape type 1
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item db82709d-e64d-5f9d-bf96-2b062a02b7e4
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F73415502bfde472c868a5b9402f27727%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/1.jpg not downloaded yet
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590517c90>
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e14c72d4-af2d-50a4-962f-b2beb10dd138/e14c72d4-af2d-50a4-962f-b2beb10dd138_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F30a3b6749e1a4e27b642db90369749a5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/4.jpg saved to cache
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e14c72d4-af2d-50a4-962f-b2beb10dd138
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590af2f90>
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e14c72d4-af2d-50a4-962f-b2beb10dd138/e14c72d4-af2d-50a4-962f-b2beb10dd138_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F30a3b6749e1a4e27b642db90369749a5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/3.jpg saved to cache
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e14c72d4-af2d-50a4-962f-b2beb10dd138
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591051210>
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e14c72d4-af2d-50a4-962f-b2beb10dd138/e14c72d4-af2d-50a4-962f-b2beb10dd138_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F30a3b6749e1a4e27b642db90369749a5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/6.jpg saved to cache
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e14c72d4-af2d-50a4-962f-b2beb10dd138
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910c73d0>
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b32b7030-899f-5369-a550-300f7afd5a6b/b32b7030-899f-5369-a550-300f7afd5a6b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Ff0c09d48601d43dcb546dfc7998c4d9d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/8.jpg saved to cache
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b32b7030-899f-5369-a550-300f7afd5a6b
2026-03-27 16:52:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b32b7030-899f-5369-a550-300f7afd5a6b, skipping ID generation
2026-03-27 16:52:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b32b7030-899f-5369-a550-300f7afd5a6b with scrape type 1
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b32b7030-899f-5369-a550-300f7afd5a6b sending to next pipeline
2026-03-27 16:52:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b32b7030-899f-5369-a550-300f7afd5a6b, identifier: 1988483
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d77450>
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e14c72d4-af2d-50a4-962f-b2beb10dd138/e14c72d4-af2d-50a4-962f-b2beb10dd138_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F30a3b6749e1a4e27b642db90369749a5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/5.jpg saved to cache
2026-03-27 16:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e14c72d4-af2d-50a4-962f-b2beb10dd138
2026-03-27 16:52:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b32b7030-899f-5369-a550-300f7afd5a6b with identifier: 1988483
2026-03-27 16:52:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b32b7030-899f-5369-a550-300f7afd5a6b with identifier: 1988483
2026-03-27 16:52:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b32b7030-899f-5369-a550-300f7afd5a6b with identifier: 1988483 to the API
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'b32b7030-899f-5369-a550-300f7afd5a6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 66065,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b32b7030-899f-5369-a550-300f7afd5a6b/b32b7030-899f-5369-a550-300f7afd5a6b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 490817,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b32b7030-899f-5369-a550-300f7afd5a6b/b32b7030-899f-5369-a550-300f7afd5a6b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 490817,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b32b7030-899f-5369-a550-300f7afd5a6b/b32b7030-899f-5369-a550-300f7afd5a6b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439868,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b32b7030-899f-5369-a550-300f7afd5a6b/b32b7030-899f-5369-a550-300f7afd5a6b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331962,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b32b7030-899f-5369-a550-300f7afd5a6b/b32b7030-899f-5369-a550-300f7afd5a6b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393850,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b32b7030-899f-5369-a550-300f7afd5a6b/b32b7030-899f-5369-a550-300f7afd5a6b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271543,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b32b7030-899f-5369-a550-300f7afd5a6b/b32b7030-899f-5369-a550-300f7afd5a6b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b32b7030-899f-5369-a550-300f7afd5a6b/b32b7030-899f-5369-a550-300f7afd5a6b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374004,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/f0c09d48601d43dcb546dfc7998c4d9d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-12',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 130ch S&S Allure EAT8',
'transmission': 'automatic',
'trim': '2008 1.2 PureTech 130ch S&S Allure EAT8',
'vin': None,
'year': 2023}
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988483%27 HTTP/1.1" 200 None
2026-03-27 16:52:04 [ayvens.fr] INFO: Saving data for 1988483: {'created_time': 1774630324.34816, 'last_price_update_time': 1774630324.348176, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988483') HTTP/1.1" 204 0
2026-03-27 16:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F73415502bfde472c868a5b9402f27727%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/2.jpg not downloaded yet
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F73415502bfde472c868a5b9402f27727%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/3.jpg not downloaded yet
2026-03-27 16:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F73415502bfde472c868a5b9402f27727%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/4.jpg not downloaded yet
2026-03-27 16:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F73415502bfde472c868a5b9402f27727%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/5.jpg not downloaded yet
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F73415502bfde472c868a5b9402f27727%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/6.jpg not downloaded yet
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F73415502bfde472c868a5b9402f27727%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/7.jpg not downloaded yet
2026-03-27 16:52:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590677d50>
2026-03-27 16:52:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e14c72d4-af2d-50a4-962f-b2beb10dd138/e14c72d4-af2d-50a4-962f-b2beb10dd138_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F30a3b6749e1a4e27b642db90369749a5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/7.jpg saved to cache
2026-03-27 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e14c72d4-af2d-50a4-962f-b2beb10dd138
2026-03-27 16:52:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e8fe10>
2026-03-27 16:52:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e14c72d4-af2d-50a4-962f-b2beb10dd138/e14c72d4-af2d-50a4-962f-b2beb10dd138_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F30a3b6749e1a4e27b642db90369749a5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/8.jpg saved to cache
2026-03-27 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e14c72d4-af2d-50a4-962f-b2beb10dd138
2026-03-27 16:52:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e14c72d4-af2d-50a4-962f-b2beb10dd138, skipping ID generation
2026-03-27 16:52:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e14c72d4-af2d-50a4-962f-b2beb10dd138 with scrape type 1
2026-03-27 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e14c72d4-af2d-50a4-962f-b2beb10dd138 sending to next pipeline
2026-03-27 16:52:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e14c72d4-af2d-50a4-962f-b2beb10dd138, identifier: 1988484
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F73415502bfde472c868a5b9402f27727%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/8.jpg not downloaded yet
2026-03-27 16:52:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e14c72d4-af2d-50a4-962f-b2beb10dd138 with identifier: 1988484
2026-03-27 16:52:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e14c72d4-af2d-50a4-962f-b2beb10dd138 with identifier: 1988484
2026-03-27 16:52:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e14c72d4-af2d-50a4-962f-b2beb10dd138 with identifier: 1988484 to the API
2026-03-27 16:52:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 135,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'e14c72d4-af2d-50a4-962f-b2beb10dd138',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 129009,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e14c72d4-af2d-50a4-962f-b2beb10dd138/e14c72d4-af2d-50a4-962f-b2beb10dd138_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290533,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e14c72d4-af2d-50a4-962f-b2beb10dd138/e14c72d4-af2d-50a4-962f-b2beb10dd138_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290533,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e14c72d4-af2d-50a4-962f-b2beb10dd138/e14c72d4-af2d-50a4-962f-b2beb10dd138_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307254,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e14c72d4-af2d-50a4-962f-b2beb10dd138/e14c72d4-af2d-50a4-962f-b2beb10dd138_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330448,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e14c72d4-af2d-50a4-962f-b2beb10dd138/e14c72d4-af2d-50a4-962f-b2beb10dd138_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350416,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e14c72d4-af2d-50a4-962f-b2beb10dd138/e14c72d4-af2d-50a4-962f-b2beb10dd138_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337561,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e14c72d4-af2d-50a4-962f-b2beb10dd138/e14c72d4-af2d-50a4-962f-b2beb10dd138_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297751,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e14c72d4-af2d-50a4-962f-b2beb10dd138/e14c72d4-af2d-50a4-962f-b2beb10dd138_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306713,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/30a3b6749e1a4e27b642db90369749a5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-16',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '3008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'vin': None,
'year': 2020}
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988484%27 HTTP/1.1" 200 None
2026-03-27 16:52:05 [ayvens.fr] INFO: Saving data for 1988484: {'created_time': 1774630325.115565, 'last_price_update_time': 1774630325.115575, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988484') HTTP/1.1" 204 0
2026-03-27 16:52:05 [ayvens.fr] INFO: Found listing with ID: 1988487
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988487%27 HTTP/1.1" 200 None
2026-03-27 16:52:05 [ayvens.fr] INFO: Scrape type for 1988487: 1
2026-03-27 16:52:05 [ayvens.fr] INFO: Extracting data for car ID: 1988487
2026-03-27 16:52:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8 with identifier: 1988487
2026-03-27 16:52:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8 with scrape type 1
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1878721a51564726995847852aae15fa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/1.jpg not downloaded yet
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1878721a51564726995847852aae15fa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/2.jpg not downloaded yet
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b40ad0>
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a835300a-c98a-58d5-9923-6582c81bba59/a835300a-c98a-58d5-9923-6582c81bba59_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd0ea5d7c247f4cb99b98ec0774837f8d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/4.jpg saved to cache
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a835300a-c98a-58d5-9923-6582c81bba59
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e25d0>
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a835300a-c98a-58d5-9923-6582c81bba59/a835300a-c98a-58d5-9923-6582c81bba59_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd0ea5d7c247f4cb99b98ec0774837f8d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/1.jpg saved to cache
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a835300a-c98a-58d5-9923-6582c81bba59
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904cbd10>
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a835300a-c98a-58d5-9923-6582c81bba59/a835300a-c98a-58d5-9923-6582c81bba59_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd0ea5d7c247f4cb99b98ec0774837f8d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/2.jpg saved to cache
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a835300a-c98a-58d5-9923-6582c81bba59
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d7ac10>
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a835300a-c98a-58d5-9923-6582c81bba59/a835300a-c98a-58d5-9923-6582c81bba59_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd0ea5d7c247f4cb99b98ec0774837f8d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/3.jpg saved to cache
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a835300a-c98a-58d5-9923-6582c81bba59
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068ee90>
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a835300a-c98a-58d5-9923-6582c81bba59/a835300a-c98a-58d5-9923-6582c81bba59_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd0ea5d7c247f4cb99b98ec0774837f8d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/5.jpg saved to cache
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a835300a-c98a-58d5-9923-6582c81bba59
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b68a10>
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a835300a-c98a-58d5-9923-6582c81bba59/a835300a-c98a-58d5-9923-6582c81bba59_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd0ea5d7c247f4cb99b98ec0774837f8d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/6.jpg saved to cache
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a835300a-c98a-58d5-9923-6582c81bba59
2026-03-27 16:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1878721a51564726995847852aae15fa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/3.jpg not downloaded yet
2026-03-27 16:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1878721a51564726995847852aae15fa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/4.jpg not downloaded yet
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1878721a51564726995847852aae15fa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/5.jpg not downloaded yet
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1878721a51564726995847852aae15fa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/6.jpg not downloaded yet
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1878721a51564726995847852aae15fa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/7.jpg not downloaded yet
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1878721a51564726995847852aae15fa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/8.jpg not downloaded yet
2026-03-27 16:52:05 [ayvens.fr] INFO: Found listing with ID: 1988488
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988488%27 HTTP/1.1" 200 None
2026-03-27 16:52:05 [ayvens.fr] INFO: Scrape type for 1988488: 1
2026-03-27 16:52:05 [ayvens.fr] INFO: Extracting data for car ID: 1988488
2026-03-27 16:52:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58bf8976-c218-5f0c-aa7b-805924bd9ed4 with identifier: 1988488
2026-03-27 16:52:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58bf8976-c218-5f0c-aa7b-805924bd9ed4 with scrape type 1
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 58bf8976-c218-5f0c-aa7b-805924bd9ed4
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F60a4f610b67a406bb0910586443a7359%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/1.jpg not downloaded yet
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F60a4f610b67a406bb0910586443a7359%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/2.jpg not downloaded yet
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b766d0>
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db82709d-e64d-5f9d-bf96-2b062a02b7e4/db82709d-e64d-5f9d-bf96-2b062a02b7e4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F73415502bfde472c868a5b9402f27727%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/2.jpg saved to cache
2026-03-27 16:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db82709d-e64d-5f9d-bf96-2b062a02b7e4
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e5450>
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a835300a-c98a-58d5-9923-6582c81bba59/a835300a-c98a-58d5-9923-6582c81bba59_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd0ea5d7c247f4cb99b98ec0774837f8d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/7.jpg saved to cache
2026-03-27 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a835300a-c98a-58d5-9923-6582c81bba59
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591104690>
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db82709d-e64d-5f9d-bf96-2b062a02b7e4/db82709d-e64d-5f9d-bf96-2b062a02b7e4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F73415502bfde472c868a5b9402f27727%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/1.jpg saved to cache
2026-03-27 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db82709d-e64d-5f9d-bf96-2b062a02b7e4
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59102c8d0>
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db82709d-e64d-5f9d-bf96-2b062a02b7e4/db82709d-e64d-5f9d-bf96-2b062a02b7e4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F73415502bfde472c868a5b9402f27727%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/5.jpg saved to cache
2026-03-27 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db82709d-e64d-5f9d-bf96-2b062a02b7e4
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e40d0>
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db82709d-e64d-5f9d-bf96-2b062a02b7e4/db82709d-e64d-5f9d-bf96-2b062a02b7e4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F73415502bfde472c868a5b9402f27727%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/4.jpg saved to cache
2026-03-27 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db82709d-e64d-5f9d-bf96-2b062a02b7e4
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a85d0>
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a835300a-c98a-58d5-9923-6582c81bba59/a835300a-c98a-58d5-9923-6582c81bba59_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252Fd0ea5d7c247f4cb99b98ec0774837f8d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/8.jpg saved to cache
2026-03-27 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a835300a-c98a-58d5-9923-6582c81bba59
2026-03-27 16:52:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a835300a-c98a-58d5-9923-6582c81bba59, skipping ID generation
2026-03-27 16:52:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a835300a-c98a-58d5-9923-6582c81bba59 with scrape type 1
2026-03-27 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a835300a-c98a-58d5-9923-6582c81bba59 sending to next pipeline
2026-03-27 16:52:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a835300a-c98a-58d5-9923-6582c81bba59, identifier: 1988485
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590faa610>
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db82709d-e64d-5f9d-bf96-2b062a02b7e4/db82709d-e64d-5f9d-bf96-2b062a02b7e4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F73415502bfde472c868a5b9402f27727%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/6.jpg saved to cache
2026-03-27 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db82709d-e64d-5f9d-bf96-2b062a02b7e4
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b04650>
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db82709d-e64d-5f9d-bf96-2b062a02b7e4/db82709d-e64d-5f9d-bf96-2b062a02b7e4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F73415502bfde472c868a5b9402f27727%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/3.jpg saved to cache
2026-03-27 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db82709d-e64d-5f9d-bf96-2b062a02b7e4
2026-03-27 16:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F60a4f610b67a406bb0910586443a7359%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/3.jpg not downloaded yet
2026-03-27 16:52:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a835300a-c98a-58d5-9923-6582c81bba59 with identifier: 1988485
2026-03-27 16:52:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a835300a-c98a-58d5-9923-6582c81bba59 with identifier: 1988485
2026-03-27 16:52:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a835300a-c98a-58d5-9923-6582c81bba59 with identifier: 1988485 to the API
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 150,
'color': 'GRIS PLATINE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'a835300a-c98a-58d5-9923-6582c81bba59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'SCENIC',
'odometer': 77058,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a835300a-c98a-58d5-9923-6582c81bba59/a835300a-c98a-58d5-9923-6582c81bba59_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 445636,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a835300a-c98a-58d5-9923-6582c81bba59/a835300a-c98a-58d5-9923-6582c81bba59_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 445636,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a835300a-c98a-58d5-9923-6582c81bba59/a835300a-c98a-58d5-9923-6582c81bba59_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 491695,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a835300a-c98a-58d5-9923-6582c81bba59/a835300a-c98a-58d5-9923-6582c81bba59_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374384,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a835300a-c98a-58d5-9923-6582c81bba59/a835300a-c98a-58d5-9923-6582c81bba59_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446720,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a835300a-c98a-58d5-9923-6582c81bba59/a835300a-c98a-58d5-9923-6582c81bba59_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438728,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a835300a-c98a-58d5-9923-6582c81bba59/a835300a-c98a-58d5-9923-6582c81bba59_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307068,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a835300a-c98a-58d5-9923-6582c81bba59/a835300a-c98a-58d5-9923-6582c81bba59_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428461,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/d0ea5d7c247f4cb99b98ec0774837f8d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-13',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT SCENIC Scenic 1.3 TCe 140ch Intens EDC',
'transmission': 'automatic',
'trim': 'Scenic 1.3 TCe 140ch Intens EDC',
'vin': None,
'year': 2021}
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988485%27 HTTP/1.1" 200 None
2026-03-27 16:52:06 [ayvens.fr] INFO: Saving data for 1988485: {'created_time': 1774630326.88322, 'last_price_update_time': 1774630326.883232, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988485') HTTP/1.1" 204 0
2026-03-27 16:52:06 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at 0 pages/min), scraped 288 items (at 48 items/min)
2026-03-27 16:52:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-27 16:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F60a4f610b67a406bb0910586443a7359%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/4.jpg not downloaded yet
2026-03-27 16:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F60a4f610b67a406bb0910586443a7359%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/5.jpg not downloaded yet
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590644890>
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db82709d-e64d-5f9d-bf96-2b062a02b7e4/db82709d-e64d-5f9d-bf96-2b062a02b7e4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F73415502bfde472c868a5b9402f27727%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/8.jpg saved to cache
2026-03-27 16:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db82709d-e64d-5f9d-bf96-2b062a02b7e4
2026-03-27 16:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F60a4f610b67a406bb0910586443a7359%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/6.jpg not downloaded yet
2026-03-27 16:52:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F60a4f610b67a406bb0910586443a7359%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/7.jpg not downloaded yet
2026-03-27 16:52:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F60a4f610b67a406bb0910586443a7359%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/8.jpg not downloaded yet
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905175d0>
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db82709d-e64d-5f9d-bf96-2b062a02b7e4/db82709d-e64d-5f9d-bf96-2b062a02b7e4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F73415502bfde472c868a5b9402f27727%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/7.jpg saved to cache
2026-03-27 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db82709d-e64d-5f9d-bf96-2b062a02b7e4
2026-03-27 16:52:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db82709d-e64d-5f9d-bf96-2b062a02b7e4, skipping ID generation
2026-03-27 16:52:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db82709d-e64d-5f9d-bf96-2b062a02b7e4 with scrape type 1
2026-03-27 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db82709d-e64d-5f9d-bf96-2b062a02b7e4 sending to next pipeline
2026-03-27 16:52:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: db82709d-e64d-5f9d-bf96-2b062a02b7e4, identifier: 1988486
2026-03-27 16:52:07 [ayvens.fr] INFO: Found listing with ID: 1988489
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988489%27 HTTP/1.1" 200 None
2026-03-27 16:52:07 [ayvens.fr] INFO: Scrape type for 1988489: 1
2026-03-27 16:52:07 [ayvens.fr] INFO: Extracting data for car ID: 1988489
2026-03-27 16:52:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ca3cb72-ff00-58d6-967a-3a5d393b328a with identifier: 1988489
2026-03-27 16:52:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ca3cb72-ff00-58d6-967a-3a5d393b328a with scrape type 1
2026-03-27 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3ca3cb72-ff00-58d6-967a-3a5d393b328a
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F1ff7ba431d594048b56254be0c0941b8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/1.jpg not downloaded yet
2026-03-27 16:52:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: db82709d-e64d-5f9d-bf96-2b062a02b7e4 with identifier: 1988486
2026-03-27 16:52:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: db82709d-e64d-5f9d-bf96-2b062a02b7e4 with identifier: 1988486
2026-03-27 16:52:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: db82709d-e64d-5f9d-bf96-2b062a02b7e4 with identifier: 1988486 to the API
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 92,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'db82709d-e64d-5f9d-bf96-2b062a02b7e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS HYBRID',
'odometer': 37902,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db82709d-e64d-5f9d-bf96-2b062a02b7e4/db82709d-e64d-5f9d-bf96-2b062a02b7e4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389171,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db82709d-e64d-5f9d-bf96-2b062a02b7e4/db82709d-e64d-5f9d-bf96-2b062a02b7e4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389171,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db82709d-e64d-5f9d-bf96-2b062a02b7e4/db82709d-e64d-5f9d-bf96-2b062a02b7e4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 463912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db82709d-e64d-5f9d-bf96-2b062a02b7e4/db82709d-e64d-5f9d-bf96-2b062a02b7e4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386436,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db82709d-e64d-5f9d-bf96-2b062a02b7e4/db82709d-e64d-5f9d-bf96-2b062a02b7e4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 390386,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db82709d-e64d-5f9d-bf96-2b062a02b7e4/db82709d-e64d-5f9d-bf96-2b062a02b7e4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374910,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db82709d-e64d-5f9d-bf96-2b062a02b7e4/db82709d-e64d-5f9d-bf96-2b062a02b7e4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397592,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db82709d-e64d-5f9d-bf96-2b062a02b7e4/db82709d-e64d-5f9d-bf96-2b062a02b7e4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254383,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/73415502bfde472c868a5b9402f27727/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-14',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA YARIS HYBRID Yaris 116h Design 5p',
'transmission': 'automatic',
'trim': 'Yaris 116h Design 5p',
'vin': None,
'year': 2022}
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988486%27 HTTP/1.1" 200 None
2026-03-27 16:52:07 [ayvens.fr] INFO: Saving data for 1988486: {'created_time': 1774630327.55532, 'last_price_update_time': 1774630327.555331, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988486') HTTP/1.1" 204 0
2026-03-27 16:52:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911b8390>
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8/bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1878721a51564726995847852aae15fa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/4.jpg saved to cache
2026-03-27 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d8dd50>
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8/bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1878721a51564726995847852aae15fa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/6.jpg saved to cache
2026-03-27 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F1ff7ba431d594048b56254be0c0941b8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/2.jpg not downloaded yet
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F1ff7ba431d594048b56254be0c0941b8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/3.jpg not downloaded yet
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b2a90>
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8/bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1878721a51564726995847852aae15fa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/1.jpg saved to cache
2026-03-27 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591481210>
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8/bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1878721a51564726995847852aae15fa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/5.jpg saved to cache
2026-03-27 16:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d97f90>
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8/bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1878721a51564726995847852aae15fa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/3.jpg saved to cache
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7ecd0>
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8/bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1878721a51564726995847852aae15fa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/2.jpg saved to cache
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d80bd0>
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8/bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1878721a51564726995847852aae15fa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/7.jpg saved to cache
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8
2026-03-27 16:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F1ff7ba431d594048b56254be0c0941b8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/4.jpg not downloaded yet
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b50f90>
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8/bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F1878721a51564726995847852aae15fa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/8.jpg saved to cache
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8
2026-03-27 16:52:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8, skipping ID generation
2026-03-27 16:52:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8 with scrape type 1
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8 sending to next pipeline
2026-03-27 16:52:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8, identifier: 1988487
2026-03-27 16:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8 with identifier: 1988487
2026-03-27 16:52:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8 with identifier: 1988487
2026-03-27 16:52:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8 with identifier: 1988487 to the API
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C5 AIRCROSS',
'odometer': 106451,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8/bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 506624,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8/bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 506624,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8/bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430444,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8/bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308431,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8/bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303672,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8/bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269119,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8/bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257442,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8/bb77a6a9-7f33-5c9b-ac45-e69ef48b86f8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252698,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/1878721a51564726995847852aae15fa/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C5 AIRCROSS C5 Aircross BlueHDi 130ch S&S Live',
'transmission': 'manual',
'trim': 'C5 Aircross BlueHDi 130ch S&S Live',
'vin': None,
'year': 2022}
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988487%27 HTTP/1.1" 200 None
2026-03-27 16:52:08 [ayvens.fr] INFO: Saving data for 1988487: {'created_time': 1774630328.640677, 'last_price_update_time': 1774630328.640687, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988487') HTTP/1.1" 204 0
2026-03-27 16:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F1ff7ba431d594048b56254be0c0941b8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/5.jpg not downloaded yet
2026-03-27 16:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6f690>
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58bf8976-c218-5f0c-aa7b-805924bd9ed4/58bf8976-c218-5f0c-aa7b-805924bd9ed4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F60a4f610b67a406bb0910586443a7359%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/7.jpg saved to cache
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58bf8976-c218-5f0c-aa7b-805924bd9ed4
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f30090>
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58bf8976-c218-5f0c-aa7b-805924bd9ed4/58bf8976-c218-5f0c-aa7b-805924bd9ed4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F60a4f610b67a406bb0910586443a7359%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/4.jpg saved to cache
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58bf8976-c218-5f0c-aa7b-805924bd9ed4
2026-03-27 16:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F1ff7ba431d594048b56254be0c0941b8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/6.jpg not downloaded yet
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0b950>
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58bf8976-c218-5f0c-aa7b-805924bd9ed4/58bf8976-c218-5f0c-aa7b-805924bd9ed4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F60a4f610b67a406bb0910586443a7359%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/5.jpg saved to cache
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58bf8976-c218-5f0c-aa7b-805924bd9ed4
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f82810>
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58bf8976-c218-5f0c-aa7b-805924bd9ed4/58bf8976-c218-5f0c-aa7b-805924bd9ed4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F60a4f610b67a406bb0910586443a7359%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/6.jpg saved to cache
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58bf8976-c218-5f0c-aa7b-805924bd9ed4
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F1ff7ba431d594048b56254be0c0941b8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/7.jpg not downloaded yet
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590db8350>
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58bf8976-c218-5f0c-aa7b-805924bd9ed4/58bf8976-c218-5f0c-aa7b-805924bd9ed4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F60a4f610b67a406bb0910586443a7359%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/3.jpg saved to cache
2026-03-27 16:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58bf8976-c218-5f0c-aa7b-805924bd9ed4
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c0310>
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58bf8976-c218-5f0c-aa7b-805924bd9ed4/58bf8976-c218-5f0c-aa7b-805924bd9ed4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F60a4f610b67a406bb0910586443a7359%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/1.jpg saved to cache
2026-03-27 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58bf8976-c218-5f0c-aa7b-805924bd9ed4
2026-03-27 16:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b43d50>
2026-03-27 16:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58bf8976-c218-5f0c-aa7b-805924bd9ed4/58bf8976-c218-5f0c-aa7b-805924bd9ed4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F60a4f610b67a406bb0910586443a7359%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/2.jpg saved to cache
2026-03-27 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58bf8976-c218-5f0c-aa7b-805924bd9ed4
2026-03-27 16:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F1ff7ba431d594048b56254be0c0941b8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/8.jpg not downloaded yet
2026-03-27 16:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e16f50>
2026-03-27 16:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58bf8976-c218-5f0c-aa7b-805924bd9ed4/58bf8976-c218-5f0c-aa7b-805924bd9ed4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F60a4f610b67a406bb0910586443a7359%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/8.jpg saved to cache
2026-03-27 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58bf8976-c218-5f0c-aa7b-805924bd9ed4
2026-03-27 16:52:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58bf8976-c218-5f0c-aa7b-805924bd9ed4, skipping ID generation
2026-03-27 16:52:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58bf8976-c218-5f0c-aa7b-805924bd9ed4 with scrape type 1
2026-03-27 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58bf8976-c218-5f0c-aa7b-805924bd9ed4 sending to next pipeline
2026-03-27 16:52:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 58bf8976-c218-5f0c-aa7b-805924bd9ed4, identifier: 1988488
2026-03-27 16:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:09 [ayvens.fr] INFO: Found listing with ID: 1988490
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988490%27 HTTP/1.1" 200 None
2026-03-27 16:52:09 [ayvens.fr] INFO: Scrape type for 1988490: 1
2026-03-27 16:52:09 [ayvens.fr] INFO: Extracting data for car ID: 1988490
2026-03-27 16:52:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc9eb717-472c-5acb-be63-4b399309b8ac with identifier: 1988490
2026-03-27 16:52:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc9eb717-472c-5acb-be63-4b399309b8ac with scrape type 1
2026-03-27 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc9eb717-472c-5acb-be63-4b399309b8ac
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F33c4a19e017e41fc9c7578e2edb9317d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/1.jpg not downloaded yet
2026-03-27 16:52:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 58bf8976-c218-5f0c-aa7b-805924bd9ed4 with identifier: 1988488
2026-03-27 16:52:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 58bf8976-c218-5f0c-aa7b-805924bd9ed4 with identifier: 1988488
2026-03-27 16:52:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 58bf8976-c218-5f0c-aa7b-805924bd9ed4 with identifier: 1988488 to the API
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': 'GRIS SQUALE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '58bf8976-c218-5f0c-aa7b-805924bd9ed4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 94069,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58bf8976-c218-5f0c-aa7b-805924bd9ed4/58bf8976-c218-5f0c-aa7b-805924bd9ed4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 547177,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58bf8976-c218-5f0c-aa7b-805924bd9ed4/58bf8976-c218-5f0c-aa7b-805924bd9ed4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 547177,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58bf8976-c218-5f0c-aa7b-805924bd9ed4/58bf8976-c218-5f0c-aa7b-805924bd9ed4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485618,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58bf8976-c218-5f0c-aa7b-805924bd9ed4/58bf8976-c218-5f0c-aa7b-805924bd9ed4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359090,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58bf8976-c218-5f0c-aa7b-805924bd9ed4/58bf8976-c218-5f0c-aa7b-805924bd9ed4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431343,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58bf8976-c218-5f0c-aa7b-805924bd9ed4/58bf8976-c218-5f0c-aa7b-805924bd9ed4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58bf8976-c218-5f0c-aa7b-805924bd9ed4/58bf8976-c218-5f0c-aa7b-805924bd9ed4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 207444,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58bf8976-c218-5f0c-aa7b-805924bd9ed4/58bf8976-c218-5f0c-aa7b-805924bd9ed4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302719,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/60a4f610b67a406bb0910586443a7359/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-21',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN QASHQAI Qashqai e-POWER 190ch N-Connecta',
'transmission': 'automatic',
'trim': 'Qashqai e-POWER 190ch N-Connecta',
'vin': None,
'year': 2023}
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988488%27 HTTP/1.1" 200 None
2026-03-27 16:52:09 [ayvens.fr] INFO: Saving data for 1988488: {'created_time': 1774630329.701017, 'last_price_update_time': 1774630329.701028, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988488') HTTP/1.1" 204 0
2026-03-27 16:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F33c4a19e017e41fc9c7578e2edb9317d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/2.jpg not downloaded yet
2026-03-27 16:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee1f90>
2026-03-27 16:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca3cb72-ff00-58d6-967a-3a5d393b328a/3ca3cb72-ff00-58d6-967a-3a5d393b328a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F1ff7ba431d594048b56254be0c0941b8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/1.jpg saved to cache
2026-03-27 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ca3cb72-ff00-58d6-967a-3a5d393b328a
2026-03-27 16:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050ff50>
2026-03-27 16:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca3cb72-ff00-58d6-967a-3a5d393b328a/3ca3cb72-ff00-58d6-967a-3a5d393b328a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F1ff7ba431d594048b56254be0c0941b8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/2.jpg saved to cache
2026-03-27 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ca3cb72-ff00-58d6-967a-3a5d393b328a
2026-03-27 16:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa9150>
2026-03-27 16:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca3cb72-ff00-58d6-967a-3a5d393b328a/3ca3cb72-ff00-58d6-967a-3a5d393b328a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F1ff7ba431d594048b56254be0c0941b8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/3.jpg saved to cache
2026-03-27 16:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ca3cb72-ff00-58d6-967a-3a5d393b328a
2026-03-27 16:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F33c4a19e017e41fc9c7578e2edb9317d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/3.jpg not downloaded yet
2026-03-27 16:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F33c4a19e017e41fc9c7578e2edb9317d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/4.jpg not downloaded yet
2026-03-27 16:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f110d0>
2026-03-27 16:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca3cb72-ff00-58d6-967a-3a5d393b328a/3ca3cb72-ff00-58d6-967a-3a5d393b328a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F1ff7ba431d594048b56254be0c0941b8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/4.jpg saved to cache
2026-03-27 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ca3cb72-ff00-58d6-967a-3a5d393b328a
2026-03-27 16:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d6de50>
2026-03-27 16:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca3cb72-ff00-58d6-967a-3a5d393b328a/3ca3cb72-ff00-58d6-967a-3a5d393b328a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F1ff7ba431d594048b56254be0c0941b8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/5.jpg saved to cache
2026-03-27 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ca3cb72-ff00-58d6-967a-3a5d393b328a
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F33c4a19e017e41fc9c7578e2edb9317d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/5.jpg not downloaded yet
2026-03-27 16:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F33c4a19e017e41fc9c7578e2edb9317d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/6.jpg not downloaded yet
2026-03-27 16:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efdcd0>
2026-03-27 16:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca3cb72-ff00-58d6-967a-3a5d393b328a/3ca3cb72-ff00-58d6-967a-3a5d393b328a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F1ff7ba431d594048b56254be0c0941b8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/6.jpg saved to cache
2026-03-27 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ca3cb72-ff00-58d6-967a-3a5d393b328a
2026-03-27 16:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591446d50>
2026-03-27 16:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca3cb72-ff00-58d6-967a-3a5d393b328a/3ca3cb72-ff00-58d6-967a-3a5d393b328a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F1ff7ba431d594048b56254be0c0941b8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/8.jpg saved to cache
2026-03-27 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ca3cb72-ff00-58d6-967a-3a5d393b328a
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F33c4a19e017e41fc9c7578e2edb9317d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/7.jpg not downloaded yet
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F33c4a19e017e41fc9c7578e2edb9317d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/8.jpg not downloaded yet
2026-03-27 16:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e09410>
2026-03-27 16:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca3cb72-ff00-58d6-967a-3a5d393b328a/3ca3cb72-ff00-58d6-967a-3a5d393b328a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F1ff7ba431d594048b56254be0c0941b8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/7.jpg saved to cache
2026-03-27 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ca3cb72-ff00-58d6-967a-3a5d393b328a
2026-03-27 16:52:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ca3cb72-ff00-58d6-967a-3a5d393b328a, skipping ID generation
2026-03-27 16:52:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ca3cb72-ff00-58d6-967a-3a5d393b328a with scrape type 1
2026-03-27 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ca3cb72-ff00-58d6-967a-3a5d393b328a sending to next pipeline
2026-03-27 16:52:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3ca3cb72-ff00-58d6-967a-3a5d393b328a, identifier: 1988489
2026-03-27 16:52:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3ca3cb72-ff00-58d6-967a-3a5d393b328a with identifier: 1988489
2026-03-27 16:52:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3ca3cb72-ff00-58d6-967a-3a5d393b328a with identifier: 1988489
2026-03-27 16:52:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3ca3cb72-ff00-58d6-967a-3a5d393b328a with identifier: 1988489 to the API
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'GRIS ACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '3ca3cb72-ff00-58d6-967a-3a5d393b328a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'E-BERLINGO',
'odometer': 41025,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca3cb72-ff00-58d6-967a-3a5d393b328a/3ca3cb72-ff00-58d6-967a-3a5d393b328a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316336,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca3cb72-ff00-58d6-967a-3a5d393b328a/3ca3cb72-ff00-58d6-967a-3a5d393b328a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316336,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca3cb72-ff00-58d6-967a-3a5d393b328a/3ca3cb72-ff00-58d6-967a-3a5d393b328a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326022,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca3cb72-ff00-58d6-967a-3a5d393b328a/3ca3cb72-ff00-58d6-967a-3a5d393b328a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321900,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca3cb72-ff00-58d6-967a-3a5d393b328a/3ca3cb72-ff00-58d6-967a-3a5d393b328a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285996,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca3cb72-ff00-58d6-967a-3a5d393b328a/3ca3cb72-ff00-58d6-967a-3a5d393b328a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293408,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca3cb72-ff00-58d6-967a-3a5d393b328a/3ca3cb72-ff00-58d6-967a-3a5d393b328a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273055,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca3cb72-ff00-58d6-967a-3a5d393b328a/3ca3cb72-ff00-58d6-967a-3a5d393b328a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168018,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/1ff7ba431d594048b56254be0c0941b8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN E-BERLINGO Berlingo M Moteur Electrique 136ch (100 kW) '
'Shine Automatique',
'transmission': 'automatic',
'trim': 'Berlingo M Moteur Electrique 136ch (100 kW) Shine Automatique',
'vin': None,
'year': 2023}
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988489%27 HTTP/1.1" 200 None
2026-03-27 16:52:10 [ayvens.fr] INFO: Saving data for 1988489: {'created_time': 1774630330.951074, 'last_price_update_time': 1774630330.951086, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988489') HTTP/1.1" 204 0
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F33c4a19e017e41fc9c7578e2edb9317d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/9.jpg not downloaded yet
2026-03-27 16:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F33c4a19e017e41fc9c7578e2edb9317d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/10.jpg not downloaded yet
2026-03-27 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:11 [ayvens.fr] INFO: Found listing with ID: 1988491
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988491%27 HTTP/1.1" 200 None
2026-03-27 16:52:11 [ayvens.fr] INFO: Scrape type for 1988491: 1
2026-03-27 16:52:11 [ayvens.fr] INFO: Extracting data for car ID: 1988491
2026-03-27 16:52:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30297ef5-c43d-5d38-897b-dd1a0de2cf0d with identifier: 1988491
2026-03-27 16:52:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30297ef5-c43d-5d38-897b-dd1a0de2cf0d with scrape type 1
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 30297ef5-c43d-5d38-897b-dd1a0de2cf0d
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fe38db74e798348e099843965a353a52d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/1.jpg not downloaded yet
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fe38db74e798348e099843965a353a52d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/2.jpg not downloaded yet
2026-03-27 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fe38db74e798348e099843965a353a52d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/3.jpg not downloaded yet
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fe38db74e798348e099843965a353a52d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/4.jpg not downloaded yet
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fe38db74e798348e099843965a353a52d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/5.jpg not downloaded yet
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fe38db74e798348e099843965a353a52d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/6.jpg not downloaded yet
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fe38db74e798348e099843965a353a52d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/7.jpg not downloaded yet
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590af2210>
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc9eb717-472c-5acb-be63-4b399309b8ac/dc9eb717-472c-5acb-be63-4b399309b8ac_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F33c4a19e017e41fc9c7578e2edb9317d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/1.jpg saved to cache
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc9eb717-472c-5acb-be63-4b399309b8ac
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fe38db74e798348e099843965a353a52d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/8.jpg not downloaded yet
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efc910>
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc9eb717-472c-5acb-be63-4b399309b8ac/dc9eb717-472c-5acb-be63-4b399309b8ac_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F33c4a19e017e41fc9c7578e2edb9317d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/2.jpg saved to cache
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc9eb717-472c-5acb-be63-4b399309b8ac
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee3a50>
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc9eb717-472c-5acb-be63-4b399309b8ac/dc9eb717-472c-5acb-be63-4b399309b8ac_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F33c4a19e017e41fc9c7578e2edb9317d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/4.jpg saved to cache
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc9eb717-472c-5acb-be63-4b399309b8ac
2026-03-27 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:11 [ayvens.fr] INFO: Found listing with ID: 1988492
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988492%27 HTTP/1.1" 200 None
2026-03-27 16:52:11 [ayvens.fr] INFO: Scrape type for 1988492: 1
2026-03-27 16:52:11 [ayvens.fr] INFO: Extracting data for car ID: 1988492
2026-03-27 16:52:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c3cce06-49e9-51fd-9ae1-48c4c4121618 with identifier: 1988492
2026-03-27 16:52:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c3cce06-49e9-51fd-9ae1-48c4c4121618 with scrape type 1
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 9c3cce06-49e9-51fd-9ae1-48c4c4121618
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252F0c63aa922da147aaa7d0578e1368d04f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/1.jpg not downloaded yet
2026-03-27 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911a62d0>
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc9eb717-472c-5acb-be63-4b399309b8ac/dc9eb717-472c-5acb-be63-4b399309b8ac_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F33c4a19e017e41fc9c7578e2edb9317d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/6.jpg saved to cache
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc9eb717-472c-5acb-be63-4b399309b8ac
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c20d0>
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc9eb717-472c-5acb-be63-4b399309b8ac/dc9eb717-472c-5acb-be63-4b399309b8ac_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F33c4a19e017e41fc9c7578e2edb9317d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/5.jpg saved to cache
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc9eb717-472c-5acb-be63-4b399309b8ac
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591482990>
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc9eb717-472c-5acb-be63-4b399309b8ac/dc9eb717-472c-5acb-be63-4b399309b8ac_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F33c4a19e017e41fc9c7578e2edb9317d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/3.jpg saved to cache
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc9eb717-472c-5acb-be63-4b399309b8ac
2026-03-27 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252F0c63aa922da147aaa7d0578e1368d04f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/2.jpg not downloaded yet
2026-03-27 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252F0c63aa922da147aaa7d0578e1368d04f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/3.jpg not downloaded yet
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f12910>
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc9eb717-472c-5acb-be63-4b399309b8ac/dc9eb717-472c-5acb-be63-4b399309b8ac_image_8.jpg HTTP/1.1" 201 0
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F33c4a19e017e41fc9c7578e2edb9317d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/9.jpg saved to cache
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc9eb717-472c-5acb-be63-4b399309b8ac
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c3b50>
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc9eb717-472c-5acb-be63-4b399309b8ac/dc9eb717-472c-5acb-be63-4b399309b8ac_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F33c4a19e017e41fc9c7578e2edb9317d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/7.jpg saved to cache
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc9eb717-472c-5acb-be63-4b399309b8ac
2026-03-27 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252F0c63aa922da147aaa7d0578e1368d04f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/4.jpg not downloaded yet
2026-03-27 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252F0c63aa922da147aaa7d0578e1368d04f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/5.jpg not downloaded yet
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b58f50>
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30297ef5-c43d-5d38-897b-dd1a0de2cf0d/30297ef5-c43d-5d38-897b-dd1a0de2cf0d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fe38db74e798348e099843965a353a52d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/1.jpg saved to cache
2026-03-27 16:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30297ef5-c43d-5d38-897b-dd1a0de2cf0d
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa3f90>
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30297ef5-c43d-5d38-897b-dd1a0de2cf0d/30297ef5-c43d-5d38-897b-dd1a0de2cf0d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fe38db74e798348e099843965a353a52d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/3.jpg saved to cache
2026-03-27 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30297ef5-c43d-5d38-897b-dd1a0de2cf0d
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252F0c63aa922da147aaa7d0578e1368d04f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/6.jpg not downloaded yet
2026-03-27 16:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252F0c63aa922da147aaa7d0578e1368d04f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/7.jpg not downloaded yet
2026-03-27 16:52:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d76d50>
2026-03-27 16:52:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30297ef5-c43d-5d38-897b-dd1a0de2cf0d/30297ef5-c43d-5d38-897b-dd1a0de2cf0d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fe38db74e798348e099843965a353a52d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/2.jpg saved to cache
2026-03-27 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30297ef5-c43d-5d38-897b-dd1a0de2cf0d
2026-03-27 16:52:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df5290>
2026-03-27 16:52:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30297ef5-c43d-5d38-897b-dd1a0de2cf0d/30297ef5-c43d-5d38-897b-dd1a0de2cf0d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fe38db74e798348e099843965a353a52d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/4.jpg saved to cache
2026-03-27 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30297ef5-c43d-5d38-897b-dd1a0de2cf0d
2026-03-27 16:52:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911830d0>
2026-03-27 16:52:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc9eb717-472c-5acb-be63-4b399309b8ac/dc9eb717-472c-5acb-be63-4b399309b8ac_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F33c4a19e017e41fc9c7578e2edb9317d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/8.jpg saved to cache
2026-03-27 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc9eb717-472c-5acb-be63-4b399309b8ac
2026-03-27 16:52:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911edf90>
2026-03-27 16:52:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc9eb717-472c-5acb-be63-4b399309b8ac/dc9eb717-472c-5acb-be63-4b399309b8ac_image_9.jpg HTTP/1.1" 201 0
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F33c4a19e017e41fc9c7578e2edb9317d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/10.jpg saved to cache
2026-03-27 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dc9eb717-472c-5acb-be63-4b399309b8ac
2026-03-27 16:52:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc9eb717-472c-5acb-be63-4b399309b8ac, skipping ID generation
2026-03-27 16:52:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc9eb717-472c-5acb-be63-4b399309b8ac with scrape type 1
2026-03-27 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc9eb717-472c-5acb-be63-4b399309b8ac sending to next pipeline
2026-03-27 16:52:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: dc9eb717-472c-5acb-be63-4b399309b8ac, identifier: 1988490
2026-03-27 16:52:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7ff50>
2026-03-27 16:52:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30297ef5-c43d-5d38-897b-dd1a0de2cf0d/30297ef5-c43d-5d38-897b-dd1a0de2cf0d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fe38db74e798348e099843965a353a52d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/7.jpg saved to cache
2026-03-27 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30297ef5-c43d-5d38-897b-dd1a0de2cf0d
2026-03-27 16:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252F0c63aa922da147aaa7d0578e1368d04f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/8.jpg not downloaded yet
2026-03-27 16:52:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: dc9eb717-472c-5acb-be63-4b399309b8ac with identifier: 1988490
2026-03-27 16:52:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:52:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: dc9eb717-472c-5acb-be63-4b399309b8ac with identifier: 1988490
2026-03-27 16:52:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: dc9eb717-472c-5acb-be63-4b399309b8ac with identifier: 1988490 to the API
2026-03-27 16:52:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/10.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'EMERAUDE BLUE NACRE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'dc9eb717-472c-5acb-be63-4b399309b8ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C4 CACTUS',
'odometer': 77346,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc9eb717-472c-5acb-be63-4b399309b8ac/dc9eb717-472c-5acb-be63-4b399309b8ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536120,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc9eb717-472c-5acb-be63-4b399309b8ac/dc9eb717-472c-5acb-be63-4b399309b8ac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536120,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc9eb717-472c-5acb-be63-4b399309b8ac/dc9eb717-472c-5acb-be63-4b399309b8ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 562811,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc9eb717-472c-5acb-be63-4b399309b8ac/dc9eb717-472c-5acb-be63-4b399309b8ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 495715,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc9eb717-472c-5acb-be63-4b399309b8ac/dc9eb717-472c-5acb-be63-4b399309b8ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 503033,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc9eb717-472c-5acb-be63-4b399309b8ac/dc9eb717-472c-5acb-be63-4b399309b8ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510238,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc9eb717-472c-5acb-be63-4b399309b8ac/dc9eb717-472c-5acb-be63-4b399309b8ac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 473949,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc9eb717-472c-5acb-be63-4b399309b8ac/dc9eb717-472c-5acb-be63-4b399309b8ac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 567532,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/8.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc9eb717-472c-5acb-be63-4b399309b8ac/dc9eb717-472c-5acb-be63-4b399309b8ac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516001,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/9.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc9eb717-472c-5acb-be63-4b399309b8ac/dc9eb717-472c-5acb-be63-4b399309b8ac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 528256,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/33c4a19e017e41fc9c7578e2edb9317d/images/large/10.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-01',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C4 CACTUS C4 Cactus PureTech 110ch S&S Feel Business EAT6',
'transmission': 'automatic',
'trim': 'C4 Cactus PureTech 110ch S&S Feel Business EAT6',
'vin': None,
'year': 2019}
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988490%27 HTTP/1.1" 200 None
2026-03-27 16:52:14 [ayvens.fr] INFO: Saving data for 1988490: {'created_time': 1774630334.640703, 'last_price_update_time': 1774630334.640716, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988490') HTTP/1.1" 204 0
2026-03-27 16:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:14 [ayvens.fr] INFO: Found listing with ID: 1988493
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988493%27 HTTP/1.1" 200 None
2026-03-27 16:52:14 [ayvens.fr] INFO: Scrape type for 1988493: 1
2026-03-27 16:52:14 [ayvens.fr] INFO: Extracting data for car ID: 1988493
2026-03-27 16:52:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3977c499-e1f5-59ff-b503-e388c3e0d067 with identifier: 1988493
2026-03-27 16:52:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3977c499-e1f5-59ff-b503-e388c3e0d067 with scrape type 1
2026-03-27 16:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3977c499-e1f5-59ff-b503-e388c3e0d067
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F535e41f3b3574f898595641babd9b7cf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/1.jpg not downloaded yet
2026-03-27 16:52:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7fe90>
2026-03-27 16:52:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30297ef5-c43d-5d38-897b-dd1a0de2cf0d/30297ef5-c43d-5d38-897b-dd1a0de2cf0d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fe38db74e798348e099843965a353a52d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/5.jpg saved to cache
2026-03-27 16:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30297ef5-c43d-5d38-897b-dd1a0de2cf0d
2026-03-27 16:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910b2450>
2026-03-27 16:52:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30297ef5-c43d-5d38-897b-dd1a0de2cf0d/30297ef5-c43d-5d38-897b-dd1a0de2cf0d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fe38db74e798348e099843965a353a52d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/6.jpg saved to cache
2026-03-27 16:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30297ef5-c43d-5d38-897b-dd1a0de2cf0d
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F535e41f3b3574f898595641babd9b7cf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/2.jpg not downloaded yet
2026-03-27 16:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F535e41f3b3574f898595641babd9b7cf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/3.jpg not downloaded yet
2026-03-27 16:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fca810>
2026-03-27 16:52:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c3cce06-49e9-51fd-9ae1-48c4c4121618/9c3cce06-49e9-51fd-9ae1-48c4c4121618_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252F0c63aa922da147aaa7d0578e1368d04f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/3.jpg saved to cache
2026-03-27 16:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c3cce06-49e9-51fd-9ae1-48c4c4121618
2026-03-27 16:52:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0ae10>
2026-03-27 16:52:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30297ef5-c43d-5d38-897b-dd1a0de2cf0d/30297ef5-c43d-5d38-897b-dd1a0de2cf0d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fe38db74e798348e099843965a353a52d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/8.jpg saved to cache
2026-03-27 16:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30297ef5-c43d-5d38-897b-dd1a0de2cf0d
2026-03-27 16:52:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30297ef5-c43d-5d38-897b-dd1a0de2cf0d, skipping ID generation
2026-03-27 16:52:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30297ef5-c43d-5d38-897b-dd1a0de2cf0d with scrape type 1
2026-03-27 16:52:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30297ef5-c43d-5d38-897b-dd1a0de2cf0d sending to next pipeline
2026-03-27 16:52:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 30297ef5-c43d-5d38-897b-dd1a0de2cf0d, identifier: 1988491
2026-03-27 16:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d41290>
2026-03-27 16:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c3cce06-49e9-51fd-9ae1-48c4c4121618/9c3cce06-49e9-51fd-9ae1-48c4c4121618_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252F0c63aa922da147aaa7d0578e1368d04f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/1.jpg saved to cache
2026-03-27 16:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c3cce06-49e9-51fd-9ae1-48c4c4121618
2026-03-27 16:52:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F535e41f3b3574f898595641babd9b7cf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/4.jpg not downloaded yet
2026-03-27 16:52:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 30297ef5-c43d-5d38-897b-dd1a0de2cf0d with identifier: 1988491
2026-03-27 16:52:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 30297ef5-c43d-5d38-897b-dd1a0de2cf0d with identifier: 1988491
2026-03-27 16:52:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 30297ef5-c43d-5d38-897b-dd1a0de2cf0d with identifier: 1988491 to the API
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '30297ef5-c43d-5d38-897b-dd1a0de2cf0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'GRAND C4 SPACETOURER',
'odometer': 112256,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30297ef5-c43d-5d38-897b-dd1a0de2cf0d/30297ef5-c43d-5d38-897b-dd1a0de2cf0d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405210,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30297ef5-c43d-5d38-897b-dd1a0de2cf0d/30297ef5-c43d-5d38-897b-dd1a0de2cf0d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405210,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30297ef5-c43d-5d38-897b-dd1a0de2cf0d/30297ef5-c43d-5d38-897b-dd1a0de2cf0d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421407,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30297ef5-c43d-5d38-897b-dd1a0de2cf0d/30297ef5-c43d-5d38-897b-dd1a0de2cf0d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378479,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30297ef5-c43d-5d38-897b-dd1a0de2cf0d/30297ef5-c43d-5d38-897b-dd1a0de2cf0d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330312,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30297ef5-c43d-5d38-897b-dd1a0de2cf0d/30297ef5-c43d-5d38-897b-dd1a0de2cf0d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400745,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30297ef5-c43d-5d38-897b-dd1a0de2cf0d/30297ef5-c43d-5d38-897b-dd1a0de2cf0d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185959,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30297ef5-c43d-5d38-897b-dd1a0de2cf0d/30297ef5-c43d-5d38-897b-dd1a0de2cf0d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277247,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/e38db74e798348e099843965a353a52d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-27',
'seats_number': 7,
'seller_name': None,
'title': 'CITROËN GRAND C4 SPACETOURER Grand C4 SpaceTourer PureTech 130ch '
'S&S Business',
'transmission': 'manual',
'trim': 'Grand C4 SpaceTourer PureTech 130ch S&S Business',
'vin': None,
'year': 2021}
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988491%27 HTTP/1.1" 200 None
2026-03-27 16:52:15 [ayvens.fr] INFO: Saving data for 1988491: {'created_time': 1774630335.616273, 'last_price_update_time': 1774630335.616283, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988491') HTTP/1.1" 204 0
2026-03-27 16:52:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F535e41f3b3574f898595641babd9b7cf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/5.jpg not downloaded yet
2026-03-27 16:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e08210>
2026-03-27 16:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c3cce06-49e9-51fd-9ae1-48c4c4121618/9c3cce06-49e9-51fd-9ae1-48c4c4121618_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252F0c63aa922da147aaa7d0578e1368d04f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/5.jpg saved to cache
2026-03-27 16:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c3cce06-49e9-51fd-9ae1-48c4c4121618
2026-03-27 16:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d97550>
2026-03-27 16:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c3cce06-49e9-51fd-9ae1-48c4c4121618/9c3cce06-49e9-51fd-9ae1-48c4c4121618_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252F0c63aa922da147aaa7d0578e1368d04f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/4.jpg saved to cache
2026-03-27 16:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c3cce06-49e9-51fd-9ae1-48c4c4121618
2026-03-27 16:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f62b10>
2026-03-27 16:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c3cce06-49e9-51fd-9ae1-48c4c4121618/9c3cce06-49e9-51fd-9ae1-48c4c4121618_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252F0c63aa922da147aaa7d0578e1368d04f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/2.jpg saved to cache
2026-03-27 16:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c3cce06-49e9-51fd-9ae1-48c4c4121618
2026-03-27 16:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d748d0>
2026-03-27 16:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c3cce06-49e9-51fd-9ae1-48c4c4121618/9c3cce06-49e9-51fd-9ae1-48c4c4121618_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252F0c63aa922da147aaa7d0578e1368d04f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/7.jpg saved to cache
2026-03-27 16:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c3cce06-49e9-51fd-9ae1-48c4c4121618
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F535e41f3b3574f898595641babd9b7cf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/6.jpg not downloaded yet
2026-03-27 16:52:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F535e41f3b3574f898595641babd9b7cf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/7.jpg not downloaded yet
2026-03-27 16:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fca610>
2026-03-27 16:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c3cce06-49e9-51fd-9ae1-48c4c4121618/9c3cce06-49e9-51fd-9ae1-48c4c4121618_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252F0c63aa922da147aaa7d0578e1368d04f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/6.jpg saved to cache
2026-03-27 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c3cce06-49e9-51fd-9ae1-48c4c4121618
2026-03-27 16:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F535e41f3b3574f898595641babd9b7cf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/8.jpg not downloaded yet
2026-03-27 16:52:16 [ayvens.fr] INFO: Found listing with ID: 1988494
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988494%27 HTTP/1.1" 200 None
2026-03-27 16:52:16 [ayvens.fr] INFO: Scrape type for 1988494: 1
2026-03-27 16:52:16 [ayvens.fr] INFO: Extracting data for car ID: 1988494
2026-03-27 16:52:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e4c2bbd-7a32-5b66-90a3-f350e954cfc8 with identifier: 1988494
2026-03-27 16:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e4c2bbd-7a32-5b66-90a3-f350e954cfc8 with scrape type 1
2026-03-27 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5e4c2bbd-7a32-5b66-90a3-f350e954cfc8
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F0973363626f146529784e47f640d3275%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/1.jpg not downloaded yet
2026-03-27 16:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F0973363626f146529784e47f640d3275%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/2.jpg not downloaded yet
2026-03-27 16:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd8210>
2026-03-27 16:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c3cce06-49e9-51fd-9ae1-48c4c4121618/9c3cce06-49e9-51fd-9ae1-48c4c4121618_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252F0c63aa922da147aaa7d0578e1368d04f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/8.jpg saved to cache
2026-03-27 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c3cce06-49e9-51fd-9ae1-48c4c4121618
2026-03-27 16:52:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c3cce06-49e9-51fd-9ae1-48c4c4121618, skipping ID generation
2026-03-27 16:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c3cce06-49e9-51fd-9ae1-48c4c4121618 with scrape type 1
2026-03-27 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c3cce06-49e9-51fd-9ae1-48c4c4121618 sending to next pipeline
2026-03-27 16:52:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9c3cce06-49e9-51fd-9ae1-48c4c4121618, identifier: 1988492
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F0973363626f146529784e47f640d3275%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/3.jpg not downloaded yet
2026-03-27 16:52:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9c3cce06-49e9-51fd-9ae1-48c4c4121618 with identifier: 1988492
2026-03-27 16:52:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:52:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9c3cce06-49e9-51fd-9ae1-48c4c4121618 with identifier: 1988492
2026-03-27 16:52:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9c3cce06-49e9-51fd-9ae1-48c4c4121618 with identifier: 1988492 to the API
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'GRIS AMAZONITE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '9c3cce06-49e9-51fd-9ae1-48c4c4121618',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 118586,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c3cce06-49e9-51fd-9ae1-48c4c4121618/9c3cce06-49e9-51fd-9ae1-48c4c4121618_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395855,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c3cce06-49e9-51fd-9ae1-48c4c4121618/9c3cce06-49e9-51fd-9ae1-48c4c4121618_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395855,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c3cce06-49e9-51fd-9ae1-48c4c4121618/9c3cce06-49e9-51fd-9ae1-48c4c4121618_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350053,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c3cce06-49e9-51fd-9ae1-48c4c4121618/9c3cce06-49e9-51fd-9ae1-48c4c4121618_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330331,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c3cce06-49e9-51fd-9ae1-48c4c4121618/9c3cce06-49e9-51fd-9ae1-48c4c4121618_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341431,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c3cce06-49e9-51fd-9ae1-48c4c4121618/9c3cce06-49e9-51fd-9ae1-48c4c4121618_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334770,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c3cce06-49e9-51fd-9ae1-48c4c4121618/9c3cce06-49e9-51fd-9ae1-48c4c4121618_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287646,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c3cce06-49e9-51fd-9ae1-48c4c4121618/9c3cce06-49e9-51fd-9ae1-48c4c4121618_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326850,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ez-/0c63aa922da147aaa7d0578e1368d04f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-21',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 2.0 BlueHDi 180ch S&S GT EAT8',
'transmission': 'automatic',
'trim': '3008 2.0 BlueHDi 180ch S&S GT EAT8',
'vin': None,
'year': 2018}
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988492%27 HTTP/1.1" 200 None
2026-03-27 16:52:16 [ayvens.fr] INFO: Saving data for 1988492: {'created_time': 1774630336.67704, 'last_price_update_time': 1774630336.677055, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988492') HTTP/1.1" 204 0
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F0973363626f146529784e47f640d3275%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/4.jpg not downloaded yet
2026-03-27 16:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d8fbd0>
2026-03-27 16:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3977c499-e1f5-59ff-b503-e388c3e0d067/3977c499-e1f5-59ff-b503-e388c3e0d067_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F535e41f3b3574f898595641babd9b7cf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/1.jpg saved to cache
2026-03-27 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3977c499-e1f5-59ff-b503-e388c3e0d067
2026-03-27 16:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b50790>
2026-03-27 16:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3977c499-e1f5-59ff-b503-e388c3e0d067/3977c499-e1f5-59ff-b503-e388c3e0d067_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F535e41f3b3574f898595641babd9b7cf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/2.jpg saved to cache
2026-03-27 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3977c499-e1f5-59ff-b503-e388c3e0d067
2026-03-27 16:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b67fd0>
2026-03-27 16:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3977c499-e1f5-59ff-b503-e388c3e0d067/3977c499-e1f5-59ff-b503-e388c3e0d067_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F535e41f3b3574f898595641babd9b7cf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/3.jpg saved to cache
2026-03-27 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3977c499-e1f5-59ff-b503-e388c3e0d067
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F0973363626f146529784e47f640d3275%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/5.jpg not downloaded yet
2026-03-27 16:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F0973363626f146529784e47f640d3275%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/6.jpg not downloaded yet
2026-03-27 16:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F0973363626f146529784e47f640d3275%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/7.jpg not downloaded yet
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F0973363626f146529784e47f640d3275%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/8.jpg not downloaded yet
2026-03-27 16:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:17 [ayvens.fr] INFO: Found listing with ID: 1988495
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988495%27 HTTP/1.1" 200 None
2026-03-27 16:52:17 [ayvens.fr] INFO: Scrape type for 1988495: 1
2026-03-27 16:52:17 [ayvens.fr] INFO: Extracting data for car ID: 1988495
2026-03-27 16:52:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc392bf5-eee4-56b8-8c6a-91bf7e934679 with identifier: 1988495
2026-03-27 16:52:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc392bf5-eee4-56b8-8c6a-91bf7e934679 with scrape type 1
2026-03-27 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item dc392bf5-eee4-56b8-8c6a-91bf7e934679
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F0d80c57db75e4d9481c8be8c2c2c8128%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/1.jpg not downloaded yet
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F0d80c57db75e4d9481c8be8c2c2c8128%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/2.jpg not downloaded yet
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F0d80c57db75e4d9481c8be8c2c2c8128%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/3.jpg not downloaded yet
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F0d80c57db75e4d9481c8be8c2c2c8128%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/4.jpg not downloaded yet
2026-03-27 16:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f135d0>
2026-03-27 16:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3977c499-e1f5-59ff-b503-e388c3e0d067/3977c499-e1f5-59ff-b503-e388c3e0d067_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F535e41f3b3574f898595641babd9b7cf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/5.jpg saved to cache
2026-03-27 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3977c499-e1f5-59ff-b503-e388c3e0d067
2026-03-27 16:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066f890>
2026-03-27 16:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3977c499-e1f5-59ff-b503-e388c3e0d067/3977c499-e1f5-59ff-b503-e388c3e0d067_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F535e41f3b3574f898595641babd9b7cf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/7.jpg saved to cache
2026-03-27 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3977c499-e1f5-59ff-b503-e388c3e0d067
2026-03-27 16:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590647110>
2026-03-27 16:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3977c499-e1f5-59ff-b503-e388c3e0d067/3977c499-e1f5-59ff-b503-e388c3e0d067_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F535e41f3b3574f898595641babd9b7cf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/6.jpg saved to cache
2026-03-27 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3977c499-e1f5-59ff-b503-e388c3e0d067
2026-03-27 16:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc7a10>
2026-03-27 16:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3977c499-e1f5-59ff-b503-e388c3e0d067/3977c499-e1f5-59ff-b503-e388c3e0d067_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F535e41f3b3574f898595641babd9b7cf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/4.jpg saved to cache
2026-03-27 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3977c499-e1f5-59ff-b503-e388c3e0d067
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F0d80c57db75e4d9481c8be8c2c2c8128%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/5.jpg not downloaded yet
2026-03-27 16:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068d350>
2026-03-27 16:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3977c499-e1f5-59ff-b503-e388c3e0d067/3977c499-e1f5-59ff-b503-e388c3e0d067_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F535e41f3b3574f898595641babd9b7cf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/8.jpg saved to cache
2026-03-27 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3977c499-e1f5-59ff-b503-e388c3e0d067
2026-03-27 16:52:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3977c499-e1f5-59ff-b503-e388c3e0d067, skipping ID generation
2026-03-27 16:52:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3977c499-e1f5-59ff-b503-e388c3e0d067 with scrape type 1
2026-03-27 16:52:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3977c499-e1f5-59ff-b503-e388c3e0d067 sending to next pipeline
2026-03-27 16:52:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3977c499-e1f5-59ff-b503-e388c3e0d067, identifier: 1988493
2026-03-27 16:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3977c499-e1f5-59ff-b503-e388c3e0d067 with identifier: 1988493
2026-03-27 16:52:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3977c499-e1f5-59ff-b503-e388c3e0d067 with identifier: 1988493
2026-03-27 16:52:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3977c499-e1f5-59ff-b503-e388c3e0d067 with identifier: 1988493 to the API
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 87,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '3977c499-e1f5-59ff-b503-e388c3e0d067',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS HYBRID',
'odometer': 63041,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3977c499-e1f5-59ff-b503-e388c3e0d067/3977c499-e1f5-59ff-b503-e388c3e0d067_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416486,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3977c499-e1f5-59ff-b503-e388c3e0d067/3977c499-e1f5-59ff-b503-e388c3e0d067_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416486,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3977c499-e1f5-59ff-b503-e388c3e0d067/3977c499-e1f5-59ff-b503-e388c3e0d067_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461578,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3977c499-e1f5-59ff-b503-e388c3e0d067/3977c499-e1f5-59ff-b503-e388c3e0d067_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338120,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3977c499-e1f5-59ff-b503-e388c3e0d067/3977c499-e1f5-59ff-b503-e388c3e0d067_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319320,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3977c499-e1f5-59ff-b503-e388c3e0d067/3977c499-e1f5-59ff-b503-e388c3e0d067_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308396,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3977c499-e1f5-59ff-b503-e388c3e0d067/3977c499-e1f5-59ff-b503-e388c3e0d067_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300182,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3977c499-e1f5-59ff-b503-e388c3e0d067/3977c499-e1f5-59ff-b503-e388c3e0d067_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379308,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/535e41f3b3574f898595641babd9b7cf/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-10',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA YARIS HYBRID Yaris 116h Dynamic 5p',
'transmission': 'automatic',
'trim': 'Yaris 116h Dynamic 5p',
'vin': None,
'year': 2022}
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988493%27 HTTP/1.1" 200 None
2026-03-27 16:52:18 [ayvens.fr] INFO: Saving data for 1988493: {'created_time': 1774630338.031489, 'last_price_update_time': 1774630338.0315, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988493') HTTP/1.1" 204 0
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F0d80c57db75e4d9481c8be8c2c2c8128%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/6.jpg not downloaded yet
2026-03-27 16:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3d210>
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e4c2bbd-7a32-5b66-90a3-f350e954cfc8/5e4c2bbd-7a32-5b66-90a3-f350e954cfc8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F0973363626f146529784e47f640d3275%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/2.jpg saved to cache
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5e4c2bbd-7a32-5b66-90a3-f350e954cfc8
2026-03-27 16:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F0d80c57db75e4d9481c8be8c2c2c8128%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/7.jpg not downloaded yet
2026-03-27 16:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b12d0>
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e4c2bbd-7a32-5b66-90a3-f350e954cfc8/5e4c2bbd-7a32-5b66-90a3-f350e954cfc8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F0973363626f146529784e47f640d3275%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/3.jpg saved to cache
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5e4c2bbd-7a32-5b66-90a3-f350e954cfc8
2026-03-27 16:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F0d80c57db75e4d9481c8be8c2c2c8128%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/8.jpg not downloaded yet
2026-03-27 16:52:18 [ayvens.fr] INFO: Found listing with ID: 1988496
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988496%27 HTTP/1.1" 200 None
2026-03-27 16:52:18 [ayvens.fr] INFO: Scrape type for 1988496: 1
2026-03-27 16:52:18 [ayvens.fr] INFO: Extracting data for car ID: 1988496
2026-03-27 16:52:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 105f0bb9-963a-5042-a1b9-d75943145b5e with identifier: 1988496
2026-03-27 16:52:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 105f0bb9-963a-5042-a1b9-d75943145b5e with scrape type 1
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 105f0bb9-963a-5042-a1b9-d75943145b5e
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe222c096bd0f44438989c2ce6ac1c2c3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/1.jpg not downloaded yet
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592c3ab10>
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e4c2bbd-7a32-5b66-90a3-f350e954cfc8/5e4c2bbd-7a32-5b66-90a3-f350e954cfc8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F0973363626f146529784e47f640d3275%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/6.jpg saved to cache
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5e4c2bbd-7a32-5b66-90a3-f350e954cfc8
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe222c096bd0f44438989c2ce6ac1c2c3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/2.jpg not downloaded yet
2026-03-27 16:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590590790>
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e4c2bbd-7a32-5b66-90a3-f350e954cfc8/5e4c2bbd-7a32-5b66-90a3-f350e954cfc8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F0973363626f146529784e47f640d3275%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/1.jpg saved to cache
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e4c2bbd-7a32-5b66-90a3-f350e954cfc8
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590511610>
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e4c2bbd-7a32-5b66-90a3-f350e954cfc8/5e4c2bbd-7a32-5b66-90a3-f350e954cfc8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F0973363626f146529784e47f640d3275%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/5.jpg saved to cache
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5e4c2bbd-7a32-5b66-90a3-f350e954cfc8
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910c2990>
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e4c2bbd-7a32-5b66-90a3-f350e954cfc8/5e4c2bbd-7a32-5b66-90a3-f350e954cfc8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F0973363626f146529784e47f640d3275%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/8.jpg saved to cache
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5e4c2bbd-7a32-5b66-90a3-f350e954cfc8
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590622250>
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e4c2bbd-7a32-5b66-90a3-f350e954cfc8/5e4c2bbd-7a32-5b66-90a3-f350e954cfc8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F0973363626f146529784e47f640d3275%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/4.jpg saved to cache
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5e4c2bbd-7a32-5b66-90a3-f350e954cfc8
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b2be50>
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e4c2bbd-7a32-5b66-90a3-f350e954cfc8/5e4c2bbd-7a32-5b66-90a3-f350e954cfc8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F0973363626f146529784e47f640d3275%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/7.jpg saved to cache
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5e4c2bbd-7a32-5b66-90a3-f350e954cfc8
2026-03-27 16:52:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e4c2bbd-7a32-5b66-90a3-f350e954cfc8, skipping ID generation
2026-03-27 16:52:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e4c2bbd-7a32-5b66-90a3-f350e954cfc8 with scrape type 1
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e4c2bbd-7a32-5b66-90a3-f350e954cfc8 sending to next pipeline
2026-03-27 16:52:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5e4c2bbd-7a32-5b66-90a3-f350e954cfc8, identifier: 1988494
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b2fd0>
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc392bf5-eee4-56b8-8c6a-91bf7e934679/dc392bf5-eee4-56b8-8c6a-91bf7e934679_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F0d80c57db75e4d9481c8be8c2c2c8128%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/1.jpg saved to cache
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc392bf5-eee4-56b8-8c6a-91bf7e934679
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe222c096bd0f44438989c2ce6ac1c2c3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/3.jpg not downloaded yet
2026-03-27 16:52:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5e4c2bbd-7a32-5b66-90a3-f350e954cfc8 with identifier: 1988494
2026-03-27 16:52:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:52:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5e4c2bbd-7a32-5b66-90a3-f350e954cfc8 with identifier: 1988494
2026-03-27 16:52:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5e4c2bbd-7a32-5b66-90a3-f350e954cfc8 with identifier: 1988494 to the API
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'NOIR BASALTE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '5e4c2bbd-7a32-5b66-90a3-f350e954cfc8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 112064,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e4c2bbd-7a32-5b66-90a3-f350e954cfc8/5e4c2bbd-7a32-5b66-90a3-f350e954cfc8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585401,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e4c2bbd-7a32-5b66-90a3-f350e954cfc8/5e4c2bbd-7a32-5b66-90a3-f350e954cfc8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585401,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e4c2bbd-7a32-5b66-90a3-f350e954cfc8/5e4c2bbd-7a32-5b66-90a3-f350e954cfc8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478843,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e4c2bbd-7a32-5b66-90a3-f350e954cfc8/5e4c2bbd-7a32-5b66-90a3-f350e954cfc8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360375,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e4c2bbd-7a32-5b66-90a3-f350e954cfc8/5e4c2bbd-7a32-5b66-90a3-f350e954cfc8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385974,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e4c2bbd-7a32-5b66-90a3-f350e954cfc8/5e4c2bbd-7a32-5b66-90a3-f350e954cfc8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362806,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e4c2bbd-7a32-5b66-90a3-f350e954cfc8/5e4c2bbd-7a32-5b66-90a3-f350e954cfc8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336784,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e4c2bbd-7a32-5b66-90a3-f350e954cfc8/5e4c2bbd-7a32-5b66-90a3-f350e954cfc8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308160,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/0973363626f146529784e47f640d3275/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-17',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 230ch HEV Design BVA6 4x2',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 230ch HEV Design BVA6 4x2',
'vin': None,
'year': 2023}
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988494%27 HTTP/1.1" 200 None
2026-03-27 16:52:19 [ayvens.fr] INFO: Saving data for 1988494: {'created_time': 1774630339.432069, 'last_price_update_time': 1774630339.43208, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988494') HTTP/1.1" 204 0
2026-03-27 16:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe222c096bd0f44438989c2ce6ac1c2c3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/4.jpg not downloaded yet
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591106550>
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc392bf5-eee4-56b8-8c6a-91bf7e934679/dc392bf5-eee4-56b8-8c6a-91bf7e934679_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F0d80c57db75e4d9481c8be8c2c2c8128%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/2.jpg saved to cache
2026-03-27 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc392bf5-eee4-56b8-8c6a-91bf7e934679
2026-03-27 16:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe222c096bd0f44438989c2ce6ac1c2c3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/5.jpg not downloaded yet
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe222c096bd0f44438989c2ce6ac1c2c3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/6.jpg not downloaded yet
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe222c096bd0f44438989c2ce6ac1c2c3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/7.jpg not downloaded yet
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904fe010>
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc392bf5-eee4-56b8-8c6a-91bf7e934679/dc392bf5-eee4-56b8-8c6a-91bf7e934679_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F0d80c57db75e4d9481c8be8c2c2c8128%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/3.jpg saved to cache
2026-03-27 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc392bf5-eee4-56b8-8c6a-91bf7e934679
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0e750>
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc392bf5-eee4-56b8-8c6a-91bf7e934679/dc392bf5-eee4-56b8-8c6a-91bf7e934679_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F0d80c57db75e4d9481c8be8c2c2c8128%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/7.jpg saved to cache
2026-03-27 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc392bf5-eee4-56b8-8c6a-91bf7e934679
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b58ad0>
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc392bf5-eee4-56b8-8c6a-91bf7e934679/dc392bf5-eee4-56b8-8c6a-91bf7e934679_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F0d80c57db75e4d9481c8be8c2c2c8128%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/6.jpg saved to cache
2026-03-27 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc392bf5-eee4-56b8-8c6a-91bf7e934679
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe222c096bd0f44438989c2ce6ac1c2c3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/8.jpg not downloaded yet
2026-03-27 16:52:19 [ayvens.fr] INFO: Found listing with ID: 1988497
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988497%27 HTTP/1.1" 200 None
2026-03-27 16:52:19 [ayvens.fr] INFO: Scrape type for 1988497: 1
2026-03-27 16:52:19 [ayvens.fr] INFO: Extracting data for car ID: 1988497
2026-03-27 16:52:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 658d0ebf-c531-5847-979e-36b92a0dcdf8 with identifier: 1988497
2026-03-27 16:52:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 658d0ebf-c531-5847-979e-36b92a0dcdf8 with scrape type 1
2026-03-27 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 658d0ebf-c531-5847-979e-36b92a0dcdf8
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F81215a5be3db4388a683bdd2997602c0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/1.jpg not downloaded yet
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d977d0>
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc392bf5-eee4-56b8-8c6a-91bf7e934679/dc392bf5-eee4-56b8-8c6a-91bf7e934679_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F0d80c57db75e4d9481c8be8c2c2c8128%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/5.jpg saved to cache
2026-03-27 16:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc392bf5-eee4-56b8-8c6a-91bf7e934679
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d48d50>
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc392bf5-eee4-56b8-8c6a-91bf7e934679/dc392bf5-eee4-56b8-8c6a-91bf7e934679_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F0d80c57db75e4d9481c8be8c2c2c8128%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/4.jpg saved to cache
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc392bf5-eee4-56b8-8c6a-91bf7e934679
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b06590>
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc392bf5-eee4-56b8-8c6a-91bf7e934679/dc392bf5-eee4-56b8-8c6a-91bf7e934679_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F0d80c57db75e4d9481c8be8c2c2c8128%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/8.jpg saved to cache
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc392bf5-eee4-56b8-8c6a-91bf7e934679
2026-03-27 16:52:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc392bf5-eee4-56b8-8c6a-91bf7e934679, skipping ID generation
2026-03-27 16:52:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc392bf5-eee4-56b8-8c6a-91bf7e934679 with scrape type 1
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc392bf5-eee4-56b8-8c6a-91bf7e934679 sending to next pipeline
2026-03-27 16:52:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: dc392bf5-eee4-56b8-8c6a-91bf7e934679, identifier: 1988495
2026-03-27 16:52:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: dc392bf5-eee4-56b8-8c6a-91bf7e934679 with identifier: 1988495
2026-03-27 16:52:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:52:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: dc392bf5-eee4-56b8-8c6a-91bf7e934679 with identifier: 1988495
2026-03-27 16:52:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: dc392bf5-eee4-56b8-8c6a-91bf7e934679 with identifier: 1988495 to the API
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 148,
'color': 'NOIR BRILLANT',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'dc392bf5-eee4-56b8-8c6a-91bf7e934679',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'AUDI',
'model': 'A4 AVANT',
'odometer': 111568,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc392bf5-eee4-56b8-8c6a-91bf7e934679/dc392bf5-eee4-56b8-8c6a-91bf7e934679_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408102,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc392bf5-eee4-56b8-8c6a-91bf7e934679/dc392bf5-eee4-56b8-8c6a-91bf7e934679_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408102,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc392bf5-eee4-56b8-8c6a-91bf7e934679/dc392bf5-eee4-56b8-8c6a-91bf7e934679_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382106,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc392bf5-eee4-56b8-8c6a-91bf7e934679/dc392bf5-eee4-56b8-8c6a-91bf7e934679_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369730,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc392bf5-eee4-56b8-8c6a-91bf7e934679/dc392bf5-eee4-56b8-8c6a-91bf7e934679_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327450,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc392bf5-eee4-56b8-8c6a-91bf7e934679/dc392bf5-eee4-56b8-8c6a-91bf7e934679_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321598,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc392bf5-eee4-56b8-8c6a-91bf7e934679/dc392bf5-eee4-56b8-8c6a-91bf7e934679_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294540,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc392bf5-eee4-56b8-8c6a-91bf7e934679/dc392bf5-eee4-56b8-8c6a-91bf7e934679_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166668,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/0d80c57db75e4d9481c8be8c2c2c8128/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-11',
'seats_number': 5,
'seller_name': None,
'title': 'AUDI A4 AVANT A4 Avant 40 TFSI 204ch Business line S tronic 7',
'transmission': 'automatic',
'trim': 'A4 Avant 40 TFSI 204ch Business line S tronic 7',
'vin': None,
'year': 2022}
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988495%27 HTTP/1.1" 200 None
2026-03-27 16:52:20 [ayvens.fr] INFO: Saving data for 1988495: {'created_time': 1774630340.546822, 'last_price_update_time': 1774630340.546832, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988495') HTTP/1.1" 204 0
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F81215a5be3db4388a683bdd2997602c0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/2.jpg not downloaded yet
2026-03-27 16:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F81215a5be3db4388a683bdd2997602c0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/3.jpg not downloaded yet
2026-03-27 16:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F81215a5be3db4388a683bdd2997602c0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/4.jpg not downloaded yet
2026-03-27 16:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F81215a5be3db4388a683bdd2997602c0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/5.jpg not downloaded yet
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F81215a5be3db4388a683bdd2997602c0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/6.jpg not downloaded yet
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F81215a5be3db4388a683bdd2997602c0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/7.jpg not downloaded yet
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F81215a5be3db4388a683bdd2997602c0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/8.jpg not downloaded yet
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4c8d0>
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_105f0bb9-963a-5042-a1b9-d75943145b5e/105f0bb9-963a-5042-a1b9-d75943145b5e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe222c096bd0f44438989c2ce6ac1c2c3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/2.jpg saved to cache
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 105f0bb9-963a-5042-a1b9-d75943145b5e
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f33910>
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_105f0bb9-963a-5042-a1b9-d75943145b5e/105f0bb9-963a-5042-a1b9-d75943145b5e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe222c096bd0f44438989c2ce6ac1c2c3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/1.jpg saved to cache
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 105f0bb9-963a-5042-a1b9-d75943145b5e
2026-03-27 16:52:20 [ayvens.fr] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 300
2026-03-27 16:52:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590514c10>
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_105f0bb9-963a-5042-a1b9-d75943145b5e/105f0bb9-963a-5042-a1b9-d75943145b5e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe222c096bd0f44438989c2ce6ac1c2c3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/5.jpg saved to cache
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 105f0bb9-963a-5042-a1b9-d75943145b5e
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4c1d0>
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_105f0bb9-963a-5042-a1b9-d75943145b5e/105f0bb9-963a-5042-a1b9-d75943145b5e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe222c096bd0f44438989c2ce6ac1c2c3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/4.jpg saved to cache
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 105f0bb9-963a-5042-a1b9-d75943145b5e
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590511410>
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_105f0bb9-963a-5042-a1b9-d75943145b5e/105f0bb9-963a-5042-a1b9-d75943145b5e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe222c096bd0f44438989c2ce6ac1c2c3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/7.jpg saved to cache
2026-03-27 16:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 105f0bb9-963a-5042-a1b9-d75943145b5e
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b07310>
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_105f0bb9-963a-5042-a1b9-d75943145b5e/105f0bb9-963a-5042-a1b9-d75943145b5e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe222c096bd0f44438989c2ce6ac1c2c3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/3.jpg saved to cache
2026-03-27 16:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 105f0bb9-963a-5042-a1b9-d75943145b5e
2026-03-27 16:52:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590faba10>
2026-03-27 16:52:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_105f0bb9-963a-5042-a1b9-d75943145b5e/105f0bb9-963a-5042-a1b9-d75943145b5e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe222c096bd0f44438989c2ce6ac1c2c3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/6.jpg saved to cache
2026-03-27 16:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 105f0bb9-963a-5042-a1b9-d75943145b5e
2026-03-27 16:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df7d10>
2026-03-27 16:52:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_105f0bb9-963a-5042-a1b9-d75943145b5e/105f0bb9-963a-5042-a1b9-d75943145b5e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fe222c096bd0f44438989c2ce6ac1c2c3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/8.jpg saved to cache
2026-03-27 16:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 105f0bb9-963a-5042-a1b9-d75943145b5e
2026-03-27 16:52:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 105f0bb9-963a-5042-a1b9-d75943145b5e, skipping ID generation
2026-03-27 16:52:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 105f0bb9-963a-5042-a1b9-d75943145b5e with scrape type 1
2026-03-27 16:52:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 105f0bb9-963a-5042-a1b9-d75943145b5e sending to next pipeline
2026-03-27 16:52:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 105f0bb9-963a-5042-a1b9-d75943145b5e, identifier: 1988496
2026-03-27 16:52:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 105f0bb9-963a-5042-a1b9-d75943145b5e with identifier: 1988496
2026-03-27 16:52:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 105f0bb9-963a-5042-a1b9-d75943145b5e with identifier: 1988496
2026-03-27 16:52:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 105f0bb9-963a-5042-a1b9-d75943145b5e with identifier: 1988496 to the API
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '105f0bb9-963a-5042-a1b9-d75943145b5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 37707,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_105f0bb9-963a-5042-a1b9-d75943145b5e/105f0bb9-963a-5042-a1b9-d75943145b5e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447946,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_105f0bb9-963a-5042-a1b9-d75943145b5e/105f0bb9-963a-5042-a1b9-d75943145b5e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447946,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_105f0bb9-963a-5042-a1b9-d75943145b5e/105f0bb9-963a-5042-a1b9-d75943145b5e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 573383,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_105f0bb9-963a-5042-a1b9-d75943145b5e/105f0bb9-963a-5042-a1b9-d75943145b5e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402631,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_105f0bb9-963a-5042-a1b9-d75943145b5e/105f0bb9-963a-5042-a1b9-d75943145b5e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 413876,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_105f0bb9-963a-5042-a1b9-d75943145b5e/105f0bb9-963a-5042-a1b9-d75943145b5e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450593,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_105f0bb9-963a-5042-a1b9-d75943145b5e/105f0bb9-963a-5042-a1b9-d75943145b5e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323439,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_105f0bb9-963a-5042-a1b9-d75943145b5e/105f0bb9-963a-5042-a1b9-d75943145b5e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329048,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/e222c096bd0f44438989c2ce6ac1c2c3/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-02',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 1.2 PureTech 110ch S&S Shine',
'transmission': 'manual',
'trim': 'C3 1.2 PureTech 110ch S&S Shine',
'vin': None,
'year': 2023}
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988496%27 HTTP/1.1" 200 None
2026-03-27 16:52:21 [ayvens.fr] INFO: Saving data for 1988496: {'created_time': 1774630341.82993, 'last_price_update_time': 1774630341.829941, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988496') HTTP/1.1" 204 0
2026-03-27 16:52:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b41d10>
2026-03-27 16:52:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_658d0ebf-c531-5847-979e-36b92a0dcdf8/658d0ebf-c531-5847-979e-36b92a0dcdf8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F81215a5be3db4388a683bdd2997602c0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/1.jpg saved to cache
2026-03-27 16:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 658d0ebf-c531-5847-979e-36b92a0dcdf8
2026-03-27 16:52:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f63950>
2026-03-27 16:52:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_658d0ebf-c531-5847-979e-36b92a0dcdf8/658d0ebf-c531-5847-979e-36b92a0dcdf8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F81215a5be3db4388a683bdd2997602c0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/3.jpg saved to cache
2026-03-27 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 658d0ebf-c531-5847-979e-36b92a0dcdf8
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c1490>
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_658d0ebf-c531-5847-979e-36b92a0dcdf8/658d0ebf-c531-5847-979e-36b92a0dcdf8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F81215a5be3db4388a683bdd2997602c0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/6.jpg saved to cache
2026-03-27 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 658d0ebf-c531-5847-979e-36b92a0dcdf8
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9e110>
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_658d0ebf-c531-5847-979e-36b92a0dcdf8/658d0ebf-c531-5847-979e-36b92a0dcdf8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F81215a5be3db4388a683bdd2997602c0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/2.jpg saved to cache
2026-03-27 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 658d0ebf-c531-5847-979e-36b92a0dcdf8
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d976d0>
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_658d0ebf-c531-5847-979e-36b92a0dcdf8/658d0ebf-c531-5847-979e-36b92a0dcdf8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F81215a5be3db4388a683bdd2997602c0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/5.jpg saved to cache
2026-03-27 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 658d0ebf-c531-5847-979e-36b92a0dcdf8
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f60d10>
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_658d0ebf-c531-5847-979e-36b92a0dcdf8/658d0ebf-c531-5847-979e-36b92a0dcdf8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F81215a5be3db4388a683bdd2997602c0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/4.jpg saved to cache
2026-03-27 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 658d0ebf-c531-5847-979e-36b92a0dcdf8
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4e710>
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_658d0ebf-c531-5847-979e-36b92a0dcdf8/658d0ebf-c531-5847-979e-36b92a0dcdf8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F81215a5be3db4388a683bdd2997602c0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/7.jpg saved to cache
2026-03-27 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 658d0ebf-c531-5847-979e-36b92a0dcdf8
2026-03-27 16:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e09090>
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_658d0ebf-c531-5847-979e-36b92a0dcdf8/658d0ebf-c531-5847-979e-36b92a0dcdf8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F81215a5be3db4388a683bdd2997602c0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/8.jpg saved to cache
2026-03-27 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 658d0ebf-c531-5847-979e-36b92a0dcdf8
2026-03-27 16:52:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 658d0ebf-c531-5847-979e-36b92a0dcdf8, skipping ID generation
2026-03-27 16:52:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 658d0ebf-c531-5847-979e-36b92a0dcdf8 with scrape type 1
2026-03-27 16:52:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 658d0ebf-c531-5847-979e-36b92a0dcdf8 sending to next pipeline
2026-03-27 16:52:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 658d0ebf-c531-5847-979e-36b92a0dcdf8, identifier: 1988497
2026-03-27 16:52:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 658d0ebf-c531-5847-979e-36b92a0dcdf8 with identifier: 1988497
2026-03-27 16:52:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:52:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 658d0ebf-c531-5847-979e-36b92a0dcdf8 with identifier: 1988497
2026-03-27 16:52:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 658d0ebf-c531-5847-979e-36b92a0dcdf8 with identifier: 1988497 to the API
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 30,
'color': 'SKYSCRAPER GRAU METALISEE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '658d0ebf-c531-5847-979e-36b92a0dcdf8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 3',
'odometer': 60896,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_658d0ebf-c531-5847-979e-36b92a0dcdf8/658d0ebf-c531-5847-979e-36b92a0dcdf8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417796,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_658d0ebf-c531-5847-979e-36b92a0dcdf8/658d0ebf-c531-5847-979e-36b92a0dcdf8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417796,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_658d0ebf-c531-5847-979e-36b92a0dcdf8/658d0ebf-c531-5847-979e-36b92a0dcdf8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_658d0ebf-c531-5847-979e-36b92a0dcdf8/658d0ebf-c531-5847-979e-36b92a0dcdf8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387024,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_658d0ebf-c531-5847-979e-36b92a0dcdf8/658d0ebf-c531-5847-979e-36b92a0dcdf8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374268,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_658d0ebf-c531-5847-979e-36b92a0dcdf8/658d0ebf-c531-5847-979e-36b92a0dcdf8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330732,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_658d0ebf-c531-5847-979e-36b92a0dcdf8/658d0ebf-c531-5847-979e-36b92a0dcdf8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363315,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_658d0ebf-c531-5847-979e-36b92a0dcdf8/658d0ebf-c531-5847-979e-36b92a0dcdf8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308136,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/81215a5be3db4388a683bdd2997602c0/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-26',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 3 Serie 3 320eA 204ch Business Design',
'transmission': 'automatic',
'trim': 'Serie 3 320eA 204ch Business Design',
'vin': None,
'year': 2023}
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988497%27 HTTP/1.1" 200 None
2026-03-27 16:52:23 [ayvens.fr] INFO: Saving data for 1988497: {'created_time': 1774630343.111647, 'last_price_update_time': 1774630343.111657, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988497') HTTP/1.1" 204 0
2026-03-27 16:52:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 16:52:23 [ayvens.fr] INFO: Found listing with ID: 1988498
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988498%27 HTTP/1.1" 200 None
2026-03-27 16:52:23 [ayvens.fr] INFO: Scrape type for 1988498: 1
2026-03-27 16:52:23 [ayvens.fr] INFO: Extracting data for car ID: 1988498
2026-03-27 16:52:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18409c7a-3d91-5c51-b2d1-94f987af007e with identifier: 1988498
2026-03-27 16:52:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18409c7a-3d91-5c51-b2d1-94f987af007e with scrape type 1
2026-03-27 16:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 18409c7a-3d91-5c51-b2d1-94f987af007e
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F11abd6a29f1945ef82df7389cdb9ce0a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/1.jpg not downloaded yet
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F11abd6a29f1945ef82df7389cdb9ce0a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/2.jpg not downloaded yet
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F11abd6a29f1945ef82df7389cdb9ce0a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/3.jpg not downloaded yet
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F11abd6a29f1945ef82df7389cdb9ce0a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/4.jpg not downloaded yet
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F11abd6a29f1945ef82df7389cdb9ce0a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/5.jpg not downloaded yet
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F11abd6a29f1945ef82df7389cdb9ce0a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/6.jpg not downloaded yet
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F11abd6a29f1945ef82df7389cdb9ce0a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/7.jpg not downloaded yet
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F11abd6a29f1945ef82df7389cdb9ce0a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/8.jpg not downloaded yet
2026-03-27 16:52:23 [ayvens.fr] INFO: Found listing with ID: 1988499
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988499%27 HTTP/1.1" 200 None
2026-03-27 16:52:23 [ayvens.fr] INFO: Scrape type for 1988499: 1
2026-03-27 16:52:23 [ayvens.fr] INFO: Extracting data for car ID: 1988499
2026-03-27 16:52:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b24fef3-fcb3-5969-9cfa-9225c20cf0a8 with identifier: 1988499
2026-03-27 16:52:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b24fef3-fcb3-5969-9cfa-9225c20cf0a8 with scrape type 1
2026-03-27 16:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 2b24fef3-fcb3-5969-9cfa-9225c20cf0a8
2026-03-27 16:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F863591bf01b8410dbc686ad3b4f7c454%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/1.jpg not downloaded yet
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F863591bf01b8410dbc686ad3b4f7c454%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/2.jpg not downloaded yet
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F863591bf01b8410dbc686ad3b4f7c454%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/3.jpg not downloaded yet
2026-03-27 16:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F863591bf01b8410dbc686ad3b4f7c454%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/4.jpg not downloaded yet
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F863591bf01b8410dbc686ad3b4f7c454%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/5.jpg not downloaded yet
2026-03-27 16:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F863591bf01b8410dbc686ad3b4f7c454%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/6.jpg not downloaded yet
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F863591bf01b8410dbc686ad3b4f7c454%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/7.jpg not downloaded yet
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F863591bf01b8410dbc686ad3b4f7c454%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/8.jpg not downloaded yet
2026-03-27 16:52:24 [ayvens.fr] INFO: Found listing with ID: 1988500
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988500%27 HTTP/1.1" 200 None
2026-03-27 16:52:24 [ayvens.fr] INFO: Scrape type for 1988500: 1
2026-03-27 16:52:24 [ayvens.fr] INFO: Extracting data for car ID: 1988500
2026-03-27 16:52:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3bead50-5fb1-5505-8590-ccb1deda2d62 with identifier: 1988500
2026-03-27 16:52:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3bead50-5fb1-5505-8590-ccb1deda2d62 with scrape type 1
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f3bead50-5fb1-5505-8590-ccb1deda2d62
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa247e4f74bd5493686e3d0523357bdd3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/1.jpg not downloaded yet
2026-03-27 16:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa247e4f74bd5493686e3d0523357bdd3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/2.jpg not downloaded yet
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0ae10>
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18409c7a-3d91-5c51-b2d1-94f987af007e/18409c7a-3d91-5c51-b2d1-94f987af007e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F11abd6a29f1945ef82df7389cdb9ce0a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/1.jpg saved to cache
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18409c7a-3d91-5c51-b2d1-94f987af007e
2026-03-27 16:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa247e4f74bd5493686e3d0523357bdd3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/3.jpg not downloaded yet
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa247e4f74bd5493686e3d0523357bdd3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/4.jpg not downloaded yet
2026-03-27 16:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa247e4f74bd5493686e3d0523357bdd3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/5.jpg not downloaded yet
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59067d410>
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18409c7a-3d91-5c51-b2d1-94f987af007e/18409c7a-3d91-5c51-b2d1-94f987af007e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F11abd6a29f1945ef82df7389cdb9ce0a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/3.jpg saved to cache
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18409c7a-3d91-5c51-b2d1-94f987af007e
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f305d0>
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18409c7a-3d91-5c51-b2d1-94f987af007e/18409c7a-3d91-5c51-b2d1-94f987af007e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F11abd6a29f1945ef82df7389cdb9ce0a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/2.jpg saved to cache
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18409c7a-3d91-5c51-b2d1-94f987af007e
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d8fa90>
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18409c7a-3d91-5c51-b2d1-94f987af007e/18409c7a-3d91-5c51-b2d1-94f987af007e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F11abd6a29f1945ef82df7389cdb9ce0a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/4.jpg saved to cache
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18409c7a-3d91-5c51-b2d1-94f987af007e
2026-03-27 16:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa247e4f74bd5493686e3d0523357bdd3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/6.jpg not downloaded yet
2026-03-27 16:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa247e4f74bd5493686e3d0523357bdd3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/7.jpg not downloaded yet
2026-03-27 16:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0c550>
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18409c7a-3d91-5c51-b2d1-94f987af007e/18409c7a-3d91-5c51-b2d1-94f987af007e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F11abd6a29f1945ef82df7389cdb9ce0a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/7.jpg saved to cache
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 18409c7a-3d91-5c51-b2d1-94f987af007e
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d96e90>
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b24fef3-fcb3-5969-9cfa-9225c20cf0a8/2b24fef3-fcb3-5969-9cfa-9225c20cf0a8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F863591bf01b8410dbc686ad3b4f7c454%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/1.jpg saved to cache
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b24fef3-fcb3-5969-9cfa-9225c20cf0a8
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590afc390>
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b24fef3-fcb3-5969-9cfa-9225c20cf0a8/2b24fef3-fcb3-5969-9cfa-9225c20cf0a8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F863591bf01b8410dbc686ad3b4f7c454%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/2.jpg saved to cache
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b24fef3-fcb3-5969-9cfa-9225c20cf0a8
2026-03-27 16:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa247e4f74bd5493686e3d0523357bdd3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/8.jpg not downloaded yet
2026-03-27 16:52:24 [ayvens.fr] INFO: Found listing with ID: 1988501
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988501%27 HTTP/1.1" 200 None
2026-03-27 16:52:24 [ayvens.fr] INFO: Scrape type for 1988501: 1
2026-03-27 16:52:24 [ayvens.fr] INFO: Extracting data for car ID: 1988501
2026-03-27 16:52:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d3b8500-2149-5cfd-bf9a-0475fa4221c9 with identifier: 1988501
2026-03-27 16:52:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d3b8500-2149-5cfd-bf9a-0475fa4221c9 with scrape type 1
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6d3b8500-2149-5cfd-bf9a-0475fa4221c9
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4c8f10a2fbca48c9ad6caf4f0a251448%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/1.jpg not downloaded yet
2026-03-27 16:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4c8f10a2fbca48c9ad6caf4f0a251448%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/2.jpg not downloaded yet
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d96f90>
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18409c7a-3d91-5c51-b2d1-94f987af007e/18409c7a-3d91-5c51-b2d1-94f987af007e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F11abd6a29f1945ef82df7389cdb9ce0a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/5.jpg saved to cache
2026-03-27 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18409c7a-3d91-5c51-b2d1-94f987af007e
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b66c90>
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18409c7a-3d91-5c51-b2d1-94f987af007e/18409c7a-3d91-5c51-b2d1-94f987af007e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F11abd6a29f1945ef82df7389cdb9ce0a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/6.jpg saved to cache
2026-03-27 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18409c7a-3d91-5c51-b2d1-94f987af007e
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f32b90>
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b24fef3-fcb3-5969-9cfa-9225c20cf0a8/2b24fef3-fcb3-5969-9cfa-9225c20cf0a8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F863591bf01b8410dbc686ad3b4f7c454%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/4.jpg saved to cache
2026-03-27 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b24fef3-fcb3-5969-9cfa-9225c20cf0a8
2026-03-27 16:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4c8f10a2fbca48c9ad6caf4f0a251448%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/3.jpg not downloaded yet
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4c8f10a2fbca48c9ad6caf4f0a251448%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/4.jpg not downloaded yet
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d8e6d0>
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18409c7a-3d91-5c51-b2d1-94f987af007e/18409c7a-3d91-5c51-b2d1-94f987af007e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F11abd6a29f1945ef82df7389cdb9ce0a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/8.jpg saved to cache
2026-03-27 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 18409c7a-3d91-5c51-b2d1-94f987af007e
2026-03-27 16:52:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18409c7a-3d91-5c51-b2d1-94f987af007e, skipping ID generation
2026-03-27 16:52:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18409c7a-3d91-5c51-b2d1-94f987af007e with scrape type 1
2026-03-27 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18409c7a-3d91-5c51-b2d1-94f987af007e sending to next pipeline
2026-03-27 16:52:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 18409c7a-3d91-5c51-b2d1-94f987af007e, identifier: 1988498
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b048d0>
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b24fef3-fcb3-5969-9cfa-9225c20cf0a8/2b24fef3-fcb3-5969-9cfa-9225c20cf0a8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F863591bf01b8410dbc686ad3b4f7c454%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/3.jpg saved to cache
2026-03-27 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b24fef3-fcb3-5969-9cfa-9225c20cf0a8
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910ecf90>
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b24fef3-fcb3-5969-9cfa-9225c20cf0a8/2b24fef3-fcb3-5969-9cfa-9225c20cf0a8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F863591bf01b8410dbc686ad3b4f7c454%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/5.jpg saved to cache
2026-03-27 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b24fef3-fcb3-5969-9cfa-9225c20cf0a8
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0e3d0>
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b24fef3-fcb3-5969-9cfa-9225c20cf0a8/2b24fef3-fcb3-5969-9cfa-9225c20cf0a8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F863591bf01b8410dbc686ad3b4f7c454%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/7.jpg saved to cache
2026-03-27 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2b24fef3-fcb3-5969-9cfa-9225c20cf0a8
2026-03-27 16:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4c8f10a2fbca48c9ad6caf4f0a251448%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/5.jpg not downloaded yet
2026-03-27 16:52:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 18409c7a-3d91-5c51-b2d1-94f987af007e with identifier: 1988498
2026-03-27 16:52:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:52:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 18409c7a-3d91-5c51-b2d1-94f987af007e with identifier: 1988498
2026-03-27 16:52:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 18409c7a-3d91-5c51-b2d1-94f987af007e with identifier: 1988498 to the API
2026-03-27 16:52:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 24,
'color': 'VOLATION BLUE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '18409c7a-3d91-5c51-b2d1-94f987af007e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'LYNK & CO',
'model': '01',
'odometer': 28993,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18409c7a-3d91-5c51-b2d1-94f987af007e/18409c7a-3d91-5c51-b2d1-94f987af007e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340674,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18409c7a-3d91-5c51-b2d1-94f987af007e/18409c7a-3d91-5c51-b2d1-94f987af007e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340674,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18409c7a-3d91-5c51-b2d1-94f987af007e/18409c7a-3d91-5c51-b2d1-94f987af007e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383544,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18409c7a-3d91-5c51-b2d1-94f987af007e/18409c7a-3d91-5c51-b2d1-94f987af007e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355619,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18409c7a-3d91-5c51-b2d1-94f987af007e/18409c7a-3d91-5c51-b2d1-94f987af007e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353131,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18409c7a-3d91-5c51-b2d1-94f987af007e/18409c7a-3d91-5c51-b2d1-94f987af007e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372243,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18409c7a-3d91-5c51-b2d1-94f987af007e/18409c7a-3d91-5c51-b2d1-94f987af007e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285602,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18409c7a-3d91-5c51-b2d1-94f987af007e/18409c7a-3d91-5c51-b2d1-94f987af007e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428995,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/11abd6a29f1945ef82df7389cdb9ce0a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-09',
'seats_number': 5,
'seller_name': None,
'title': 'LYNK & CO 01 01 1.5 PHEV 261ch DCTH 7',
'transmission': 'automatic',
'trim': '01 1.5 PHEV 261ch DCTH 7',
'vin': None,
'year': 2023}
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988498%27 HTTP/1.1" 200 None
2026-03-27 16:52:26 [ayvens.fr] INFO: Saving data for 1988498: {'created_time': 1774630346.139947, 'last_price_update_time': 1774630346.139958, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988498') HTTP/1.1" 204 0
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4c8f10a2fbca48c9ad6caf4f0a251448%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/6.jpg not downloaded yet
2026-03-27 16:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4c8f10a2fbca48c9ad6caf4f0a251448%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/7.jpg not downloaded yet
2026-03-27 16:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d960d0>
2026-03-27 16:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b24fef3-fcb3-5969-9cfa-9225c20cf0a8/2b24fef3-fcb3-5969-9cfa-9225c20cf0a8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F863591bf01b8410dbc686ad3b4f7c454%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/6.jpg saved to cache
2026-03-27 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2b24fef3-fcb3-5969-9cfa-9225c20cf0a8
2026-03-27 16:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4e710>
2026-03-27 16:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b24fef3-fcb3-5969-9cfa-9225c20cf0a8/2b24fef3-fcb3-5969-9cfa-9225c20cf0a8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252F863591bf01b8410dbc686ad3b4f7c454%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/8.jpg saved to cache
2026-03-27 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2b24fef3-fcb3-5969-9cfa-9225c20cf0a8
2026-03-27 16:52:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b24fef3-fcb3-5969-9cfa-9225c20cf0a8, skipping ID generation
2026-03-27 16:52:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b24fef3-fcb3-5969-9cfa-9225c20cf0a8 with scrape type 1
2026-03-27 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b24fef3-fcb3-5969-9cfa-9225c20cf0a8 sending to next pipeline
2026-03-27 16:52:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 2b24fef3-fcb3-5969-9cfa-9225c20cf0a8, identifier: 1988499
2026-03-27 16:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f31990>
2026-03-27 16:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3bead50-5fb1-5505-8590-ccb1deda2d62/f3bead50-5fb1-5505-8590-ccb1deda2d62_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa247e4f74bd5493686e3d0523357bdd3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/4.jpg saved to cache
2026-03-27 16:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f3bead50-5fb1-5505-8590-ccb1deda2d62
2026-03-27 16:52:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 2b24fef3-fcb3-5969-9cfa-9225c20cf0a8 with identifier: 1988499
2026-03-27 16:52:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 2b24fef3-fcb3-5969-9cfa-9225c20cf0a8 with identifier: 1988499
2026-03-27 16:52:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 2b24fef3-fcb3-5969-9cfa-9225c20cf0a8 with identifier: 1988499 to the API
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'GRIS ACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '2b24fef3-fcb3-5969-9cfa-9225c20cf0a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 52317,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b24fef3-fcb3-5969-9cfa-9225c20cf0a8/2b24fef3-fcb3-5969-9cfa-9225c20cf0a8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423407,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b24fef3-fcb3-5969-9cfa-9225c20cf0a8/2b24fef3-fcb3-5969-9cfa-9225c20cf0a8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423407,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b24fef3-fcb3-5969-9cfa-9225c20cf0a8/2b24fef3-fcb3-5969-9cfa-9225c20cf0a8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 489928,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b24fef3-fcb3-5969-9cfa-9225c20cf0a8/2b24fef3-fcb3-5969-9cfa-9225c20cf0a8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402593,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b24fef3-fcb3-5969-9cfa-9225c20cf0a8/2b24fef3-fcb3-5969-9cfa-9225c20cf0a8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474173,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b24fef3-fcb3-5969-9cfa-9225c20cf0a8/2b24fef3-fcb3-5969-9cfa-9225c20cf0a8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b24fef3-fcb3-5969-9cfa-9225c20cf0a8/2b24fef3-fcb3-5969-9cfa-9225c20cf0a8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255317,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b24fef3-fcb3-5969-9cfa-9225c20cf0a8/2b24fef3-fcb3-5969-9cfa-9225c20cf0a8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327578,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/863591bf01b8410dbc686ad3b4f7c454/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-05',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 230ch HEV Active Business BVA6 4x2',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 230ch HEV Active Business BVA6 4x2',
'vin': None,
'year': 2023}
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988499%27 HTTP/1.1" 200 None
2026-03-27 16:52:26 [ayvens.fr] INFO: Saving data for 1988499: {'created_time': 1774630346.97751, 'last_price_update_time': 1774630346.97752, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988499') HTTP/1.1" 204 0
2026-03-27 16:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4c8f10a2fbca48c9ad6caf4f0a251448%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/8.jpg not downloaded yet
2026-03-27 16:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:27 [ayvens.fr] INFO: Found listing with ID: 1988502
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988502%27 HTTP/1.1" 200 None
2026-03-27 16:52:27 [ayvens.fr] INFO: Scrape type for 1988502: 1
2026-03-27 16:52:27 [ayvens.fr] INFO: Extracting data for car ID: 1988502
2026-03-27 16:52:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdc5c713-c60a-569c-bbaf-86caa6c51043 with identifier: 1988502
2026-03-27 16:52:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdc5c713-c60a-569c-bbaf-86caa6c51043 with scrape type 1
2026-03-27 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item cdc5c713-c60a-569c-bbaf-86caa6c51043
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F907d29df4e3746dfaa56ea73f891306b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/1.jpg not downloaded yet
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efef50>
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3bead50-5fb1-5505-8590-ccb1deda2d62/f3bead50-5fb1-5505-8590-ccb1deda2d62_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa247e4f74bd5493686e3d0523357bdd3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/2.jpg saved to cache
2026-03-27 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f3bead50-5fb1-5505-8590-ccb1deda2d62
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e16390>
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3bead50-5fb1-5505-8590-ccb1deda2d62/f3bead50-5fb1-5505-8590-ccb1deda2d62_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa247e4f74bd5493686e3d0523357bdd3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/1.jpg saved to cache
2026-03-27 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3bead50-5fb1-5505-8590-ccb1deda2d62
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abd950>
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3bead50-5fb1-5505-8590-ccb1deda2d62/f3bead50-5fb1-5505-8590-ccb1deda2d62_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa247e4f74bd5493686e3d0523357bdd3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/3.jpg saved to cache
2026-03-27 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f3bead50-5fb1-5505-8590-ccb1deda2d62
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d53450>
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3bead50-5fb1-5505-8590-ccb1deda2d62/f3bead50-5fb1-5505-8590-ccb1deda2d62_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa247e4f74bd5493686e3d0523357bdd3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/7.jpg saved to cache
2026-03-27 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f3bead50-5fb1-5505-8590-ccb1deda2d62
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F907d29df4e3746dfaa56ea73f891306b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/2.jpg not downloaded yet
2026-03-27 16:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F907d29df4e3746dfaa56ea73f891306b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/3.jpg not downloaded yet
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590517910>
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3bead50-5fb1-5505-8590-ccb1deda2d62/f3bead50-5fb1-5505-8590-ccb1deda2d62_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa247e4f74bd5493686e3d0523357bdd3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/6.jpg saved to cache
2026-03-27 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f3bead50-5fb1-5505-8590-ccb1deda2d62
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b5ab50>
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3bead50-5fb1-5505-8590-ccb1deda2d62/f3bead50-5fb1-5505-8590-ccb1deda2d62_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa247e4f74bd5493686e3d0523357bdd3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/5.jpg saved to cache
2026-03-27 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f3bead50-5fb1-5505-8590-ccb1deda2d62
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590528410>
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3bead50-5fb1-5505-8590-ccb1deda2d62/f3bead50-5fb1-5505-8590-ccb1deda2d62_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa247e4f74bd5493686e3d0523357bdd3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/8.jpg saved to cache
2026-03-27 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f3bead50-5fb1-5505-8590-ccb1deda2d62
2026-03-27 16:52:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3bead50-5fb1-5505-8590-ccb1deda2d62, skipping ID generation
2026-03-27 16:52:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3bead50-5fb1-5505-8590-ccb1deda2d62 with scrape type 1
2026-03-27 16:52:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3bead50-5fb1-5505-8590-ccb1deda2d62 sending to next pipeline
2026-03-27 16:52:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f3bead50-5fb1-5505-8590-ccb1deda2d62, identifier: 1988500
2026-03-27 16:52:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f3bead50-5fb1-5505-8590-ccb1deda2d62 with identifier: 1988500
2026-03-27 16:52:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:52:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f3bead50-5fb1-5505-8590-ccb1deda2d62 with identifier: 1988500
2026-03-27 16:52:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f3bead50-5fb1-5505-8590-ccb1deda2d62 with identifier: 1988500 to the API
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 146,
'color': 'GRIS PLATINUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'f3bead50-5fb1-5505-8590-ccb1deda2d62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 126421,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3bead50-5fb1-5505-8590-ccb1deda2d62/f3bead50-5fb1-5505-8590-ccb1deda2d62_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 520088,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3bead50-5fb1-5505-8590-ccb1deda2d62/f3bead50-5fb1-5505-8590-ccb1deda2d62_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 520088,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3bead50-5fb1-5505-8590-ccb1deda2d62/f3bead50-5fb1-5505-8590-ccb1deda2d62_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476194,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3bead50-5fb1-5505-8590-ccb1deda2d62/f3bead50-5fb1-5505-8590-ccb1deda2d62_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316463,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3bead50-5fb1-5505-8590-ccb1deda2d62/f3bead50-5fb1-5505-8590-ccb1deda2d62_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411292,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3bead50-5fb1-5505-8590-ccb1deda2d62/f3bead50-5fb1-5505-8590-ccb1deda2d62_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379206,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3bead50-5fb1-5505-8590-ccb1deda2d62/f3bead50-5fb1-5505-8590-ccb1deda2d62_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238542,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3bead50-5fb1-5505-8590-ccb1deda2d62/f3bead50-5fb1-5505-8590-ccb1deda2d62_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 472122,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a247e4f74bd5493686e3d0523357bdd3/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-19',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '3008 1.2 PureTech 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988500%27 HTTP/1.1" 200 None
2026-03-27 16:52:27 [ayvens.fr] INFO: Saving data for 1988500: {'created_time': 1774630347.973972, 'last_price_update_time': 1774630347.973984, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988500') HTTP/1.1" 204 0
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F907d29df4e3746dfaa56ea73f891306b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/4.jpg not downloaded yet
2026-03-27 16:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d5b190>
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d3b8500-2149-5cfd-bf9a-0475fa4221c9/6d3b8500-2149-5cfd-bf9a-0475fa4221c9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4c8f10a2fbca48c9ad6caf4f0a251448%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/1.jpg saved to cache
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d3b8500-2149-5cfd-bf9a-0475fa4221c9
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904fcf50>
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d3b8500-2149-5cfd-bf9a-0475fa4221c9/6d3b8500-2149-5cfd-bf9a-0475fa4221c9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4c8f10a2fbca48c9ad6caf4f0a251448%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/5.jpg saved to cache
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d3b8500-2149-5cfd-bf9a-0475fa4221c9
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee1c10>
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d3b8500-2149-5cfd-bf9a-0475fa4221c9/6d3b8500-2149-5cfd-bf9a-0475fa4221c9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4c8f10a2fbca48c9ad6caf4f0a251448%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/4.jpg saved to cache
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d3b8500-2149-5cfd-bf9a-0475fa4221c9
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590afc710>
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d3b8500-2149-5cfd-bf9a-0475fa4221c9/6d3b8500-2149-5cfd-bf9a-0475fa4221c9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4c8f10a2fbca48c9ad6caf4f0a251448%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/3.jpg saved to cache
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d3b8500-2149-5cfd-bf9a-0475fa4221c9
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0f210>
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d3b8500-2149-5cfd-bf9a-0475fa4221c9/6d3b8500-2149-5cfd-bf9a-0475fa4221c9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4c8f10a2fbca48c9ad6caf4f0a251448%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/2.jpg saved to cache
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d3b8500-2149-5cfd-bf9a-0475fa4221c9
2026-03-27 16:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F907d29df4e3746dfaa56ea73f891306b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/5.jpg not downloaded yet
2026-03-27 16:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F907d29df4e3746dfaa56ea73f891306b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/6.jpg not downloaded yet
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590aea090>
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d3b8500-2149-5cfd-bf9a-0475fa4221c9/6d3b8500-2149-5cfd-bf9a-0475fa4221c9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4c8f10a2fbca48c9ad6caf4f0a251448%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/6.jpg saved to cache
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d3b8500-2149-5cfd-bf9a-0475fa4221c9
2026-03-27 16:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F907d29df4e3746dfaa56ea73f891306b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/7.jpg not downloaded yet
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4c850>
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d3b8500-2149-5cfd-bf9a-0475fa4221c9/6d3b8500-2149-5cfd-bf9a-0475fa4221c9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4c8f10a2fbca48c9ad6caf4f0a251448%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/7.jpg saved to cache
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d3b8500-2149-5cfd-bf9a-0475fa4221c9
2026-03-27 16:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F907d29df4e3746dfaa56ea73f891306b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/8.jpg not downloaded yet
2026-03-27 16:52:28 [ayvens.fr] INFO: Found listing with ID: 1988503
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988503%27 HTTP/1.1" 200 None
2026-03-27 16:52:28 [ayvens.fr] INFO: Scrape type for 1988503: 1
2026-03-27 16:52:28 [ayvens.fr] INFO: Extracting data for car ID: 1988503
2026-03-27 16:52:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d1c66b3-0ad9-5818-93b7-73e4aef1d100 with identifier: 1988503
2026-03-27 16:52:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d1c66b3-0ad9-5818-93b7-73e4aef1d100 with scrape type 1
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1d1c66b3-0ad9-5818-93b7-73e4aef1d100
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F2a675777140a4bcabc1d9de619616e69%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/1.jpg not downloaded yet
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a1650>
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d3b8500-2149-5cfd-bf9a-0475fa4221c9/6d3b8500-2149-5cfd-bf9a-0475fa4221c9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F4c8f10a2fbca48c9ad6caf4f0a251448%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/8.jpg saved to cache
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d3b8500-2149-5cfd-bf9a-0475fa4221c9
2026-03-27 16:52:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d3b8500-2149-5cfd-bf9a-0475fa4221c9, skipping ID generation
2026-03-27 16:52:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d3b8500-2149-5cfd-bf9a-0475fa4221c9 with scrape type 1
2026-03-27 16:52:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d3b8500-2149-5cfd-bf9a-0475fa4221c9 sending to next pipeline
2026-03-27 16:52:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6d3b8500-2149-5cfd-bf9a-0475fa4221c9, identifier: 1988501
2026-03-27 16:52:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6d3b8500-2149-5cfd-bf9a-0475fa4221c9 with identifier: 1988501
2026-03-27 16:52:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6d3b8500-2149-5cfd-bf9a-0475fa4221c9 with identifier: 1988501
2026-03-27 16:52:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6d3b8500-2149-5cfd-bf9a-0475fa4221c9 with identifier: 1988501 to the API
2026-03-27 16:52:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '6d3b8500-2149-5cfd-bf9a-0475fa4221c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 1',
'odometer': 124240,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d3b8500-2149-5cfd-bf9a-0475fa4221c9/6d3b8500-2149-5cfd-bf9a-0475fa4221c9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352627,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d3b8500-2149-5cfd-bf9a-0475fa4221c9/6d3b8500-2149-5cfd-bf9a-0475fa4221c9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352627,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d3b8500-2149-5cfd-bf9a-0475fa4221c9/6d3b8500-2149-5cfd-bf9a-0475fa4221c9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321994,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d3b8500-2149-5cfd-bf9a-0475fa4221c9/6d3b8500-2149-5cfd-bf9a-0475fa4221c9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271707,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d3b8500-2149-5cfd-bf9a-0475fa4221c9/6d3b8500-2149-5cfd-bf9a-0475fa4221c9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279576,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d3b8500-2149-5cfd-bf9a-0475fa4221c9/6d3b8500-2149-5cfd-bf9a-0475fa4221c9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 270192,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d3b8500-2149-5cfd-bf9a-0475fa4221c9/6d3b8500-2149-5cfd-bf9a-0475fa4221c9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334710,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d3b8500-2149-5cfd-bf9a-0475fa4221c9/6d3b8500-2149-5cfd-bf9a-0475fa4221c9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301602,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/4c8f10a2fbca48c9ad6caf4f0a251448/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 1 Serie 1 116dA 116ch Business Design DKG7',
'transmission': 'automatic',
'trim': 'Serie 1 116dA 116ch Business Design DKG7',
'vin': None,
'year': 2022}
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988501%27 HTTP/1.1" 200 None
2026-03-27 16:52:29 [ayvens.fr] INFO: Saving data for 1988501: {'created_time': 1774630349.251831, 'last_price_update_time': 1774630349.251842, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988501') HTTP/1.1" 204 0
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F2a675777140a4bcabc1d9de619616e69%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/2.jpg not downloaded yet
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b4b350>
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdc5c713-c60a-569c-bbaf-86caa6c51043/cdc5c713-c60a-569c-bbaf-86caa6c51043_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F907d29df4e3746dfaa56ea73f891306b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/1.jpg saved to cache
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cdc5c713-c60a-569c-bbaf-86caa6c51043
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590592d10>
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdc5c713-c60a-569c-bbaf-86caa6c51043/cdc5c713-c60a-569c-bbaf-86caa6c51043_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F907d29df4e3746dfaa56ea73f891306b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/2.jpg saved to cache
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cdc5c713-c60a-569c-bbaf-86caa6c51043
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F2a675777140a4bcabc1d9de619616e69%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/3.jpg not downloaded yet
2026-03-27 16:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F2a675777140a4bcabc1d9de619616e69%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/4.jpg not downloaded yet
2026-03-27 16:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F2a675777140a4bcabc1d9de619616e69%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/5.jpg not downloaded yet
2026-03-27 16:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F2a675777140a4bcabc1d9de619616e69%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/6.jpg not downloaded yet
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F2a675777140a4bcabc1d9de619616e69%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/7.jpg not downloaded yet
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F2a675777140a4bcabc1d9de619616e69%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/8.jpg not downloaded yet
2026-03-27 16:52:29 [ayvens.fr] INFO: Found listing with ID: 1988504
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988504%27 HTTP/1.1" 200 None
2026-03-27 16:52:29 [ayvens.fr] INFO: Scrape type for 1988504: 1
2026-03-27 16:52:29 [ayvens.fr] INFO: Extracting data for car ID: 1988504
2026-03-27 16:52:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c4d96f0-bd98-5b18-91c2-f6eb64495f52 with identifier: 1988504
2026-03-27 16:52:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c4d96f0-bd98-5b18-91c2-f6eb64495f52 with scrape type 1
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 8c4d96f0-bd98-5b18-91c2-f6eb64495f52
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe20c0a05f0424097b66445361d562d24%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/1.jpg not downloaded yet
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590af3d50>
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdc5c713-c60a-569c-bbaf-86caa6c51043/cdc5c713-c60a-569c-bbaf-86caa6c51043_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F907d29df4e3746dfaa56ea73f891306b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/7.jpg saved to cache
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cdc5c713-c60a-569c-bbaf-86caa6c51043
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0eb50>
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdc5c713-c60a-569c-bbaf-86caa6c51043/cdc5c713-c60a-569c-bbaf-86caa6c51043_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F907d29df4e3746dfaa56ea73f891306b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/4.jpg saved to cache
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cdc5c713-c60a-569c-bbaf-86caa6c51043
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910015d0>
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdc5c713-c60a-569c-bbaf-86caa6c51043/cdc5c713-c60a-569c-bbaf-86caa6c51043_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F907d29df4e3746dfaa56ea73f891306b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/6.jpg saved to cache
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cdc5c713-c60a-569c-bbaf-86caa6c51043
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe20c0a05f0424097b66445361d562d24%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/2.jpg not downloaded yet
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe20c0a05f0424097b66445361d562d24%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/3.jpg not downloaded yet
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2e350>
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdc5c713-c60a-569c-bbaf-86caa6c51043/cdc5c713-c60a-569c-bbaf-86caa6c51043_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F907d29df4e3746dfaa56ea73f891306b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/5.jpg saved to cache
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cdc5c713-c60a-569c-bbaf-86caa6c51043
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b23c10>
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdc5c713-c60a-569c-bbaf-86caa6c51043/cdc5c713-c60a-569c-bbaf-86caa6c51043_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F907d29df4e3746dfaa56ea73f891306b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/3.jpg saved to cache
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cdc5c713-c60a-569c-bbaf-86caa6c51043
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b4bcd0>
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdc5c713-c60a-569c-bbaf-86caa6c51043/cdc5c713-c60a-569c-bbaf-86caa6c51043_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F907d29df4e3746dfaa56ea73f891306b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/8.jpg saved to cache
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cdc5c713-c60a-569c-bbaf-86caa6c51043
2026-03-27 16:52:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cdc5c713-c60a-569c-bbaf-86caa6c51043, skipping ID generation
2026-03-27 16:52:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdc5c713-c60a-569c-bbaf-86caa6c51043 with scrape type 1
2026-03-27 16:52:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cdc5c713-c60a-569c-bbaf-86caa6c51043 sending to next pipeline
2026-03-27 16:52:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: cdc5c713-c60a-569c-bbaf-86caa6c51043, identifier: 1988502
2026-03-27 16:52:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: cdc5c713-c60a-569c-bbaf-86caa6c51043 with identifier: 1988502
2026-03-27 16:52:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: cdc5c713-c60a-569c-bbaf-86caa6c51043 with identifier: 1988502
2026-03-27 16:52:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: cdc5c713-c60a-569c-bbaf-86caa6c51043 with identifier: 1988502 to the API
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'cdc5c713-c60a-569c-bbaf-86caa6c51043',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 67119,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc5c713-c60a-569c-bbaf-86caa6c51043/cdc5c713-c60a-569c-bbaf-86caa6c51043_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346497,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc5c713-c60a-569c-bbaf-86caa6c51043/cdc5c713-c60a-569c-bbaf-86caa6c51043_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346497,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc5c713-c60a-569c-bbaf-86caa6c51043/cdc5c713-c60a-569c-bbaf-86caa6c51043_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402135,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc5c713-c60a-569c-bbaf-86caa6c51043/cdc5c713-c60a-569c-bbaf-86caa6c51043_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305870,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc5c713-c60a-569c-bbaf-86caa6c51043/cdc5c713-c60a-569c-bbaf-86caa6c51043_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349785,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc5c713-c60a-569c-bbaf-86caa6c51043/cdc5c713-c60a-569c-bbaf-86caa6c51043_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288755,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc5c713-c60a-569c-bbaf-86caa6c51043/cdc5c713-c60a-569c-bbaf-86caa6c51043_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220829,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc5c713-c60a-569c-bbaf-86caa6c51043/cdc5c713-c60a-569c-bbaf-86caa6c51043_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268879,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/907d29df4e3746dfaa56ea73f891306b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-11',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CAPTUR Captur 1.0 TCe 100ch Business',
'transmission': 'manual',
'trim': 'Captur 1.0 TCe 100ch Business',
'vin': None,
'year': 2020}
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988502%27 HTTP/1.1" 200 None
2026-03-27 16:52:30 [ayvens.fr] INFO: Saving data for 1988502: {'created_time': 1774630350.424256, 'last_price_update_time': 1774630350.424268, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988502') HTTP/1.1" 204 0
2026-03-27 16:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe20c0a05f0424097b66445361d562d24%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/4.jpg not downloaded yet
2026-03-27 16:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe20c0a05f0424097b66445361d562d24%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/5.jpg not downloaded yet
2026-03-27 16:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe20c0a05f0424097b66445361d562d24%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/6.jpg not downloaded yet
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe20c0a05f0424097b66445361d562d24%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/7.jpg not downloaded yet
2026-03-27 16:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe20c0a05f0424097b66445361d562d24%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/8.jpg not downloaded yet
2026-03-27 16:52:30 [ayvens.fr] INFO: Found listing with ID: 1988505
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988505%27 HTTP/1.1" 200 None
2026-03-27 16:52:30 [ayvens.fr] INFO: Scrape type for 1988505: 1
2026-03-27 16:52:30 [ayvens.fr] INFO: Extracting data for car ID: 1988505
2026-03-27 16:52:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0c8613d-8482-51b8-8d72-6beaec99a96e with identifier: 1988505
2026-03-27 16:52:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0c8613d-8482-51b8-8d72-6beaec99a96e with scrape type 1
2026-03-27 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c0c8613d-8482-51b8-8d72-6beaec99a96e
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fe23c5e8ad2874bab8c2fc2f187478da8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/1.jpg not downloaded yet
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fe23c5e8ad2874bab8c2fc2f187478da8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/2.jpg not downloaded yet
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590645a10>
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d1c66b3-0ad9-5818-93b7-73e4aef1d100/1d1c66b3-0ad9-5818-93b7-73e4aef1d100_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F2a675777140a4bcabc1d9de619616e69%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/2.jpg saved to cache
2026-03-27 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d1c66b3-0ad9-5818-93b7-73e4aef1d100
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590617490>
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d1c66b3-0ad9-5818-93b7-73e4aef1d100/1d1c66b3-0ad9-5818-93b7-73e4aef1d100_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F2a675777140a4bcabc1d9de619616e69%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/5.jpg saved to cache
2026-03-27 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d1c66b3-0ad9-5818-93b7-73e4aef1d100
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b4b3d0>
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d1c66b3-0ad9-5818-93b7-73e4aef1d100/1d1c66b3-0ad9-5818-93b7-73e4aef1d100_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F2a675777140a4bcabc1d9de619616e69%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/6.jpg saved to cache
2026-03-27 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d1c66b3-0ad9-5818-93b7-73e4aef1d100
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fe23c5e8ad2874bab8c2fc2f187478da8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/3.jpg not downloaded yet
2026-03-27 16:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fe23c5e8ad2874bab8c2fc2f187478da8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/4.jpg not downloaded yet
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0ffd0>
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d1c66b3-0ad9-5818-93b7-73e4aef1d100/1d1c66b3-0ad9-5818-93b7-73e4aef1d100_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F2a675777140a4bcabc1d9de619616e69%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/1.jpg saved to cache
2026-03-27 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d1c66b3-0ad9-5818-93b7-73e4aef1d100
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4fe90>
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d1c66b3-0ad9-5818-93b7-73e4aef1d100/1d1c66b3-0ad9-5818-93b7-73e4aef1d100_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F2a675777140a4bcabc1d9de619616e69%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/3.jpg saved to cache
2026-03-27 16:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d1c66b3-0ad9-5818-93b7-73e4aef1d100
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efef90>
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d1c66b3-0ad9-5818-93b7-73e4aef1d100/1d1c66b3-0ad9-5818-93b7-73e4aef1d100_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F2a675777140a4bcabc1d9de619616e69%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/4.jpg saved to cache
2026-03-27 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d1c66b3-0ad9-5818-93b7-73e4aef1d100
2026-03-27 16:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d58ed0>
2026-03-27 16:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d1c66b3-0ad9-5818-93b7-73e4aef1d100/1d1c66b3-0ad9-5818-93b7-73e4aef1d100_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F2a675777140a4bcabc1d9de619616e69%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/7.jpg saved to cache
2026-03-27 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d1c66b3-0ad9-5818-93b7-73e4aef1d100
2026-03-27 16:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911a6e50>
2026-03-27 16:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d1c66b3-0ad9-5818-93b7-73e4aef1d100/1d1c66b3-0ad9-5818-93b7-73e4aef1d100_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F2a675777140a4bcabc1d9de619616e69%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/8.jpg saved to cache
2026-03-27 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d1c66b3-0ad9-5818-93b7-73e4aef1d100
2026-03-27 16:52:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d1c66b3-0ad9-5818-93b7-73e4aef1d100, skipping ID generation
2026-03-27 16:52:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d1c66b3-0ad9-5818-93b7-73e4aef1d100 with scrape type 1
2026-03-27 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d1c66b3-0ad9-5818-93b7-73e4aef1d100 sending to next pipeline
2026-03-27 16:52:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1d1c66b3-0ad9-5818-93b7-73e4aef1d100, identifier: 1988503
2026-03-27 16:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1d1c66b3-0ad9-5818-93b7-73e4aef1d100 with identifier: 1988503
2026-03-27 16:52:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1d1c66b3-0ad9-5818-93b7-73e4aef1d100 with identifier: 1988503
2026-03-27 16:52:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 1d1c66b3-0ad9-5818-93b7-73e4aef1d100 with identifier: 1988503 to the API
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '1d1c66b3-0ad9-5818-93b7-73e4aef1d100',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 74596,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d1c66b3-0ad9-5818-93b7-73e4aef1d100/1d1c66b3-0ad9-5818-93b7-73e4aef1d100_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406799,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d1c66b3-0ad9-5818-93b7-73e4aef1d100/1d1c66b3-0ad9-5818-93b7-73e4aef1d100_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406799,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d1c66b3-0ad9-5818-93b7-73e4aef1d100/1d1c66b3-0ad9-5818-93b7-73e4aef1d100_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420943,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d1c66b3-0ad9-5818-93b7-73e4aef1d100/1d1c66b3-0ad9-5818-93b7-73e4aef1d100_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318291,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d1c66b3-0ad9-5818-93b7-73e4aef1d100/1d1c66b3-0ad9-5818-93b7-73e4aef1d100_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300886,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d1c66b3-0ad9-5818-93b7-73e4aef1d100/1d1c66b3-0ad9-5818-93b7-73e4aef1d100_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281027,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d1c66b3-0ad9-5818-93b7-73e4aef1d100/1d1c66b3-0ad9-5818-93b7-73e4aef1d100_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338544,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d1c66b3-0ad9-5818-93b7-73e4aef1d100/1d1c66b3-0ad9-5818-93b7-73e4aef1d100_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 587507,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/2a675777140a4bcabc1d9de619616e69/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-01',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 1.2 PureTech 83ch S&S Feel Business',
'transmission': 'manual',
'trim': 'C3 1.2 PureTech 83ch S&S Feel Business',
'vin': None,
'year': 2022}
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988503%27 HTTP/1.1" 200 None
2026-03-27 16:52:31 [ayvens.fr] INFO: Saving data for 1988503: {'created_time': 1774630351.851513, 'last_price_update_time': 1774630351.851526, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988503') HTTP/1.1" 204 0
2026-03-27 16:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fe23c5e8ad2874bab8c2fc2f187478da8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/5.jpg not downloaded yet
2026-03-27 16:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fe23c5e8ad2874bab8c2fc2f187478da8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/6.jpg not downloaded yet
2026-03-27 16:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3bfd0>
2026-03-27 16:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c4d96f0-bd98-5b18-91c2-f6eb64495f52/8c4d96f0-bd98-5b18-91c2-f6eb64495f52_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe20c0a05f0424097b66445361d562d24%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/1.jpg saved to cache
2026-03-27 16:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c4d96f0-bd98-5b18-91c2-f6eb64495f52
2026-03-27 16:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911efd90>
2026-03-27 16:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c4d96f0-bd98-5b18-91c2-f6eb64495f52/8c4d96f0-bd98-5b18-91c2-f6eb64495f52_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe20c0a05f0424097b66445361d562d24%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/2.jpg saved to cache
2026-03-27 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c4d96f0-bd98-5b18-91c2-f6eb64495f52
2026-03-27 16:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fe23c5e8ad2874bab8c2fc2f187478da8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/7.jpg not downloaded yet
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fe23c5e8ad2874bab8c2fc2f187478da8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/8.jpg not downloaded yet
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591196690>
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c4d96f0-bd98-5b18-91c2-f6eb64495f52/8c4d96f0-bd98-5b18-91c2-f6eb64495f52_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe20c0a05f0424097b66445361d562d24%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/7.jpg saved to cache
2026-03-27 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c4d96f0-bd98-5b18-91c2-f6eb64495f52
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590654590>
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c4d96f0-bd98-5b18-91c2-f6eb64495f52/8c4d96f0-bd98-5b18-91c2-f6eb64495f52_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe20c0a05f0424097b66445361d562d24%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/4.jpg saved to cache
2026-03-27 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c4d96f0-bd98-5b18-91c2-f6eb64495f52
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6d710>
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c4d96f0-bd98-5b18-91c2-f6eb64495f52/8c4d96f0-bd98-5b18-91c2-f6eb64495f52_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe20c0a05f0424097b66445361d562d24%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/8.jpg saved to cache
2026-03-27 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c4d96f0-bd98-5b18-91c2-f6eb64495f52
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068ff50>
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c4d96f0-bd98-5b18-91c2-f6eb64495f52/8c4d96f0-bd98-5b18-91c2-f6eb64495f52_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe20c0a05f0424097b66445361d562d24%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/5.jpg saved to cache
2026-03-27 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c4d96f0-bd98-5b18-91c2-f6eb64495f52
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d74190>
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c4d96f0-bd98-5b18-91c2-f6eb64495f52/8c4d96f0-bd98-5b18-91c2-f6eb64495f52_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe20c0a05f0424097b66445361d562d24%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/6.jpg saved to cache
2026-03-27 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c4d96f0-bd98-5b18-91c2-f6eb64495f52
2026-03-27 16:52:32 [ayvens.fr] INFO: Found listing with ID: 1988506
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988506%27 HTTP/1.1" 200 None
2026-03-27 16:52:32 [ayvens.fr] INFO: Scrape type for 1988506: 1
2026-03-27 16:52:32 [ayvens.fr] INFO: Extracting data for car ID: 1988506
2026-03-27 16:52:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab7c6de0-80d8-5635-bae5-dc50ae35a515 with identifier: 1988506
2026-03-27 16:52:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab7c6de0-80d8-5635-bae5-dc50ae35a515 with scrape type 1
2026-03-27 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ab7c6de0-80d8-5635-bae5-dc50ae35a515
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F64845f3a1aac4fb4816ef036957ea42b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/1.jpg not downloaded yet
2026-03-27 16:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4e8d0>
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c4d96f0-bd98-5b18-91c2-f6eb64495f52/8c4d96f0-bd98-5b18-91c2-f6eb64495f52_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fe20c0a05f0424097b66445361d562d24%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/3.jpg saved to cache
2026-03-27 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c4d96f0-bd98-5b18-91c2-f6eb64495f52
2026-03-27 16:52:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c4d96f0-bd98-5b18-91c2-f6eb64495f52, skipping ID generation
2026-03-27 16:52:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c4d96f0-bd98-5b18-91c2-f6eb64495f52 with scrape type 1
2026-03-27 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c4d96f0-bd98-5b18-91c2-f6eb64495f52 sending to next pipeline
2026-03-27 16:52:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8c4d96f0-bd98-5b18-91c2-f6eb64495f52, identifier: 1988504
2026-03-27 16:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F64845f3a1aac4fb4816ef036957ea42b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/2.jpg not downloaded yet
2026-03-27 16:52:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8c4d96f0-bd98-5b18-91c2-f6eb64495f52 with identifier: 1988504
2026-03-27 16:52:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8c4d96f0-bd98-5b18-91c2-f6eb64495f52 with identifier: 1988504
2026-03-27 16:52:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8c4d96f0-bd98-5b18-91c2-f6eb64495f52 with identifier: 1988504 to the API
2026-03-27 16:52:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 145,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '8c4d96f0-bd98-5b18-91c2-f6eb64495f52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 61536,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c4d96f0-bd98-5b18-91c2-f6eb64495f52/8c4d96f0-bd98-5b18-91c2-f6eb64495f52_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468157,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c4d96f0-bd98-5b18-91c2-f6eb64495f52/8c4d96f0-bd98-5b18-91c2-f6eb64495f52_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468157,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c4d96f0-bd98-5b18-91c2-f6eb64495f52/8c4d96f0-bd98-5b18-91c2-f6eb64495f52_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464118,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c4d96f0-bd98-5b18-91c2-f6eb64495f52/8c4d96f0-bd98-5b18-91c2-f6eb64495f52_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338901,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c4d96f0-bd98-5b18-91c2-f6eb64495f52/8c4d96f0-bd98-5b18-91c2-f6eb64495f52_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358357,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c4d96f0-bd98-5b18-91c2-f6eb64495f52/8c4d96f0-bd98-5b18-91c2-f6eb64495f52_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375150,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c4d96f0-bd98-5b18-91c2-f6eb64495f52/8c4d96f0-bd98-5b18-91c2-f6eb64495f52_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258851,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c4d96f0-bd98-5b18-91c2-f6eb64495f52/8c4d96f0-bd98-5b18-91c2-f6eb64495f52_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285823,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/e20c0a05f0424097b66445361d562d24/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-04',
'seats_number': 5,
'seller_name': None,
'title': 'NISSAN QASHQAI Qashqai 1.3 Mild Hybrid 158ch Tekna Xtronic',
'transmission': 'automatic',
'trim': 'Qashqai 1.3 Mild Hybrid 158ch Tekna Xtronic',
'vin': None,
'year': 2022}
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988504%27 HTTP/1.1" 200 None
2026-03-27 16:52:33 [ayvens.fr] INFO: Saving data for 1988504: {'created_time': 1774630353.355426, 'last_price_update_time': 1774630353.355437, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988504') HTTP/1.1" 204 0
2026-03-27 16:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F64845f3a1aac4fb4816ef036957ea42b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/3.jpg not downloaded yet
2026-03-27 16:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910eed90>
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c8613d-8482-51b8-8d72-6beaec99a96e/c0c8613d-8482-51b8-8d72-6beaec99a96e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fe23c5e8ad2874bab8c2fc2f187478da8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/1.jpg saved to cache
2026-03-27 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0c8613d-8482-51b8-8d72-6beaec99a96e
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e17cd0>
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c8613d-8482-51b8-8d72-6beaec99a96e/c0c8613d-8482-51b8-8d72-6beaec99a96e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fe23c5e8ad2874bab8c2fc2f187478da8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/4.jpg saved to cache
2026-03-27 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0c8613d-8482-51b8-8d72-6beaec99a96e
2026-03-27 16:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F64845f3a1aac4fb4816ef036957ea42b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/4.jpg not downloaded yet
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F64845f3a1aac4fb4816ef036957ea42b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/5.jpg not downloaded yet
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d49450>
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c8613d-8482-51b8-8d72-6beaec99a96e/c0c8613d-8482-51b8-8d72-6beaec99a96e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fe23c5e8ad2874bab8c2fc2f187478da8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/6.jpg saved to cache
2026-03-27 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c0c8613d-8482-51b8-8d72-6beaec99a96e
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911ee010>
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c8613d-8482-51b8-8d72-6beaec99a96e/c0c8613d-8482-51b8-8d72-6beaec99a96e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fe23c5e8ad2874bab8c2fc2f187478da8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/2.jpg saved to cache
2026-03-27 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0c8613d-8482-51b8-8d72-6beaec99a96e
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590514450>
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c8613d-8482-51b8-8d72-6beaec99a96e/c0c8613d-8482-51b8-8d72-6beaec99a96e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fe23c5e8ad2874bab8c2fc2f187478da8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/3.jpg saved to cache
2026-03-27 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0c8613d-8482-51b8-8d72-6beaec99a96e
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b744d0>
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c8613d-8482-51b8-8d72-6beaec99a96e/c0c8613d-8482-51b8-8d72-6beaec99a96e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fe23c5e8ad2874bab8c2fc2f187478da8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/5.jpg saved to cache
2026-03-27 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0c8613d-8482-51b8-8d72-6beaec99a96e
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F64845f3a1aac4fb4816ef036957ea42b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/6.jpg not downloaded yet
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abd610>
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c8613d-8482-51b8-8d72-6beaec99a96e/c0c8613d-8482-51b8-8d72-6beaec99a96e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fe23c5e8ad2874bab8c2fc2f187478da8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/7.jpg saved to cache
2026-03-27 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0c8613d-8482-51b8-8d72-6beaec99a96e
2026-03-27 16:52:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F64845f3a1aac4fb4816ef036957ea42b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/7.jpg not downloaded yet
2026-03-27 16:52:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F64845f3a1aac4fb4816ef036957ea42b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/8.jpg not downloaded yet
2026-03-27 16:52:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:34 [ayvens.fr] INFO: Found listing with ID: 1988507
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988507%27 HTTP/1.1" 200 None
2026-03-27 16:52:34 [ayvens.fr] INFO: Scrape type for 1988507: 1
2026-03-27 16:52:34 [ayvens.fr] INFO: Extracting data for car ID: 1988507
2026-03-27 16:52:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b25b2f2f-6c40-5ce8-84be-0397e6e3acd9 with identifier: 1988507
2026-03-27 16:52:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b25b2f2f-6c40-5ce8-84be-0397e6e3acd9 with scrape type 1
2026-03-27 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b25b2f2f-6c40-5ce8-84be-0397e6e3acd9
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F5ce36725a38c489bb081d99c55457815%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/1.jpg not downloaded yet
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F5ce36725a38c489bb081d99c55457815%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/2.jpg not downloaded yet
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F5ce36725a38c489bb081d99c55457815%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/3.jpg not downloaded yet
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F5ce36725a38c489bb081d99c55457815%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/4.jpg not downloaded yet
2026-03-27 16:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911edfd0>
2026-03-27 16:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c8613d-8482-51b8-8d72-6beaec99a96e/c0c8613d-8482-51b8-8d72-6beaec99a96e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252Fe23c5e8ad2874bab8c2fc2f187478da8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/8.jpg saved to cache
2026-03-27 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0c8613d-8482-51b8-8d72-6beaec99a96e
2026-03-27 16:52:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0c8613d-8482-51b8-8d72-6beaec99a96e, skipping ID generation
2026-03-27 16:52:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0c8613d-8482-51b8-8d72-6beaec99a96e with scrape type 1
2026-03-27 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0c8613d-8482-51b8-8d72-6beaec99a96e sending to next pipeline
2026-03-27 16:52:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c0c8613d-8482-51b8-8d72-6beaec99a96e, identifier: 1988505
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F5ce36725a38c489bb081d99c55457815%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/5.jpg not downloaded yet
2026-03-27 16:52:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c0c8613d-8482-51b8-8d72-6beaec99a96e with identifier: 1988505
2026-03-27 16:52:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c0c8613d-8482-51b8-8d72-6beaec99a96e with identifier: 1988505
2026-03-27 16:52:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c0c8613d-8482-51b8-8d72-6beaec99a96e with identifier: 1988505 to the API
2026-03-27 16:52:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 151,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'c0c8613d-8482-51b8-8d72-6beaec99a96e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 129657,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c8613d-8482-51b8-8d72-6beaec99a96e/c0c8613d-8482-51b8-8d72-6beaec99a96e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529674,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c8613d-8482-51b8-8d72-6beaec99a96e/c0c8613d-8482-51b8-8d72-6beaec99a96e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529674,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c8613d-8482-51b8-8d72-6beaec99a96e/c0c8613d-8482-51b8-8d72-6beaec99a96e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442858,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c8613d-8482-51b8-8d72-6beaec99a96e/c0c8613d-8482-51b8-8d72-6beaec99a96e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353897,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c8613d-8482-51b8-8d72-6beaec99a96e/c0c8613d-8482-51b8-8d72-6beaec99a96e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382699,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c8613d-8482-51b8-8d72-6beaec99a96e/c0c8613d-8482-51b8-8d72-6beaec99a96e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311250,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c8613d-8482-51b8-8d72-6beaec99a96e/c0c8613d-8482-51b8-8d72-6beaec99a96e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228252,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c8613d-8482-51b8-8d72-6beaec99a96e/c0c8613d-8482-51b8-8d72-6beaec99a96e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344975,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/e23c5e8ad2874bab8c2fc2f187478da8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-06',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988505%27 HTTP/1.1" 200 None
2026-03-27 16:52:35 [ayvens.fr] INFO: Saving data for 1988505: {'created_time': 1774630355.347049, 'last_price_update_time': 1774630355.34706, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988505') HTTP/1.1" 204 0
2026-03-27 16:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4e790>
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab7c6de0-80d8-5635-bae5-dc50ae35a515/ab7c6de0-80d8-5635-bae5-dc50ae35a515_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F64845f3a1aac4fb4816ef036957ea42b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/1.jpg saved to cache
2026-03-27 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab7c6de0-80d8-5635-bae5-dc50ae35a515
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F5ce36725a38c489bb081d99c55457815%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/6.jpg not downloaded yet
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F5ce36725a38c489bb081d99c55457815%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/7.jpg not downloaded yet
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d52090>
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab7c6de0-80d8-5635-bae5-dc50ae35a515/ab7c6de0-80d8-5635-bae5-dc50ae35a515_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F64845f3a1aac4fb4816ef036957ea42b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/2.jpg saved to cache
2026-03-27 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab7c6de0-80d8-5635-bae5-dc50ae35a515
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4f2d0>
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab7c6de0-80d8-5635-bae5-dc50ae35a515/ab7c6de0-80d8-5635-bae5-dc50ae35a515_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F64845f3a1aac4fb4816ef036957ea42b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/3.jpg saved to cache
2026-03-27 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab7c6de0-80d8-5635-bae5-dc50ae35a515
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590db9b50>
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab7c6de0-80d8-5635-bae5-dc50ae35a515/ab7c6de0-80d8-5635-bae5-dc50ae35a515_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F64845f3a1aac4fb4816ef036957ea42b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/4.jpg saved to cache
2026-03-27 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab7c6de0-80d8-5635-bae5-dc50ae35a515
2026-03-27 16:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F5ce36725a38c489bb081d99c55457815%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/8.jpg not downloaded yet
2026-03-27 16:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:35 [ayvens.fr] INFO: Found listing with ID: 1988508
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988508%27 HTTP/1.1" 200 None
2026-03-27 16:52:35 [ayvens.fr] INFO: Scrape type for 1988508: 1
2026-03-27 16:52:35 [ayvens.fr] INFO: Extracting data for car ID: 1988508
2026-03-27 16:52:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38ea160b-047d-5977-bd79-705dbf75e334 with identifier: 1988508
2026-03-27 16:52:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38ea160b-047d-5977-bd79-705dbf75e334 with scrape type 1
2026-03-27 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 38ea160b-047d-5977-bd79-705dbf75e334
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4456cd7816584ceb8ce88a26a744c217%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/1.jpg not downloaded yet
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4456cd7816584ceb8ce88a26a744c217%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/2.jpg not downloaded yet
2026-03-27 16:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4456cd7816584ceb8ce88a26a744c217%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/3.jpg not downloaded yet
2026-03-27 16:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4456cd7816584ceb8ce88a26a744c217%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/4.jpg not downloaded yet
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4456cd7816584ceb8ce88a26a744c217%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/5.jpg not downloaded yet
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911971d0>
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab7c6de0-80d8-5635-bae5-dc50ae35a515/ab7c6de0-80d8-5635-bae5-dc50ae35a515_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F64845f3a1aac4fb4816ef036957ea42b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/6.jpg saved to cache
2026-03-27 16:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab7c6de0-80d8-5635-bae5-dc50ae35a515
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dbbe10>
2026-03-27 16:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab7c6de0-80d8-5635-bae5-dc50ae35a515/ab7c6de0-80d8-5635-bae5-dc50ae35a515_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F64845f3a1aac4fb4816ef036957ea42b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/5.jpg saved to cache
2026-03-27 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab7c6de0-80d8-5635-bae5-dc50ae35a515
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911cc090>
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab7c6de0-80d8-5635-bae5-dc50ae35a515/ab7c6de0-80d8-5635-bae5-dc50ae35a515_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F64845f3a1aac4fb4816ef036957ea42b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/7.jpg saved to cache
2026-03-27 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab7c6de0-80d8-5635-bae5-dc50ae35a515
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4456cd7816584ceb8ce88a26a744c217%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/6.jpg not downloaded yet
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590518cd0>
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab7c6de0-80d8-5635-bae5-dc50ae35a515/ab7c6de0-80d8-5635-bae5-dc50ae35a515_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F64845f3a1aac4fb4816ef036957ea42b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/8.jpg saved to cache
2026-03-27 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab7c6de0-80d8-5635-bae5-dc50ae35a515
2026-03-27 16:52:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab7c6de0-80d8-5635-bae5-dc50ae35a515, skipping ID generation
2026-03-27 16:52:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab7c6de0-80d8-5635-bae5-dc50ae35a515 with scrape type 1
2026-03-27 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab7c6de0-80d8-5635-bae5-dc50ae35a515 sending to next pipeline
2026-03-27 16:52:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ab7c6de0-80d8-5635-bae5-dc50ae35a515, identifier: 1988506
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4456cd7816584ceb8ce88a26a744c217%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/7.jpg not downloaded yet
2026-03-27 16:52:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ab7c6de0-80d8-5635-bae5-dc50ae35a515 with identifier: 1988506
2026-03-27 16:52:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:52:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ab7c6de0-80d8-5635-bae5-dc50ae35a515 with identifier: 1988506
2026-03-27 16:52:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ab7c6de0-80d8-5635-bae5-dc50ae35a515 with identifier: 1988506 to the API
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'e85',
'id': 'ab7c6de0-80d8-5635-bae5-dc50ae35a515',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FOCUS',
'odometer': 53458,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab7c6de0-80d8-5635-bae5-dc50ae35a515/ab7c6de0-80d8-5635-bae5-dc50ae35a515_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398351,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab7c6de0-80d8-5635-bae5-dc50ae35a515/ab7c6de0-80d8-5635-bae5-dc50ae35a515_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398351,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab7c6de0-80d8-5635-bae5-dc50ae35a515/ab7c6de0-80d8-5635-bae5-dc50ae35a515_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab7c6de0-80d8-5635-bae5-dc50ae35a515/ab7c6de0-80d8-5635-bae5-dc50ae35a515_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294626,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab7c6de0-80d8-5635-bae5-dc50ae35a515/ab7c6de0-80d8-5635-bae5-dc50ae35a515_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274156,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab7c6de0-80d8-5635-bae5-dc50ae35a515/ab7c6de0-80d8-5635-bae5-dc50ae35a515_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317570,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab7c6de0-80d8-5635-bae5-dc50ae35a515/ab7c6de0-80d8-5635-bae5-dc50ae35a515_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333277,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab7c6de0-80d8-5635-bae5-dc50ae35a515/ab7c6de0-80d8-5635-bae5-dc50ae35a515_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433408,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/64845f3a1aac4fb4816ef036957ea42b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-04',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FOCUS Focus 1.0 Flexifuel mHEV 125ch Titanium X Business',
'transmission': 'manual',
'trim': 'Focus 1.0 Flexifuel mHEV 125ch Titanium X Business',
'vin': None,
'year': 2022}
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988506%27 HTTP/1.1" 200 None
2026-03-27 16:52:36 [ayvens.fr] INFO: Saving data for 1988506: {'created_time': 1774630356.739269, 'last_price_update_time': 1774630356.739286, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988506') HTTP/1.1" 204 0
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4456cd7816584ceb8ce88a26a744c217%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/8.jpg not downloaded yet
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590695c10>
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b25b2f2f-6c40-5ce8-84be-0397e6e3acd9/b25b2f2f-6c40-5ce8-84be-0397e6e3acd9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F5ce36725a38c489bb081d99c55457815%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/1.jpg saved to cache
2026-03-27 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b25b2f2f-6c40-5ce8-84be-0397e6e3acd9
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f31090>
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b25b2f2f-6c40-5ce8-84be-0397e6e3acd9/b25b2f2f-6c40-5ce8-84be-0397e6e3acd9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F5ce36725a38c489bb081d99c55457815%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/2.jpg saved to cache
2026-03-27 16:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b25b2f2f-6c40-5ce8-84be-0397e6e3acd9
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6c990>
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b25b2f2f-6c40-5ce8-84be-0397e6e3acd9/b25b2f2f-6c40-5ce8-84be-0397e6e3acd9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F5ce36725a38c489bb081d99c55457815%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/3.jpg saved to cache
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b25b2f2f-6c40-5ce8-84be-0397e6e3acd9
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592d55dd0>
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b25b2f2f-6c40-5ce8-84be-0397e6e3acd9/b25b2f2f-6c40-5ce8-84be-0397e6e3acd9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F5ce36725a38c489bb081d99c55457815%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/4.jpg saved to cache
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b25b2f2f-6c40-5ce8-84be-0397e6e3acd9
2026-03-27 16:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:37 [ayvens.fr] INFO: Found listing with ID: 1988509
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988509%27 HTTP/1.1" 200 None
2026-03-27 16:52:37 [ayvens.fr] INFO: Scrape type for 1988509: 1
2026-03-27 16:52:37 [ayvens.fr] INFO: Extracting data for car ID: 1988509
2026-03-27 16:52:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a15ca55-1b23-5c6f-a69f-47f68a072b0f with identifier: 1988509
2026-03-27 16:52:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a15ca55-1b23-5c6f-a69f-47f68a072b0f with scrape type 1
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3a15ca55-1b23-5c6f-a69f-47f68a072b0f
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0e42d5bd9fbe4ed097cff2846eed4a63%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/1.jpg not downloaded yet
2026-03-27 16:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0e42d5bd9fbe4ed097cff2846eed4a63%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/2.jpg not downloaded yet
2026-03-27 16:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0e42d5bd9fbe4ed097cff2846eed4a63%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/3.jpg not downloaded yet
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0e42d5bd9fbe4ed097cff2846eed4a63%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/4.jpg not downloaded yet
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0e42d5bd9fbe4ed097cff2846eed4a63%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/5.jpg not downloaded yet
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0e42d5bd9fbe4ed097cff2846eed4a63%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/6.jpg not downloaded yet
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6d410>
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b25b2f2f-6c40-5ce8-84be-0397e6e3acd9/b25b2f2f-6c40-5ce8-84be-0397e6e3acd9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F5ce36725a38c489bb081d99c55457815%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/8.jpg saved to cache
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b25b2f2f-6c40-5ce8-84be-0397e6e3acd9
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0e42d5bd9fbe4ed097cff2846eed4a63%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/7.jpg not downloaded yet
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0e42d5bd9fbe4ed097cff2846eed4a63%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/8.jpg not downloaded yet
2026-03-27 16:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:37 [ayvens.fr] INFO: Found listing with ID: 1988510
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988510%27 HTTP/1.1" 200 None
2026-03-27 16:52:37 [ayvens.fr] INFO: Scrape type for 1988510: 1
2026-03-27 16:52:37 [ayvens.fr] INFO: Extracting data for car ID: 1988510
2026-03-27 16:52:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98f15037-487c-5b86-9fed-f067fc2fb971 with identifier: 1988510
2026-03-27 16:52:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98f15037-487c-5b86-9fed-f067fc2fb971 with scrape type 1
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 98f15037-487c-5b86-9fed-f067fc2fb971
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fccdcafdc80c14bbf875202ecaa127764%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/1.jpg not downloaded yet
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911a5f50>
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b25b2f2f-6c40-5ce8-84be-0397e6e3acd9/b25b2f2f-6c40-5ce8-84be-0397e6e3acd9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F5ce36725a38c489bb081d99c55457815%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/7.jpg saved to cache
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b25b2f2f-6c40-5ce8-84be-0397e6e3acd9
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b59c10>
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b25b2f2f-6c40-5ce8-84be-0397e6e3acd9/b25b2f2f-6c40-5ce8-84be-0397e6e3acd9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F5ce36725a38c489bb081d99c55457815%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/6.jpg saved to cache
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b25b2f2f-6c40-5ce8-84be-0397e6e3acd9
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903cc410>
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ea160b-047d-5977-bd79-705dbf75e334/38ea160b-047d-5977-bd79-705dbf75e334_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4456cd7816584ceb8ce88a26a744c217%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/3.jpg saved to cache
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38ea160b-047d-5977-bd79-705dbf75e334
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59103fbd0>
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ea160b-047d-5977-bd79-705dbf75e334/38ea160b-047d-5977-bd79-705dbf75e334_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4456cd7816584ceb8ce88a26a744c217%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/1.jpg saved to cache
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38ea160b-047d-5977-bd79-705dbf75e334
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590aba4d0>
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ea160b-047d-5977-bd79-705dbf75e334/38ea160b-047d-5977-bd79-705dbf75e334_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4456cd7816584ceb8ce88a26a744c217%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/2.jpg saved to cache
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38ea160b-047d-5977-bd79-705dbf75e334
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591446410>
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b25b2f2f-6c40-5ce8-84be-0397e6e3acd9/b25b2f2f-6c40-5ce8-84be-0397e6e3acd9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgz-%252F5ce36725a38c489bb081d99c55457815%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/5.jpg saved to cache
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b25b2f2f-6c40-5ce8-84be-0397e6e3acd9
2026-03-27 16:52:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b25b2f2f-6c40-5ce8-84be-0397e6e3acd9, skipping ID generation
2026-03-27 16:52:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b25b2f2f-6c40-5ce8-84be-0397e6e3acd9 with scrape type 1
2026-03-27 16:52:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b25b2f2f-6c40-5ce8-84be-0397e6e3acd9 sending to next pipeline
2026-03-27 16:52:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b25b2f2f-6c40-5ce8-84be-0397e6e3acd9, identifier: 1988507
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590528690>
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ea160b-047d-5977-bd79-705dbf75e334/38ea160b-047d-5977-bd79-705dbf75e334_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4456cd7816584ceb8ce88a26a744c217%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/4.jpg saved to cache
2026-03-27 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38ea160b-047d-5977-bd79-705dbf75e334
2026-03-27 16:52:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b25b2f2f-6c40-5ce8-84be-0397e6e3acd9 with identifier: 1988507
2026-03-27 16:52:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b25b2f2f-6c40-5ce8-84be-0397e6e3acd9 with identifier: 1988507
2026-03-27 16:52:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b25b2f2f-6c40-5ce8-84be-0397e6e3acd9 with identifier: 1988507 to the API
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 16,
'color': 'SAPHIRSCHWARZ M',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'b25b2f2f-6c40-5ce8-84be-0397e6e3acd9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'X1',
'odometer': 24671,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b25b2f2f-6c40-5ce8-84be-0397e6e3acd9/b25b2f2f-6c40-5ce8-84be-0397e6e3acd9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 679645,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b25b2f2f-6c40-5ce8-84be-0397e6e3acd9/b25b2f2f-6c40-5ce8-84be-0397e6e3acd9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 679645,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b25b2f2f-6c40-5ce8-84be-0397e6e3acd9/b25b2f2f-6c40-5ce8-84be-0397e6e3acd9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607712,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b25b2f2f-6c40-5ce8-84be-0397e6e3acd9/b25b2f2f-6c40-5ce8-84be-0397e6e3acd9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527992,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b25b2f2f-6c40-5ce8-84be-0397e6e3acd9/b25b2f2f-6c40-5ce8-84be-0397e6e3acd9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457942,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b25b2f2f-6c40-5ce8-84be-0397e6e3acd9/b25b2f2f-6c40-5ce8-84be-0397e6e3acd9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 454571,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b25b2f2f-6c40-5ce8-84be-0397e6e3acd9/b25b2f2f-6c40-5ce8-84be-0397e6e3acd9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418397,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b25b2f2f-6c40-5ce8-84be-0397e6e3acd9/b25b2f2f-6c40-5ce8-84be-0397e6e3acd9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348244,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gz-/5ce36725a38c489bb081d99c55457815/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-10-17',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 X1 xDrive25e 245ch',
'transmission': 'automatic',
'trim': 'X1 xDrive25e 245ch',
'vin': None,
'year': 2024}
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988507%27 HTTP/1.1" 200 None
2026-03-27 16:52:38 [ayvens.fr] INFO: Saving data for 1988507: {'created_time': 1774630358.428096, 'last_price_update_time': 1774630358.428112, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988507') HTTP/1.1" 204 0
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fccdcafdc80c14bbf875202ecaa127764%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/2.jpg not downloaded yet
2026-03-27 16:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fccdcafdc80c14bbf875202ecaa127764%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/3.jpg not downloaded yet
2026-03-27 16:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c0510>
2026-03-27 16:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ea160b-047d-5977-bd79-705dbf75e334/38ea160b-047d-5977-bd79-705dbf75e334_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4456cd7816584ceb8ce88a26a744c217%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/8.jpg saved to cache
2026-03-27 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 38ea160b-047d-5977-bd79-705dbf75e334
2026-03-27 16:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fccdcafdc80c14bbf875202ecaa127764%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/4.jpg not downloaded yet
2026-03-27 16:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fccdcafdc80c14bbf875202ecaa127764%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/5.jpg not downloaded yet
2026-03-27 16:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d2c90>
2026-03-27 16:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ea160b-047d-5977-bd79-705dbf75e334/38ea160b-047d-5977-bd79-705dbf75e334_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4456cd7816584ceb8ce88a26a744c217%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/5.jpg saved to cache
2026-03-27 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38ea160b-047d-5977-bd79-705dbf75e334
2026-03-27 16:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590519810>
2026-03-27 16:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ea160b-047d-5977-bd79-705dbf75e334/38ea160b-047d-5977-bd79-705dbf75e334_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4456cd7816584ceb8ce88a26a744c217%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/6.jpg saved to cache
2026-03-27 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38ea160b-047d-5977-bd79-705dbf75e334
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fccdcafdc80c14bbf875202ecaa127764%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/6.jpg not downloaded yet
2026-03-27 16:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591483bd0>
2026-03-27 16:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ea160b-047d-5977-bd79-705dbf75e334/38ea160b-047d-5977-bd79-705dbf75e334_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F4456cd7816584ceb8ce88a26a744c217%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/7.jpg saved to cache
2026-03-27 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 38ea160b-047d-5977-bd79-705dbf75e334
2026-03-27 16:52:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38ea160b-047d-5977-bd79-705dbf75e334, skipping ID generation
2026-03-27 16:52:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38ea160b-047d-5977-bd79-705dbf75e334 with scrape type 1
2026-03-27 16:52:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38ea160b-047d-5977-bd79-705dbf75e334 sending to next pipeline
2026-03-27 16:52:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 38ea160b-047d-5977-bd79-705dbf75e334, identifier: 1988508
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5914460d0>
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a15ca55-1b23-5c6f-a69f-47f68a072b0f/3a15ca55-1b23-5c6f-a69f-47f68a072b0f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0e42d5bd9fbe4ed097cff2846eed4a63%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/1.jpg saved to cache
2026-03-27 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a15ca55-1b23-5c6f-a69f-47f68a072b0f
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b7df10>
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a15ca55-1b23-5c6f-a69f-47f68a072b0f/3a15ca55-1b23-5c6f-a69f-47f68a072b0f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0e42d5bd9fbe4ed097cff2846eed4a63%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/4.jpg saved to cache
2026-03-27 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a15ca55-1b23-5c6f-a69f-47f68a072b0f
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fccdcafdc80c14bbf875202ecaa127764%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/7.jpg not downloaded yet
2026-03-27 16:52:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 38ea160b-047d-5977-bd79-705dbf75e334 with identifier: 1988508
2026-03-27 16:52:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:52:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 38ea160b-047d-5977-bd79-705dbf75e334 with identifier: 1988508
2026-03-27 16:52:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 38ea160b-047d-5977-bd79-705dbf75e334 with identifier: 1988508 to the API
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 42,
'color': 'IMPERIAL BLAU',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '38ea160b-047d-5977-bd79-705dbf75e334',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 2 ACTIVE TOURE',
'odometer': 137194,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ea160b-047d-5977-bd79-705dbf75e334/38ea160b-047d-5977-bd79-705dbf75e334_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402248,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ea160b-047d-5977-bd79-705dbf75e334/38ea160b-047d-5977-bd79-705dbf75e334_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402248,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ea160b-047d-5977-bd79-705dbf75e334/38ea160b-047d-5977-bd79-705dbf75e334_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415429,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ea160b-047d-5977-bd79-705dbf75e334/38ea160b-047d-5977-bd79-705dbf75e334_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426953,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ea160b-047d-5977-bd79-705dbf75e334/38ea160b-047d-5977-bd79-705dbf75e334_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334872,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ea160b-047d-5977-bd79-705dbf75e334/38ea160b-047d-5977-bd79-705dbf75e334_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406334,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ea160b-047d-5977-bd79-705dbf75e334/38ea160b-047d-5977-bd79-705dbf75e334_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 396616,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ea160b-047d-5977-bd79-705dbf75e334/38ea160b-047d-5977-bd79-705dbf75e334_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312570,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/4456cd7816584ceb8ce88a26a744c217/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-17',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 2 ACTIVE TOURE Serie 2 ActiveTourer 225xeA 224ch Business '
'Design',
'transmission': 'automatic',
'trim': 'Serie 2 ActiveTourer 225xeA 224ch Business Design',
'vin': None,
'year': 2019}
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988508%27 HTTP/1.1" 200 None
2026-03-27 16:52:39 [ayvens.fr] INFO: Saving data for 1988508: {'created_time': 1774630359.580424, 'last_price_update_time': 1774630359.580435, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988508') HTTP/1.1" 204 0
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591001750>
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a15ca55-1b23-5c6f-a69f-47f68a072b0f/3a15ca55-1b23-5c6f-a69f-47f68a072b0f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0e42d5bd9fbe4ed097cff2846eed4a63%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/3.jpg saved to cache
2026-03-27 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a15ca55-1b23-5c6f-a69f-47f68a072b0f
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050eb50>
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a15ca55-1b23-5c6f-a69f-47f68a072b0f/3a15ca55-1b23-5c6f-a69f-47f68a072b0f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0e42d5bd9fbe4ed097cff2846eed4a63%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/2.jpg saved to cache
2026-03-27 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a15ca55-1b23-5c6f-a69f-47f68a072b0f
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe0610>
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a15ca55-1b23-5c6f-a69f-47f68a072b0f/3a15ca55-1b23-5c6f-a69f-47f68a072b0f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0e42d5bd9fbe4ed097cff2846eed4a63%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/5.jpg saved to cache
2026-03-27 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a15ca55-1b23-5c6f-a69f-47f68a072b0f
2026-03-27 16:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fccdcafdc80c14bbf875202ecaa127764%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/8.jpg not downloaded yet
2026-03-27 16:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:39 [ayvens.fr] INFO: Found listing with ID: 1988511
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988511%27 HTTP/1.1" 200 None
2026-03-27 16:52:39 [ayvens.fr] INFO: Scrape type for 1988511: 1
2026-03-27 16:52:39 [ayvens.fr] INFO: Extracting data for car ID: 1988511
2026-03-27 16:52:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4758891-e7ca-5053-bf3e-b1d31e65810b with identifier: 1988511
2026-03-27 16:52:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4758891-e7ca-5053-bf3e-b1d31e65810b with scrape type 1
2026-03-27 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e4758891-e7ca-5053-bf3e-b1d31e65810b
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F80fc5529bf894112b85c9ecf4d77fabe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/1.jpg not downloaded yet
2026-03-27 16:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F80fc5529bf894112b85c9ecf4d77fabe%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/2.jpg not downloaded yet
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F80fc5529bf894112b85c9ecf4d77fabe%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/3.jpg not downloaded yet
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F80fc5529bf894112b85c9ecf4d77fabe%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/4.jpg not downloaded yet
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F80fc5529bf894112b85c9ecf4d77fabe%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/5.jpg not downloaded yet
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b68590>
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a15ca55-1b23-5c6f-a69f-47f68a072b0f/3a15ca55-1b23-5c6f-a69f-47f68a072b0f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0e42d5bd9fbe4ed097cff2846eed4a63%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/7.jpg saved to cache
2026-03-27 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a15ca55-1b23-5c6f-a69f-47f68a072b0f
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F80fc5529bf894112b85c9ecf4d77fabe%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/6.jpg not downloaded yet
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de4e10>
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a15ca55-1b23-5c6f-a69f-47f68a072b0f/3a15ca55-1b23-5c6f-a69f-47f68a072b0f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0e42d5bd9fbe4ed097cff2846eed4a63%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/6.jpg saved to cache
2026-03-27 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a15ca55-1b23-5c6f-a69f-47f68a072b0f
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc593024490>
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f15037-487c-5b86-9fed-f067fc2fb971/98f15037-487c-5b86-9fed-f067fc2fb971_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fccdcafdc80c14bbf875202ecaa127764%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/2.jpg saved to cache
2026-03-27 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98f15037-487c-5b86-9fed-f067fc2fb971
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911a57d0>
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f15037-487c-5b86-9fed-f067fc2fb971/98f15037-487c-5b86-9fed-f067fc2fb971_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fccdcafdc80c14bbf875202ecaa127764%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/3.jpg saved to cache
2026-03-27 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98f15037-487c-5b86-9fed-f067fc2fb971
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f10810>
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f15037-487c-5b86-9fed-f067fc2fb971/98f15037-487c-5b86-9fed-f067fc2fb971_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fccdcafdc80c14bbf875202ecaa127764%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/1.jpg saved to cache
2026-03-27 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98f15037-487c-5b86-9fed-f067fc2fb971
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b6bb10>
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f15037-487c-5b86-9fed-f067fc2fb971/98f15037-487c-5b86-9fed-f067fc2fb971_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fccdcafdc80c14bbf875202ecaa127764%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/4.jpg saved to cache
2026-03-27 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98f15037-487c-5b86-9fed-f067fc2fb971
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F80fc5529bf894112b85c9ecf4d77fabe%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/7.jpg not downloaded yet
2026-03-27 16:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F80fc5529bf894112b85c9ecf4d77fabe%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/8.jpg not downloaded yet
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910c68d0>
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a15ca55-1b23-5c6f-a69f-47f68a072b0f/3a15ca55-1b23-5c6f-a69f-47f68a072b0f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F0e42d5bd9fbe4ed097cff2846eed4a63%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/8.jpg saved to cache
2026-03-27 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a15ca55-1b23-5c6f-a69f-47f68a072b0f
2026-03-27 16:52:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a15ca55-1b23-5c6f-a69f-47f68a072b0f, skipping ID generation
2026-03-27 16:52:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a15ca55-1b23-5c6f-a69f-47f68a072b0f with scrape type 1
2026-03-27 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a15ca55-1b23-5c6f-a69f-47f68a072b0f sending to next pipeline
2026-03-27 16:52:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3a15ca55-1b23-5c6f-a69f-47f68a072b0f, identifier: 1988509
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592c2d510>
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f15037-487c-5b86-9fed-f067fc2fb971/98f15037-487c-5b86-9fed-f067fc2fb971_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fccdcafdc80c14bbf875202ecaa127764%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/5.jpg saved to cache
2026-03-27 16:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98f15037-487c-5b86-9fed-f067fc2fb971
2026-03-27 16:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3a15ca55-1b23-5c6f-a69f-47f68a072b0f with identifier: 1988509
2026-03-27 16:52:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3a15ca55-1b23-5c6f-a69f-47f68a072b0f with identifier: 1988509
2026-03-27 16:52:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3a15ca55-1b23-5c6f-a69f-47f68a072b0f with identifier: 1988509 to the API
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '3a15ca55-1b23-5c6f-a69f-47f68a072b0f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 64534,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a15ca55-1b23-5c6f-a69f-47f68a072b0f/3a15ca55-1b23-5c6f-a69f-47f68a072b0f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383447,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a15ca55-1b23-5c6f-a69f-47f68a072b0f/3a15ca55-1b23-5c6f-a69f-47f68a072b0f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383447,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a15ca55-1b23-5c6f-a69f-47f68a072b0f/3a15ca55-1b23-5c6f-a69f-47f68a072b0f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316535,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a15ca55-1b23-5c6f-a69f-47f68a072b0f/3a15ca55-1b23-5c6f-a69f-47f68a072b0f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360136,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a15ca55-1b23-5c6f-a69f-47f68a072b0f/3a15ca55-1b23-5c6f-a69f-47f68a072b0f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388760,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a15ca55-1b23-5c6f-a69f-47f68a072b0f/3a15ca55-1b23-5c6f-a69f-47f68a072b0f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362009,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a15ca55-1b23-5c6f-a69f-47f68a072b0f/3a15ca55-1b23-5c6f-a69f-47f68a072b0f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253953,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a15ca55-1b23-5c6f-a69f-47f68a072b0f/3a15ca55-1b23-5c6f-a69f-47f68a072b0f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420931,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/0e42d5bd9fbe4ed097cff2846eed4a63/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-15',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 SW 308 SW 1.2 PureTech 130ch S&S Allure EAT8',
'transmission': 'automatic',
'trim': '308 SW 1.2 PureTech 130ch S&S Allure EAT8',
'vin': None,
'year': 2022}
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988509%27 HTTP/1.1" 200 None
2026-03-27 16:52:41 [ayvens.fr] INFO: Saving data for 1988509: {'created_time': 1774630361.057618, 'last_price_update_time': 1774630361.057631, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988509') HTTP/1.1" 204 0
2026-03-27 16:52:41 [ayvens.fr] INFO: Found listing with ID: 1988512
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988512%27 HTTP/1.1" 200 None
2026-03-27 16:52:41 [ayvens.fr] INFO: Scrape type for 1988512: 1
2026-03-27 16:52:41 [ayvens.fr] INFO: Extracting data for car ID: 1988512
2026-03-27 16:52:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de858eea-7a15-5ba8-bfdf-1e550ae26cff with identifier: 1988512
2026-03-27 16:52:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de858eea-7a15-5ba8-bfdf-1e550ae26cff with scrape type 1
2026-03-27 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item de858eea-7a15-5ba8-bfdf-1e550ae26cff
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F33d4ba0b54c24261b378a8c7f2de3b82%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/1.jpg not downloaded yet
2026-03-27 16:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F33d4ba0b54c24261b378a8c7f2de3b82%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/2.jpg not downloaded yet
2026-03-27 16:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910c6010>
2026-03-27 16:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f15037-487c-5b86-9fed-f067fc2fb971/98f15037-487c-5b86-9fed-f067fc2fb971_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fccdcafdc80c14bbf875202ecaa127764%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/8.jpg saved to cache
2026-03-27 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98f15037-487c-5b86-9fed-f067fc2fb971
2026-03-27 16:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904c3fd0>
2026-03-27 16:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f15037-487c-5b86-9fed-f067fc2fb971/98f15037-487c-5b86-9fed-f067fc2fb971_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fccdcafdc80c14bbf875202ecaa127764%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/7.jpg saved to cache
2026-03-27 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98f15037-487c-5b86-9fed-f067fc2fb971
2026-03-27 16:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910b1b10>
2026-03-27 16:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98f15037-487c-5b86-9fed-f067fc2fb971/98f15037-487c-5b86-9fed-f067fc2fb971_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252Fccdcafdc80c14bbf875202ecaa127764%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/6.jpg saved to cache
2026-03-27 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98f15037-487c-5b86-9fed-f067fc2fb971
2026-03-27 16:52:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98f15037-487c-5b86-9fed-f067fc2fb971, skipping ID generation
2026-03-27 16:52:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98f15037-487c-5b86-9fed-f067fc2fb971 with scrape type 1
2026-03-27 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98f15037-487c-5b86-9fed-f067fc2fb971 sending to next pipeline
2026-03-27 16:52:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 98f15037-487c-5b86-9fed-f067fc2fb971, identifier: 1988510
2026-03-27 16:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F33d4ba0b54c24261b378a8c7f2de3b82%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/3.jpg not downloaded yet
2026-03-27 16:52:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 98f15037-487c-5b86-9fed-f067fc2fb971 with identifier: 1988510
2026-03-27 16:52:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 98f15037-487c-5b86-9fed-f067fc2fb971 with identifier: 1988510
2026-03-27 16:52:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 98f15037-487c-5b86-9fed-f067fc2fb971 with identifier: 1988510 to the API
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '98f15037-487c-5b86-9fed-f067fc2fb971',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE E-TECH',
'odometer': 96291,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f15037-487c-5b86-9fed-f067fc2fb971/98f15037-487c-5b86-9fed-f067fc2fb971_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291993,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f15037-487c-5b86-9fed-f067fc2fb971/98f15037-487c-5b86-9fed-f067fc2fb971_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291993,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f15037-487c-5b86-9fed-f067fc2fb971/98f15037-487c-5b86-9fed-f067fc2fb971_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285435,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f15037-487c-5b86-9fed-f067fc2fb971/98f15037-487c-5b86-9fed-f067fc2fb971_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221900,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f15037-487c-5b86-9fed-f067fc2fb971/98f15037-487c-5b86-9fed-f067fc2fb971_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285074,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f15037-487c-5b86-9fed-f067fc2fb971/98f15037-487c-5b86-9fed-f067fc2fb971_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284816,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f15037-487c-5b86-9fed-f067fc2fb971/98f15037-487c-5b86-9fed-f067fc2fb971_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375960,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f15037-487c-5b86-9fed-f067fc2fb971/98f15037-487c-5b86-9fed-f067fc2fb971_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326388,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/ccdcafdc80c14bbf875202ecaa127764/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT MEGANE E-TECH Megane E-Tech Electric EV60 130ch Evolution '
'ER super charge -B',
'transmission': 'automatic',
'trim': 'Megane E-Tech Electric EV60 130ch Evolution ER super charge -B',
'vin': None,
'year': 2023}
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988510%27 HTTP/1.1" 200 None
2026-03-27 16:52:41 [ayvens.fr] INFO: Saving data for 1988510: {'created_time': 1774630361.752909, 'last_price_update_time': 1774630361.75292, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988510') HTTP/1.1" 204 0
2026-03-27 16:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F33d4ba0b54c24261b378a8c7f2de3b82%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/4.jpg not downloaded yet
2026-03-27 16:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066c210>
2026-03-27 16:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4758891-e7ca-5053-bf3e-b1d31e65810b/e4758891-e7ca-5053-bf3e-b1d31e65810b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F80fc5529bf894112b85c9ecf4d77fabe%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/4.jpg saved to cache
2026-03-27 16:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4758891-e7ca-5053-bf3e-b1d31e65810b
2026-03-27 16:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d53950>
2026-03-27 16:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4758891-e7ca-5053-bf3e-b1d31e65810b/e4758891-e7ca-5053-bf3e-b1d31e65810b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F80fc5529bf894112b85c9ecf4d77fabe%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/3.jpg saved to cache
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4758891-e7ca-5053-bf3e-b1d31e65810b
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f83250>
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4758891-e7ca-5053-bf3e-b1d31e65810b/e4758891-e7ca-5053-bf3e-b1d31e65810b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F80fc5529bf894112b85c9ecf4d77fabe%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/2.jpg saved to cache
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4758891-e7ca-5053-bf3e-b1d31e65810b
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911ce150>
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4758891-e7ca-5053-bf3e-b1d31e65810b/e4758891-e7ca-5053-bf3e-b1d31e65810b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F80fc5529bf894112b85c9ecf4d77fabe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/1.jpg saved to cache
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4758891-e7ca-5053-bf3e-b1d31e65810b
2026-03-27 16:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F33d4ba0b54c24261b378a8c7f2de3b82%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/5.jpg not downloaded yet
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0d990>
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4758891-e7ca-5053-bf3e-b1d31e65810b/e4758891-e7ca-5053-bf3e-b1d31e65810b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F80fc5529bf894112b85c9ecf4d77fabe%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/5.jpg saved to cache
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4758891-e7ca-5053-bf3e-b1d31e65810b
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591052cd0>
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4758891-e7ca-5053-bf3e-b1d31e65810b/e4758891-e7ca-5053-bf3e-b1d31e65810b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F80fc5529bf894112b85c9ecf4d77fabe%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/6.jpg saved to cache
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4758891-e7ca-5053-bf3e-b1d31e65810b
2026-03-27 16:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F33d4ba0b54c24261b378a8c7f2de3b82%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/6.jpg not downloaded yet
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F33d4ba0b54c24261b378a8c7f2de3b82%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/7.jpg not downloaded yet
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910c2050>
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4758891-e7ca-5053-bf3e-b1d31e65810b/e4758891-e7ca-5053-bf3e-b1d31e65810b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F80fc5529bf894112b85c9ecf4d77fabe%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/7.jpg saved to cache
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e4758891-e7ca-5053-bf3e-b1d31e65810b
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F33d4ba0b54c24261b378a8c7f2de3b82%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/8.jpg not downloaded yet
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065c890>
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4758891-e7ca-5053-bf3e-b1d31e65810b/e4758891-e7ca-5053-bf3e-b1d31e65810b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F80fc5529bf894112b85c9ecf4d77fabe%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/8.jpg saved to cache
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e4758891-e7ca-5053-bf3e-b1d31e65810b
2026-03-27 16:52:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4758891-e7ca-5053-bf3e-b1d31e65810b, skipping ID generation
2026-03-27 16:52:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4758891-e7ca-5053-bf3e-b1d31e65810b with scrape type 1
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4758891-e7ca-5053-bf3e-b1d31e65810b sending to next pipeline
2026-03-27 16:52:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e4758891-e7ca-5053-bf3e-b1d31e65810b, identifier: 1988511
2026-03-27 16:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:42 [ayvens.fr] INFO: Found listing with ID: 1988513
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988513%27 HTTP/1.1" 200 None
2026-03-27 16:52:42 [ayvens.fr] INFO: Scrape type for 1988513: 1
2026-03-27 16:52:42 [ayvens.fr] INFO: Extracting data for car ID: 1988513
2026-03-27 16:52:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb32062f-6330-5808-aa03-1ecc95365bf5 with identifier: 1988513
2026-03-27 16:52:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb32062f-6330-5808-aa03-1ecc95365bf5 with scrape type 1
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item fb32062f-6330-5808-aa03-1ecc95365bf5
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F435435cbd9e247339b7766fa2398a3bf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/1.jpg not downloaded yet
2026-03-27 16:52:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e4758891-e7ca-5053-bf3e-b1d31e65810b with identifier: 1988511
2026-03-27 16:52:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e4758891-e7ca-5053-bf3e-b1d31e65810b with identifier: 1988511
2026-03-27 16:52:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e4758891-e7ca-5053-bf3e-b1d31e65810b with identifier: 1988511 to the API
2026-03-27 16:52:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'GRIS ACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': 'e4758891-e7ca-5053-bf3e-b1d31e65810b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'E-C4',
'odometer': 35171,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4758891-e7ca-5053-bf3e-b1d31e65810b/e4758891-e7ca-5053-bf3e-b1d31e65810b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620890,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4758891-e7ca-5053-bf3e-b1d31e65810b/e4758891-e7ca-5053-bf3e-b1d31e65810b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620890,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4758891-e7ca-5053-bf3e-b1d31e65810b/e4758891-e7ca-5053-bf3e-b1d31e65810b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481738,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4758891-e7ca-5053-bf3e-b1d31e65810b/e4758891-e7ca-5053-bf3e-b1d31e65810b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371052,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4758891-e7ca-5053-bf3e-b1d31e65810b/e4758891-e7ca-5053-bf3e-b1d31e65810b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397565,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4758891-e7ca-5053-bf3e-b1d31e65810b/e4758891-e7ca-5053-bf3e-b1d31e65810b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368838,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4758891-e7ca-5053-bf3e-b1d31e65810b/e4758891-e7ca-5053-bf3e-b1d31e65810b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252034,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4758891-e7ca-5053-bf3e-b1d31e65810b/e4758891-e7ca-5053-bf3e-b1d31e65810b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361235,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/80fc5529bf894112b85c9ecf4d77fabe/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-24',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN E-C4 C4 Moteur electrique 136ch (100 kW) Feel Pack Business '
'Automatique',
'transmission': 'automatic',
'trim': 'C4 Moteur electrique 136ch (100 kW) Feel Pack Business Automatique',
'vin': None,
'year': 2022}
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988511%27 HTTP/1.1" 200 None
2026-03-27 16:52:43 [ayvens.fr] INFO: Saving data for 1988511: {'created_time': 1774630363.12011, 'last_price_update_time': 1774630363.120121, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988511') HTTP/1.1" 204 0
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F435435cbd9e247339b7766fa2398a3bf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/2.jpg not downloaded yet
2026-03-27 16:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911cead0>
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de858eea-7a15-5ba8-bfdf-1e550ae26cff/de858eea-7a15-5ba8-bfdf-1e550ae26cff_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F33d4ba0b54c24261b378a8c7f2de3b82%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/2.jpg saved to cache
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de858eea-7a15-5ba8-bfdf-1e550ae26cff
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59052a310>
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de858eea-7a15-5ba8-bfdf-1e550ae26cff/de858eea-7a15-5ba8-bfdf-1e550ae26cff_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F33d4ba0b54c24261b378a8c7f2de3b82%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/1.jpg saved to cache
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de858eea-7a15-5ba8-bfdf-1e550ae26cff
2026-03-27 16:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F435435cbd9e247339b7766fa2398a3bf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/3.jpg not downloaded yet
2026-03-27 16:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F435435cbd9e247339b7766fa2398a3bf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/4.jpg not downloaded yet
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d41110>
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de858eea-7a15-5ba8-bfdf-1e550ae26cff/de858eea-7a15-5ba8-bfdf-1e550ae26cff_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F33d4ba0b54c24261b378a8c7f2de3b82%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/4.jpg saved to cache
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de858eea-7a15-5ba8-bfdf-1e550ae26cff
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe2090>
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de858eea-7a15-5ba8-bfdf-1e550ae26cff/de858eea-7a15-5ba8-bfdf-1e550ae26cff_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F33d4ba0b54c24261b378a8c7f2de3b82%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/5.jpg saved to cache
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de858eea-7a15-5ba8-bfdf-1e550ae26cff
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F435435cbd9e247339b7766fa2398a3bf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/5.jpg not downloaded yet
2026-03-27 16:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F435435cbd9e247339b7766fa2398a3bf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/6.jpg not downloaded yet
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b22f10>
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de858eea-7a15-5ba8-bfdf-1e550ae26cff/de858eea-7a15-5ba8-bfdf-1e550ae26cff_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F33d4ba0b54c24261b378a8c7f2de3b82%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/3.jpg saved to cache
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de858eea-7a15-5ba8-bfdf-1e550ae26cff
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd0210>
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de858eea-7a15-5ba8-bfdf-1e550ae26cff/de858eea-7a15-5ba8-bfdf-1e550ae26cff_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F33d4ba0b54c24261b378a8c7f2de3b82%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/6.jpg saved to cache
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de858eea-7a15-5ba8-bfdf-1e550ae26cff
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F435435cbd9e247339b7766fa2398a3bf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/7.jpg not downloaded yet
2026-03-27 16:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F435435cbd9e247339b7766fa2398a3bf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/8.jpg not downloaded yet
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910a3dd0>
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de858eea-7a15-5ba8-bfdf-1e550ae26cff/de858eea-7a15-5ba8-bfdf-1e550ae26cff_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F33d4ba0b54c24261b378a8c7f2de3b82%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/7.jpg saved to cache
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de858eea-7a15-5ba8-bfdf-1e550ae26cff
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590faa1d0>
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de858eea-7a15-5ba8-bfdf-1e550ae26cff/de858eea-7a15-5ba8-bfdf-1e550ae26cff_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252F33d4ba0b54c24261b378a8c7f2de3b82%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/8.jpg saved to cache
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de858eea-7a15-5ba8-bfdf-1e550ae26cff
2026-03-27 16:52:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de858eea-7a15-5ba8-bfdf-1e550ae26cff, skipping ID generation
2026-03-27 16:52:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de858eea-7a15-5ba8-bfdf-1e550ae26cff with scrape type 1
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de858eea-7a15-5ba8-bfdf-1e550ae26cff sending to next pipeline
2026-03-27 16:52:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: de858eea-7a15-5ba8-bfdf-1e550ae26cff, identifier: 1988512
2026-03-27 16:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:43 [ayvens.fr] INFO: Found listing with ID: 1988514
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988514%27 HTTP/1.1" 200 None
2026-03-27 16:52:43 [ayvens.fr] INFO: Scrape type for 1988514: 1
2026-03-27 16:52:43 [ayvens.fr] INFO: Extracting data for car ID: 1988514
2026-03-27 16:52:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72da0e92-9bea-51ad-933a-f25efdab18d0 with identifier: 1988514
2026-03-27 16:52:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72da0e92-9bea-51ad-933a-f25efdab18d0 with scrape type 1
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 72da0e92-9bea-51ad-933a-f25efdab18d0
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F5a46f0c5fb7b433aa9d06913e82ec05f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/1.jpg not downloaded yet
2026-03-27 16:52:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: de858eea-7a15-5ba8-bfdf-1e550ae26cff with identifier: 1988512
2026-03-27 16:52:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: de858eea-7a15-5ba8-bfdf-1e550ae26cff with identifier: 1988512
2026-03-27 16:52:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: de858eea-7a15-5ba8-bfdf-1e550ae26cff with identifier: 1988512 to the API
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid',
'id': 'de858eea-7a15-5ba8-bfdf-1e550ae26cff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FOCUS',
'odometer': 125863,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de858eea-7a15-5ba8-bfdf-1e550ae26cff/de858eea-7a15-5ba8-bfdf-1e550ae26cff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 528399,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de858eea-7a15-5ba8-bfdf-1e550ae26cff/de858eea-7a15-5ba8-bfdf-1e550ae26cff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 528399,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de858eea-7a15-5ba8-bfdf-1e550ae26cff/de858eea-7a15-5ba8-bfdf-1e550ae26cff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518110,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de858eea-7a15-5ba8-bfdf-1e550ae26cff/de858eea-7a15-5ba8-bfdf-1e550ae26cff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298872,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de858eea-7a15-5ba8-bfdf-1e550ae26cff/de858eea-7a15-5ba8-bfdf-1e550ae26cff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290312,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de858eea-7a15-5ba8-bfdf-1e550ae26cff/de858eea-7a15-5ba8-bfdf-1e550ae26cff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272584,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de858eea-7a15-5ba8-bfdf-1e550ae26cff/de858eea-7a15-5ba8-bfdf-1e550ae26cff_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297384,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de858eea-7a15-5ba8-bfdf-1e550ae26cff/de858eea-7a15-5ba8-bfdf-1e550ae26cff_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363906,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/33d4ba0b54c24261b378a8c7f2de3b82/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-09',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FOCUS Focus SW 1.0 Flexifuel mHEV 125ch Titanium X Business '
'Powershift',
'transmission': 'automatic',
'trim': 'Focus SW 1.0 Flexifuel mHEV 125ch Titanium X Business Powershift',
'vin': None,
'year': 2023}
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988512%27 HTTP/1.1" 200 None
2026-03-27 16:52:44 [ayvens.fr] INFO: Saving data for 1988512: {'created_time': 1774630364.409447, 'last_price_update_time': 1774630364.409458, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988512') HTTP/1.1" 204 0
2026-03-27 16:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F5a46f0c5fb7b433aa9d06913e82ec05f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/2.jpg not downloaded yet
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd0cd0>
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb32062f-6330-5808-aa03-1ecc95365bf5/fb32062f-6330-5808-aa03-1ecc95365bf5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F435435cbd9e247339b7766fa2398a3bf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/1.jpg saved to cache
2026-03-27 16:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb32062f-6330-5808-aa03-1ecc95365bf5
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590620990>
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb32062f-6330-5808-aa03-1ecc95365bf5/fb32062f-6330-5808-aa03-1ecc95365bf5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F435435cbd9e247339b7766fa2398a3bf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/2.jpg saved to cache
2026-03-27 16:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb32062f-6330-5808-aa03-1ecc95365bf5
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F5a46f0c5fb7b433aa9d06913e82ec05f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/3.jpg not downloaded yet
2026-03-27 16:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F5a46f0c5fb7b433aa9d06913e82ec05f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/4.jpg not downloaded yet
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4ff50>
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb32062f-6330-5808-aa03-1ecc95365bf5/fb32062f-6330-5808-aa03-1ecc95365bf5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F435435cbd9e247339b7766fa2398a3bf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/4.jpg saved to cache
2026-03-27 16:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb32062f-6330-5808-aa03-1ecc95365bf5
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591483750>
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb32062f-6330-5808-aa03-1ecc95365bf5/fb32062f-6330-5808-aa03-1ecc95365bf5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F435435cbd9e247339b7766fa2398a3bf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/3.jpg saved to cache
2026-03-27 16:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb32062f-6330-5808-aa03-1ecc95365bf5
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F5a46f0c5fb7b433aa9d06913e82ec05f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/5.jpg not downloaded yet
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59052a2d0>
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb32062f-6330-5808-aa03-1ecc95365bf5/fb32062f-6330-5808-aa03-1ecc95365bf5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F435435cbd9e247339b7766fa2398a3bf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/5.jpg saved to cache
2026-03-27 16:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb32062f-6330-5808-aa03-1ecc95365bf5
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065dd10>
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb32062f-6330-5808-aa03-1ecc95365bf5/fb32062f-6330-5808-aa03-1ecc95365bf5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F435435cbd9e247339b7766fa2398a3bf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/6.jpg saved to cache
2026-03-27 16:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb32062f-6330-5808-aa03-1ecc95365bf5
2026-03-27 16:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F5a46f0c5fb7b433aa9d06913e82ec05f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/6.jpg not downloaded yet
2026-03-27 16:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F5a46f0c5fb7b433aa9d06913e82ec05f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/7.jpg not downloaded yet
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F5a46f0c5fb7b433aa9d06913e82ec05f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/8.jpg not downloaded yet
2026-03-27 16:52:45 [ayvens.fr] INFO: Found listing with ID: 1988515
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988515%27 HTTP/1.1" 200 None
2026-03-27 16:52:45 [ayvens.fr] INFO: Scrape type for 1988515: 1
2026-03-27 16:52:45 [ayvens.fr] INFO: Extracting data for car ID: 1988515
2026-03-27 16:52:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29ce0965-3c38-5ccb-ab1d-23d2ea812ff3 with identifier: 1988515
2026-03-27 16:52:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29ce0965-3c38-5ccb-ab1d-23d2ea812ff3 with scrape type 1
2026-03-27 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 29ce0965-3c38-5ccb-ab1d-23d2ea812ff3
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F534ef6e598a84be6aef2ad04de8765fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/1.jpg not downloaded yet
2026-03-27 16:52:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F534ef6e598a84be6aef2ad04de8765fd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/2.jpg not downloaded yet
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F534ef6e598a84be6aef2ad04de8765fd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/3.jpg not downloaded yet
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F534ef6e598a84be6aef2ad04de8765fd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/4.jpg not downloaded yet
2026-03-27 16:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591482190>
2026-03-27 16:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb32062f-6330-5808-aa03-1ecc95365bf5/fb32062f-6330-5808-aa03-1ecc95365bf5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F435435cbd9e247339b7766fa2398a3bf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/7.jpg saved to cache
2026-03-27 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb32062f-6330-5808-aa03-1ecc95365bf5
2026-03-27 16:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4fd10>
2026-03-27 16:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb32062f-6330-5808-aa03-1ecc95365bf5/fb32062f-6330-5808-aa03-1ecc95365bf5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F435435cbd9e247339b7766fa2398a3bf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/8.jpg saved to cache
2026-03-27 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb32062f-6330-5808-aa03-1ecc95365bf5
2026-03-27 16:52:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb32062f-6330-5808-aa03-1ecc95365bf5, skipping ID generation
2026-03-27 16:52:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb32062f-6330-5808-aa03-1ecc95365bf5 with scrape type 1
2026-03-27 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb32062f-6330-5808-aa03-1ecc95365bf5 sending to next pipeline
2026-03-27 16:52:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: fb32062f-6330-5808-aa03-1ecc95365bf5, identifier: 1988513
2026-03-27 16:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d5a3d0>
2026-03-27 16:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72da0e92-9bea-51ad-933a-f25efdab18d0/72da0e92-9bea-51ad-933a-f25efdab18d0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F5a46f0c5fb7b433aa9d06913e82ec05f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/1.jpg saved to cache
2026-03-27 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72da0e92-9bea-51ad-933a-f25efdab18d0
2026-03-27 16:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911cfd50>
2026-03-27 16:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72da0e92-9bea-51ad-933a-f25efdab18d0/72da0e92-9bea-51ad-933a-f25efdab18d0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F5a46f0c5fb7b433aa9d06913e82ec05f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/2.jpg saved to cache
2026-03-27 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 72da0e92-9bea-51ad-933a-f25efdab18d0
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F534ef6e598a84be6aef2ad04de8765fd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/5.jpg not downloaded yet
2026-03-27 16:52:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: fb32062f-6330-5808-aa03-1ecc95365bf5 with identifier: 1988513
2026-03-27 16:52:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: fb32062f-6330-5808-aa03-1ecc95365bf5 with identifier: 1988513
2026-03-27 16:52:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: fb32062f-6330-5808-aa03-1ecc95365bf5 with identifier: 1988513 to the API
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 176,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'fb32062f-6330-5808-aa03-1ecc95365bf5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'ESPACE',
'odometer': 85563,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb32062f-6330-5808-aa03-1ecc95365bf5/fb32062f-6330-5808-aa03-1ecc95365bf5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322995,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb32062f-6330-5808-aa03-1ecc95365bf5/fb32062f-6330-5808-aa03-1ecc95365bf5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322995,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb32062f-6330-5808-aa03-1ecc95365bf5/fb32062f-6330-5808-aa03-1ecc95365bf5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343263,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb32062f-6330-5808-aa03-1ecc95365bf5/fb32062f-6330-5808-aa03-1ecc95365bf5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336463,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb32062f-6330-5808-aa03-1ecc95365bf5/fb32062f-6330-5808-aa03-1ecc95365bf5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342510,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb32062f-6330-5808-aa03-1ecc95365bf5/fb32062f-6330-5808-aa03-1ecc95365bf5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342725,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb32062f-6330-5808-aa03-1ecc95365bf5/fb32062f-6330-5808-aa03-1ecc95365bf5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339170,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb32062f-6330-5808-aa03-1ecc95365bf5/fb32062f-6330-5808-aa03-1ecc95365bf5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378301,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/435435cbd9e247339b7766fa2398a3bf/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-20',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT ESPACE Espace 2.0 Blue dCi 190ch Initiale Paris EDC',
'transmission': 'automatic',
'trim': 'Espace 2.0 Blue dCi 190ch Initiale Paris EDC',
'vin': None,
'year': 2021}
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988513%27 HTTP/1.1" 200 None
2026-03-27 16:52:45 [ayvens.fr] INFO: Saving data for 1988513: {'created_time': 1774630365.901292, 'last_price_update_time': 1774630365.901304, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988513') HTTP/1.1" 204 0
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F534ef6e598a84be6aef2ad04de8765fd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/6.jpg not downloaded yet
2026-03-27 16:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590510650>
2026-03-27 16:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72da0e92-9bea-51ad-933a-f25efdab18d0/72da0e92-9bea-51ad-933a-f25efdab18d0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F5a46f0c5fb7b433aa9d06913e82ec05f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/3.jpg saved to cache
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 72da0e92-9bea-51ad-933a-f25efdab18d0
2026-03-27 16:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F534ef6e598a84be6aef2ad04de8765fd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/7.jpg not downloaded yet
2026-03-27 16:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F534ef6e598a84be6aef2ad04de8765fd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/8.jpg not downloaded yet
2026-03-27 16:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:46 [ayvens.fr] INFO: Found listing with ID: 1988516
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988516%27 HTTP/1.1" 200 None
2026-03-27 16:52:46 [ayvens.fr] INFO: Scrape type for 1988516: 1
2026-03-27 16:52:46 [ayvens.fr] INFO: Extracting data for car ID: 1988516
2026-03-27 16:52:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 796cdd4a-f1c4-560e-8c11-e80d78deaa5e with identifier: 1988516
2026-03-27 16:52:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 796cdd4a-f1c4-560e-8c11-e80d78deaa5e with scrape type 1
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 796cdd4a-f1c4-560e-8c11-e80d78deaa5e
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F450bf796c36a438ca0e38cbd48dc352c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/1.jpg not downloaded yet
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F450bf796c36a438ca0e38cbd48dc352c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/2.jpg not downloaded yet
2026-03-27 16:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F450bf796c36a438ca0e38cbd48dc352c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/3.jpg not downloaded yet
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F450bf796c36a438ca0e38cbd48dc352c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/4.jpg not downloaded yet
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F450bf796c36a438ca0e38cbd48dc352c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/5.jpg not downloaded yet
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F450bf796c36a438ca0e38cbd48dc352c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/6.jpg not downloaded yet
2026-03-27 16:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b88450>
2026-03-27 16:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72da0e92-9bea-51ad-933a-f25efdab18d0/72da0e92-9bea-51ad-933a-f25efdab18d0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F5a46f0c5fb7b433aa9d06913e82ec05f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/5.jpg saved to cache
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 72da0e92-9bea-51ad-933a-f25efdab18d0
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F450bf796c36a438ca0e38cbd48dc352c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/7.jpg not downloaded yet
2026-03-27 16:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fa1a10>
2026-03-27 16:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72da0e92-9bea-51ad-933a-f25efdab18d0/72da0e92-9bea-51ad-933a-f25efdab18d0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F5a46f0c5fb7b433aa9d06913e82ec05f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/8.jpg saved to cache
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 72da0e92-9bea-51ad-933a-f25efdab18d0
2026-03-27 16:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911956d0>
2026-03-27 16:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72da0e92-9bea-51ad-933a-f25efdab18d0/72da0e92-9bea-51ad-933a-f25efdab18d0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F5a46f0c5fb7b433aa9d06913e82ec05f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/4.jpg saved to cache
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 72da0e92-9bea-51ad-933a-f25efdab18d0
2026-03-27 16:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d52090>
2026-03-27 16:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72da0e92-9bea-51ad-933a-f25efdab18d0/72da0e92-9bea-51ad-933a-f25efdab18d0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F5a46f0c5fb7b433aa9d06913e82ec05f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/7.jpg saved to cache
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 72da0e92-9bea-51ad-933a-f25efdab18d0
2026-03-27 16:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b417d0>
2026-03-27 16:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72da0e92-9bea-51ad-933a-f25efdab18d0/72da0e92-9bea-51ad-933a-f25efdab18d0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F5a46f0c5fb7b433aa9d06913e82ec05f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/6.jpg saved to cache
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 72da0e92-9bea-51ad-933a-f25efdab18d0
2026-03-27 16:52:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72da0e92-9bea-51ad-933a-f25efdab18d0, skipping ID generation
2026-03-27 16:52:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72da0e92-9bea-51ad-933a-f25efdab18d0 with scrape type 1
2026-03-27 16:52:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72da0e92-9bea-51ad-933a-f25efdab18d0 sending to next pipeline
2026-03-27 16:52:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 72da0e92-9bea-51ad-933a-f25efdab18d0, identifier: 1988514
2026-03-27 16:52:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 72da0e92-9bea-51ad-933a-f25efdab18d0 with identifier: 1988514
2026-03-27 16:52:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 72da0e92-9bea-51ad-933a-f25efdab18d0 with identifier: 1988514
2026-03-27 16:52:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 72da0e92-9bea-51ad-933a-f25efdab18d0 with identifier: 1988514 to the API
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'electric',
'id': '72da0e92-9bea-51ad-933a-f25efdab18d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'NIRO EV',
'odometer': 58378,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72da0e92-9bea-51ad-933a-f25efdab18d0/72da0e92-9bea-51ad-933a-f25efdab18d0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322348,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72da0e92-9bea-51ad-933a-f25efdab18d0/72da0e92-9bea-51ad-933a-f25efdab18d0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322348,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72da0e92-9bea-51ad-933a-f25efdab18d0/72da0e92-9bea-51ad-933a-f25efdab18d0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361220,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72da0e92-9bea-51ad-933a-f25efdab18d0/72da0e92-9bea-51ad-933a-f25efdab18d0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323887,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72da0e92-9bea-51ad-933a-f25efdab18d0/72da0e92-9bea-51ad-933a-f25efdab18d0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374802,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72da0e92-9bea-51ad-933a-f25efdab18d0/72da0e92-9bea-51ad-933a-f25efdab18d0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348138,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72da0e92-9bea-51ad-933a-f25efdab18d0/72da0e92-9bea-51ad-933a-f25efdab18d0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324313,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72da0e92-9bea-51ad-933a-f25efdab18d0/72da0e92-9bea-51ad-933a-f25efdab18d0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263914,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/5a46f0c5fb7b433aa9d06913e82ec05f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'KIA NIRO EV Niro EV 204ch Active Business',
'transmission': 'automatic',
'trim': 'Niro EV 204ch Active Business',
'vin': None,
'year': 2023}
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988514%27 HTTP/1.1" 200 None
2026-03-27 16:52:47 [ayvens.fr] INFO: Saving data for 1988514: {'created_time': 1774630367.083965, 'last_price_update_time': 1774630367.083976, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988514') HTTP/1.1" 204 0
2026-03-27 16:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F450bf796c36a438ca0e38cbd48dc352c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/8.jpg not downloaded yet
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591445c10>
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29ce0965-3c38-5ccb-ab1d-23d2ea812ff3/29ce0965-3c38-5ccb-ab1d-23d2ea812ff3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F534ef6e598a84be6aef2ad04de8765fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/1.jpg saved to cache
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29ce0965-3c38-5ccb-ab1d-23d2ea812ff3
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe2090>
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29ce0965-3c38-5ccb-ab1d-23d2ea812ff3/29ce0965-3c38-5ccb-ab1d-23d2ea812ff3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F534ef6e598a84be6aef2ad04de8765fd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/2.jpg saved to cache
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29ce0965-3c38-5ccb-ab1d-23d2ea812ff3
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910c2350>
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29ce0965-3c38-5ccb-ab1d-23d2ea812ff3/29ce0965-3c38-5ccb-ab1d-23d2ea812ff3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F534ef6e598a84be6aef2ad04de8765fd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/3.jpg saved to cache
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29ce0965-3c38-5ccb-ab1d-23d2ea812ff3
2026-03-27 16:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:47 [ayvens.fr] INFO: Found listing with ID: 1988517
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988517%27 HTTP/1.1" 200 None
2026-03-27 16:52:47 [ayvens.fr] INFO: Scrape type for 1988517: 1
2026-03-27 16:52:47 [ayvens.fr] INFO: Extracting data for car ID: 1988517
2026-03-27 16:52:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdf66095-d009-5883-955d-8f2b983a67f0 with identifier: 1988517
2026-03-27 16:52:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdf66095-d009-5883-955d-8f2b983a67f0 with scrape type 1
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item fdf66095-d009-5883-955d-8f2b983a67f0
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F748f41b9e3b3407d85d6e171be1d1f9a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/1.jpg not downloaded yet
2026-03-27 16:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b05b50>
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29ce0965-3c38-5ccb-ab1d-23d2ea812ff3/29ce0965-3c38-5ccb-ab1d-23d2ea812ff3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F534ef6e598a84be6aef2ad04de8765fd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/4.jpg saved to cache
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29ce0965-3c38-5ccb-ab1d-23d2ea812ff3
2026-03-27 16:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F748f41b9e3b3407d85d6e171be1d1f9a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/2.jpg not downloaded yet
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b05a90>
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29ce0965-3c38-5ccb-ab1d-23d2ea812ff3/29ce0965-3c38-5ccb-ab1d-23d2ea812ff3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F534ef6e598a84be6aef2ad04de8765fd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/5.jpg saved to cache
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29ce0965-3c38-5ccb-ab1d-23d2ea812ff3
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590696850>
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29ce0965-3c38-5ccb-ab1d-23d2ea812ff3/29ce0965-3c38-5ccb-ab1d-23d2ea812ff3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F534ef6e598a84be6aef2ad04de8765fd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/6.jpg saved to cache
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 29ce0965-3c38-5ccb-ab1d-23d2ea812ff3
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F748f41b9e3b3407d85d6e171be1d1f9a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/3.jpg not downloaded yet
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b5b150>
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29ce0965-3c38-5ccb-ab1d-23d2ea812ff3/29ce0965-3c38-5ccb-ab1d-23d2ea812ff3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F534ef6e598a84be6aef2ad04de8765fd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/7.jpg saved to cache
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 29ce0965-3c38-5ccb-ab1d-23d2ea812ff3
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591115910>
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_796cdd4a-f1c4-560e-8c11-e80d78deaa5e/796cdd4a-f1c4-560e-8c11-e80d78deaa5e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F450bf796c36a438ca0e38cbd48dc352c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/3.jpg saved to cache
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 796cdd4a-f1c4-560e-8c11-e80d78deaa5e
2026-03-27 16:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F748f41b9e3b3407d85d6e171be1d1f9a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/4.jpg not downloaded yet
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590615210>
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29ce0965-3c38-5ccb-ab1d-23d2ea812ff3/29ce0965-3c38-5ccb-ab1d-23d2ea812ff3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F534ef6e598a84be6aef2ad04de8765fd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/8.jpg saved to cache
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 29ce0965-3c38-5ccb-ab1d-23d2ea812ff3
2026-03-27 16:52:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29ce0965-3c38-5ccb-ab1d-23d2ea812ff3, skipping ID generation
2026-03-27 16:52:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29ce0965-3c38-5ccb-ab1d-23d2ea812ff3 with scrape type 1
2026-03-27 16:52:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29ce0965-3c38-5ccb-ab1d-23d2ea812ff3 sending to next pipeline
2026-03-27 16:52:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 29ce0965-3c38-5ccb-ab1d-23d2ea812ff3, identifier: 1988515
2026-03-27 16:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910a1090>
2026-03-27 16:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_796cdd4a-f1c4-560e-8c11-e80d78deaa5e/796cdd4a-f1c4-560e-8c11-e80d78deaa5e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F450bf796c36a438ca0e38cbd48dc352c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/2.jpg saved to cache
2026-03-27 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 796cdd4a-f1c4-560e-8c11-e80d78deaa5e
2026-03-27 16:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dff190>
2026-03-27 16:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_796cdd4a-f1c4-560e-8c11-e80d78deaa5e/796cdd4a-f1c4-560e-8c11-e80d78deaa5e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F450bf796c36a438ca0e38cbd48dc352c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/1.jpg saved to cache
2026-03-27 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 796cdd4a-f1c4-560e-8c11-e80d78deaa5e
2026-03-27 16:52:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 29ce0965-3c38-5ccb-ab1d-23d2ea812ff3 with identifier: 1988515
2026-03-27 16:52:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 29ce0965-3c38-5ccb-ab1d-23d2ea812ff3 with identifier: 1988515
2026-03-27 16:52:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 29ce0965-3c38-5ccb-ab1d-23d2ea812ff3 with identifier: 1988515 to the API
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 24,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'phev/petrol',
'id': '29ce0965-3c38-5ccb-ab1d-23d2ea812ff3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'MERCEDES-BENZ',
'model': 'CLASSE B',
'odometer': 81976,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29ce0965-3c38-5ccb-ab1d-23d2ea812ff3/29ce0965-3c38-5ccb-ab1d-23d2ea812ff3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 520298,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29ce0965-3c38-5ccb-ab1d-23d2ea812ff3/29ce0965-3c38-5ccb-ab1d-23d2ea812ff3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 520298,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29ce0965-3c38-5ccb-ab1d-23d2ea812ff3/29ce0965-3c38-5ccb-ab1d-23d2ea812ff3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 507025,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29ce0965-3c38-5ccb-ab1d-23d2ea812ff3/29ce0965-3c38-5ccb-ab1d-23d2ea812ff3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424764,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29ce0965-3c38-5ccb-ab1d-23d2ea812ff3/29ce0965-3c38-5ccb-ab1d-23d2ea812ff3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378777,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29ce0965-3c38-5ccb-ab1d-23d2ea812ff3/29ce0965-3c38-5ccb-ab1d-23d2ea812ff3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323112,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29ce0965-3c38-5ccb-ab1d-23d2ea812ff3/29ce0965-3c38-5ccb-ab1d-23d2ea812ff3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382504,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29ce0965-3c38-5ccb-ab1d-23d2ea812ff3/29ce0965-3c38-5ccb-ab1d-23d2ea812ff3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450246,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/534ef6e598a84be6aef2ad04de8765fd/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-24',
'seats_number': 5,
'seller_name': None,
'title': 'MERCEDES-BENZ CLASSE B Classe B 250 e 160+102ch Business Line '
'Edition 8G-DCT',
'transmission': 'automatic',
'trim': 'Classe B 250 e 160+102ch Business Line Edition 8G-DCT',
'vin': None,
'year': 2022}
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988515%27 HTTP/1.1" 200 None
2026-03-27 16:52:48 [ayvens.fr] INFO: Saving data for 1988515: {'created_time': 1774630368.668937, 'last_price_update_time': 1774630368.668949, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988515') HTTP/1.1" 204 0
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F748f41b9e3b3407d85d6e171be1d1f9a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/5.jpg not downloaded yet
2026-03-27 16:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b51ed0>
2026-03-27 16:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_796cdd4a-f1c4-560e-8c11-e80d78deaa5e/796cdd4a-f1c4-560e-8c11-e80d78deaa5e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F450bf796c36a438ca0e38cbd48dc352c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/4.jpg saved to cache
2026-03-27 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 796cdd4a-f1c4-560e-8c11-e80d78deaa5e
2026-03-27 16:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F748f41b9e3b3407d85d6e171be1d1f9a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/6.jpg not downloaded yet
2026-03-27 16:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F748f41b9e3b3407d85d6e171be1d1f9a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/7.jpg not downloaded yet
2026-03-27 16:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F748f41b9e3b3407d85d6e171be1d1f9a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/8.jpg not downloaded yet
2026-03-27 16:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:48 [ayvens.fr] INFO: Found listing with ID: 1988518
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988518%27 HTTP/1.1" 200 None
2026-03-27 16:52:48 [ayvens.fr] INFO: Scrape type for 1988518: 1
2026-03-27 16:52:48 [ayvens.fr] INFO: Extracting data for car ID: 1988518
2026-03-27 16:52:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 749c8d1d-58ff-58d5-af2f-05126c87161b with identifier: 1988518
2026-03-27 16:52:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 749c8d1d-58ff-58d5-af2f-05126c87161b with scrape type 1
2026-03-27 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 749c8d1d-58ff-58d5-af2f-05126c87161b
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F9a6be90b1f7b4c39a633c9dd1ba082f5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/1.jpg not downloaded yet
2026-03-27 16:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59307e190>
2026-03-27 16:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_796cdd4a-f1c4-560e-8c11-e80d78deaa5e/796cdd4a-f1c4-560e-8c11-e80d78deaa5e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F450bf796c36a438ca0e38cbd48dc352c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/6.jpg saved to cache
2026-03-27 16:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 796cdd4a-f1c4-560e-8c11-e80d78deaa5e
2026-03-27 16:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051b0d0>
2026-03-27 16:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_796cdd4a-f1c4-560e-8c11-e80d78deaa5e/796cdd4a-f1c4-560e-8c11-e80d78deaa5e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F450bf796c36a438ca0e38cbd48dc352c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/8.jpg saved to cache
2026-03-27 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 796cdd4a-f1c4-560e-8c11-e80d78deaa5e
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F9a6be90b1f7b4c39a633c9dd1ba082f5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/2.jpg not downloaded yet
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F9a6be90b1f7b4c39a633c9dd1ba082f5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/3.jpg not downloaded yet
2026-03-27 16:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591106790>
2026-03-27 16:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_796cdd4a-f1c4-560e-8c11-e80d78deaa5e/796cdd4a-f1c4-560e-8c11-e80d78deaa5e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F450bf796c36a438ca0e38cbd48dc352c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/5.jpg saved to cache
2026-03-27 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 796cdd4a-f1c4-560e-8c11-e80d78deaa5e
2026-03-27 16:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfffd0>
2026-03-27 16:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_796cdd4a-f1c4-560e-8c11-e80d78deaa5e/796cdd4a-f1c4-560e-8c11-e80d78deaa5e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F450bf796c36a438ca0e38cbd48dc352c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/7.jpg saved to cache
2026-03-27 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 796cdd4a-f1c4-560e-8c11-e80d78deaa5e
2026-03-27 16:52:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 796cdd4a-f1c4-560e-8c11-e80d78deaa5e, skipping ID generation
2026-03-27 16:52:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 796cdd4a-f1c4-560e-8c11-e80d78deaa5e with scrape type 1
2026-03-27 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 796cdd4a-f1c4-560e-8c11-e80d78deaa5e sending to next pipeline
2026-03-27 16:52:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 796cdd4a-f1c4-560e-8c11-e80d78deaa5e, identifier: 1988516
2026-03-27 16:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5a051ec90>
2026-03-27 16:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdf66095-d009-5883-955d-8f2b983a67f0/fdf66095-d009-5883-955d-8f2b983a67f0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F748f41b9e3b3407d85d6e171be1d1f9a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/1.jpg saved to cache
2026-03-27 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fdf66095-d009-5883-955d-8f2b983a67f0
2026-03-27 16:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5914451d0>
2026-03-27 16:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdf66095-d009-5883-955d-8f2b983a67f0/fdf66095-d009-5883-955d-8f2b983a67f0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F748f41b9e3b3407d85d6e171be1d1f9a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/2.jpg saved to cache
2026-03-27 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fdf66095-d009-5883-955d-8f2b983a67f0
2026-03-27 16:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F9a6be90b1f7b4c39a633c9dd1ba082f5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/4.jpg not downloaded yet
2026-03-27 16:52:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 796cdd4a-f1c4-560e-8c11-e80d78deaa5e with identifier: 1988516
2026-03-27 16:52:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 796cdd4a-f1c4-560e-8c11-e80d78deaa5e with identifier: 1988516
2026-03-27 16:52:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 796cdd4a-f1c4-560e-8c11-e80d78deaa5e with identifier: 1988516 to the API
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '796cdd4a-f1c4-560e-8c11-e80d78deaa5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 101652,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_796cdd4a-f1c4-560e-8c11-e80d78deaa5e/796cdd4a-f1c4-560e-8c11-e80d78deaa5e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421502,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_796cdd4a-f1c4-560e-8c11-e80d78deaa5e/796cdd4a-f1c4-560e-8c11-e80d78deaa5e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421502,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_796cdd4a-f1c4-560e-8c11-e80d78deaa5e/796cdd4a-f1c4-560e-8c11-e80d78deaa5e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365782,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_796cdd4a-f1c4-560e-8c11-e80d78deaa5e/796cdd4a-f1c4-560e-8c11-e80d78deaa5e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318566,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_796cdd4a-f1c4-560e-8c11-e80d78deaa5e/796cdd4a-f1c4-560e-8c11-e80d78deaa5e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352917,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_796cdd4a-f1c4-560e-8c11-e80d78deaa5e/796cdd4a-f1c4-560e-8c11-e80d78deaa5e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314663,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_796cdd4a-f1c4-560e-8c11-e80d78deaa5e/796cdd4a-f1c4-560e-8c11-e80d78deaa5e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418031,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_796cdd4a-f1c4-560e-8c11-e80d78deaa5e/796cdd4a-f1c4-560e-8c11-e80d78deaa5e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289852,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/450bf796c36a438ca0e38cbd48dc352c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-19',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Active Pack EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch S&S Active Pack EAT8',
'vin': None,
'year': 2022}
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988516%27 HTTP/1.1" 200 None
2026-03-27 16:52:49 [ayvens.fr] INFO: Saving data for 1988516: {'created_time': 1774630369.909732, 'last_price_update_time': 1774630369.909744, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988516') HTTP/1.1" 204 0
2026-03-27 16:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F9a6be90b1f7b4c39a633c9dd1ba082f5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/5.jpg not downloaded yet
2026-03-27 16:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d1d90>
2026-03-27 16:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdf66095-d009-5883-955d-8f2b983a67f0/fdf66095-d009-5883-955d-8f2b983a67f0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F748f41b9e3b3407d85d6e171be1d1f9a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/3.jpg saved to cache
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fdf66095-d009-5883-955d-8f2b983a67f0
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5942e9490>
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdf66095-d009-5883-955d-8f2b983a67f0/fdf66095-d009-5883-955d-8f2b983a67f0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F748f41b9e3b3407d85d6e171be1d1f9a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/7.jpg saved to cache
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fdf66095-d009-5883-955d-8f2b983a67f0
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F9a6be90b1f7b4c39a633c9dd1ba082f5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/6.jpg not downloaded yet
2026-03-27 16:52:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F9a6be90b1f7b4c39a633c9dd1ba082f5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/7.jpg not downloaded yet
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f6f490>
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdf66095-d009-5883-955d-8f2b983a67f0/fdf66095-d009-5883-955d-8f2b983a67f0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F748f41b9e3b3407d85d6e171be1d1f9a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/6.jpg saved to cache
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fdf66095-d009-5883-955d-8f2b983a67f0
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0e850>
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdf66095-d009-5883-955d-8f2b983a67f0/fdf66095-d009-5883-955d-8f2b983a67f0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F748f41b9e3b3407d85d6e171be1d1f9a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/4.jpg saved to cache
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fdf66095-d009-5883-955d-8f2b983a67f0
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b65e10>
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdf66095-d009-5883-955d-8f2b983a67f0/fdf66095-d009-5883-955d-8f2b983a67f0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F748f41b9e3b3407d85d6e171be1d1f9a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/5.jpg saved to cache
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fdf66095-d009-5883-955d-8f2b983a67f0
2026-03-27 16:52:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F9a6be90b1f7b4c39a633c9dd1ba082f5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/8.jpg not downloaded yet
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0c490>
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdf66095-d009-5883-955d-8f2b983a67f0/fdf66095-d009-5883-955d-8f2b983a67f0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F748f41b9e3b3407d85d6e171be1d1f9a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/8.jpg saved to cache
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fdf66095-d009-5883-955d-8f2b983a67f0
2026-03-27 16:52:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fdf66095-d009-5883-955d-8f2b983a67f0, skipping ID generation
2026-03-27 16:52:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdf66095-d009-5883-955d-8f2b983a67f0 with scrape type 1
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fdf66095-d009-5883-955d-8f2b983a67f0 sending to next pipeline
2026-03-27 16:52:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: fdf66095-d009-5883-955d-8f2b983a67f0, identifier: 1988517
2026-03-27 16:52:50 [ayvens.fr] INFO: Found listing with ID: 1988519
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988519%27 HTTP/1.1" 200 None
2026-03-27 16:52:50 [ayvens.fr] INFO: Scrape type for 1988519: 1
2026-03-27 16:52:50 [ayvens.fr] INFO: Extracting data for car ID: 1988519
2026-03-27 16:52:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b5a6131-fc9f-54bd-82f5-213158075bca with identifier: 1988519
2026-03-27 16:52:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b5a6131-fc9f-54bd-82f5-213158075bca with scrape type 1
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5b5a6131-fc9f-54bd-82f5-213158075bca
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F86158acabfd84190801f97128bb97376%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/1.jpg not downloaded yet
2026-03-27 16:52:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: fdf66095-d009-5883-955d-8f2b983a67f0 with identifier: 1988517
2026-03-27 16:52:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: fdf66095-d009-5883-955d-8f2b983a67f0 with identifier: 1988517
2026-03-27 16:52:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: fdf66095-d009-5883-955d-8f2b983a67f0 with identifier: 1988517 to the API
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': 'GRIS PLATINIUM METALLISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'fdf66095-d009-5883-955d-8f2b983a67f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C5 AIRCROSS',
'odometer': 122953,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdf66095-d009-5883-955d-8f2b983a67f0/fdf66095-d009-5883-955d-8f2b983a67f0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 483141,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdf66095-d009-5883-955d-8f2b983a67f0/fdf66095-d009-5883-955d-8f2b983a67f0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 483141,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdf66095-d009-5883-955d-8f2b983a67f0/fdf66095-d009-5883-955d-8f2b983a67f0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438242,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdf66095-d009-5883-955d-8f2b983a67f0/fdf66095-d009-5883-955d-8f2b983a67f0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344145,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdf66095-d009-5883-955d-8f2b983a67f0/fdf66095-d009-5883-955d-8f2b983a67f0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336416,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdf66095-d009-5883-955d-8f2b983a67f0/fdf66095-d009-5883-955d-8f2b983a67f0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344116,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdf66095-d009-5883-955d-8f2b983a67f0/fdf66095-d009-5883-955d-8f2b983a67f0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230559,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdf66095-d009-5883-955d-8f2b983a67f0/fdf66095-d009-5883-955d-8f2b983a67f0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371477,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/748f41b9e3b3407d85d6e171be1d1f9a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-23',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C5 AIRCROSS C5 Aircross BlueHDi 130ch S&S Business EAT8',
'transmission': 'automatic',
'trim': 'C5 Aircross BlueHDi 130ch S&S Business EAT8',
'vin': None,
'year': 2022}
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988517%27 HTTP/1.1" 200 None
2026-03-27 16:52:50 [ayvens.fr] INFO: Saving data for 1988517: {'created_time': 1774630370.835909, 'last_price_update_time': 1774630370.835922, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988517') HTTP/1.1" 204 0
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F86158acabfd84190801f97128bb97376%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/2.jpg not downloaded yet
2026-03-27 16:52:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590529750>
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_749c8d1d-58ff-58d5-af2f-05126c87161b/749c8d1d-58ff-58d5-af2f-05126c87161b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F9a6be90b1f7b4c39a633c9dd1ba082f5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/1.jpg saved to cache
2026-03-27 16:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 749c8d1d-58ff-58d5-af2f-05126c87161b
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591446c10>
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_749c8d1d-58ff-58d5-af2f-05126c87161b/749c8d1d-58ff-58d5-af2f-05126c87161b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F9a6be90b1f7b4c39a633c9dd1ba082f5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/2.jpg saved to cache
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 749c8d1d-58ff-58d5-af2f-05126c87161b
2026-03-27 16:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F86158acabfd84190801f97128bb97376%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/3.jpg not downloaded yet
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F86158acabfd84190801f97128bb97376%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/4.jpg not downloaded yet
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f13ed0>
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_749c8d1d-58ff-58d5-af2f-05126c87161b/749c8d1d-58ff-58d5-af2f-05126c87161b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F9a6be90b1f7b4c39a633c9dd1ba082f5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/3.jpg saved to cache
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 749c8d1d-58ff-58d5-af2f-05126c87161b
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de5fd0>
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_749c8d1d-58ff-58d5-af2f-05126c87161b/749c8d1d-58ff-58d5-af2f-05126c87161b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F9a6be90b1f7b4c39a633c9dd1ba082f5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/5.jpg saved to cache
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 749c8d1d-58ff-58d5-af2f-05126c87161b
2026-03-27 16:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F86158acabfd84190801f97128bb97376%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/5.jpg not downloaded yet
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b67890>
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_749c8d1d-58ff-58d5-af2f-05126c87161b/749c8d1d-58ff-58d5-af2f-05126c87161b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F9a6be90b1f7b4c39a633c9dd1ba082f5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/4.jpg saved to cache
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 749c8d1d-58ff-58d5-af2f-05126c87161b
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F86158acabfd84190801f97128bb97376%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/6.jpg not downloaded yet
2026-03-27 16:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F86158acabfd84190801f97128bb97376%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/7.jpg not downloaded yet
2026-03-27 16:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F86158acabfd84190801f97128bb97376%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/8.jpg not downloaded yet
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b2b450>
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_749c8d1d-58ff-58d5-af2f-05126c87161b/749c8d1d-58ff-58d5-af2f-05126c87161b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F9a6be90b1f7b4c39a633c9dd1ba082f5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/6.jpg saved to cache
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 749c8d1d-58ff-58d5-af2f-05126c87161b
2026-03-27 16:52:51 [ayvens.fr] INFO: Found listing with ID: 1988520
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988520%27 HTTP/1.1" 200 None
2026-03-27 16:52:51 [ayvens.fr] INFO: Scrape type for 1988520: 1
2026-03-27 16:52:51 [ayvens.fr] INFO: Extracting data for car ID: 1988520
2026-03-27 16:52:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52e23e56-d1e8-52fe-a140-6e54531672a2 with identifier: 1988520
2026-03-27 16:52:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52e23e56-d1e8-52fe-a140-6e54531672a2 with scrape type 1
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 52e23e56-d1e8-52fe-a140-6e54531672a2
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F2b0e3ee87b074309934cfb6a4fef6fcf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/1.jpg not downloaded yet
2026-03-27 16:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F2b0e3ee87b074309934cfb6a4fef6fcf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/2.jpg not downloaded yet
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591115390>
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_749c8d1d-58ff-58d5-af2f-05126c87161b/749c8d1d-58ff-58d5-af2f-05126c87161b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F9a6be90b1f7b4c39a633c9dd1ba082f5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/7.jpg saved to cache
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 749c8d1d-58ff-58d5-af2f-05126c87161b
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905181d0>
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_749c8d1d-58ff-58d5-af2f-05126c87161b/749c8d1d-58ff-58d5-af2f-05126c87161b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F9a6be90b1f7b4c39a633c9dd1ba082f5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/8.jpg saved to cache
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 749c8d1d-58ff-58d5-af2f-05126c87161b
2026-03-27 16:52:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 749c8d1d-58ff-58d5-af2f-05126c87161b, skipping ID generation
2026-03-27 16:52:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 749c8d1d-58ff-58d5-af2f-05126c87161b with scrape type 1
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 749c8d1d-58ff-58d5-af2f-05126c87161b sending to next pipeline
2026-03-27 16:52:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 749c8d1d-58ff-58d5-af2f-05126c87161b, identifier: 1988518
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de5550>
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b5a6131-fc9f-54bd-82f5-213158075bca/5b5a6131-fc9f-54bd-82f5-213158075bca_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F86158acabfd84190801f97128bb97376%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/1.jpg saved to cache
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b5a6131-fc9f-54bd-82f5-213158075bca
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F2b0e3ee87b074309934cfb6a4fef6fcf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/3.jpg not downloaded yet
2026-03-27 16:52:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 749c8d1d-58ff-58d5-af2f-05126c87161b with identifier: 1988518
2026-03-27 16:52:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 749c8d1d-58ff-58d5-af2f-05126c87161b with identifier: 1988518
2026-03-27 16:52:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 749c8d1d-58ff-58d5-af2f-05126c87161b with identifier: 1988518 to the API
2026-03-27 16:52:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '749c8d1d-58ff-58d5-af2f-05126c87161b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 79177,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_749c8d1d-58ff-58d5-af2f-05126c87161b/749c8d1d-58ff-58d5-af2f-05126c87161b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450329,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_749c8d1d-58ff-58d5-af2f-05126c87161b/749c8d1d-58ff-58d5-af2f-05126c87161b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450329,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_749c8d1d-58ff-58d5-af2f-05126c87161b/749c8d1d-58ff-58d5-af2f-05126c87161b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433023,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_749c8d1d-58ff-58d5-af2f-05126c87161b/749c8d1d-58ff-58d5-af2f-05126c87161b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418837,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_749c8d1d-58ff-58d5-af2f-05126c87161b/749c8d1d-58ff-58d5-af2f-05126c87161b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331666,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_749c8d1d-58ff-58d5-af2f-05126c87161b/749c8d1d-58ff-58d5-af2f-05126c87161b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338504,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_749c8d1d-58ff-58d5-af2f-05126c87161b/749c8d1d-58ff-58d5-af2f-05126c87161b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356019,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_749c8d1d-58ff-58d5-af2f-05126c87161b/749c8d1d-58ff-58d5-af2f-05126c87161b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340651,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/9a6be90b1f7b4c39a633c9dd1ba082f5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-10',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 230ch HEV GT-Line Premium BVA6 4x2',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 230ch HEV GT-Line Premium BVA6 4x2',
'vin': None,
'year': 2022}
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988518%27 HTTP/1.1" 200 None
2026-03-27 16:52:52 [ayvens.fr] INFO: Saving data for 1988518: {'created_time': 1774630372.429695, 'last_price_update_time': 1774630372.429705, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988518') HTTP/1.1" 204 0
2026-03-27 16:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F2b0e3ee87b074309934cfb6a4fef6fcf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/4.jpg not downloaded yet
2026-03-27 16:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e1710>
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b5a6131-fc9f-54bd-82f5-213158075bca/5b5a6131-fc9f-54bd-82f5-213158075bca_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F86158acabfd84190801f97128bb97376%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/2.jpg saved to cache
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b5a6131-fc9f-54bd-82f5-213158075bca
2026-03-27 16:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F2b0e3ee87b074309934cfb6a4fef6fcf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/5.jpg not downloaded yet
2026-03-27 16:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F2b0e3ee87b074309934cfb6a4fef6fcf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/6.jpg not downloaded yet
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F2b0e3ee87b074309934cfb6a4fef6fcf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/7.jpg not downloaded yet
2026-03-27 16:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe2750>
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b5a6131-fc9f-54bd-82f5-213158075bca/5b5a6131-fc9f-54bd-82f5-213158075bca_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F86158acabfd84190801f97128bb97376%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/3.jpg saved to cache
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b5a6131-fc9f-54bd-82f5-213158075bca
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ae9d50>
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b5a6131-fc9f-54bd-82f5-213158075bca/5b5a6131-fc9f-54bd-82f5-213158075bca_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F86158acabfd84190801f97128bb97376%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/6.jpg saved to cache
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b5a6131-fc9f-54bd-82f5-213158075bca
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F2b0e3ee87b074309934cfb6a4fef6fcf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/8.jpg not downloaded yet
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a07d0>
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b5a6131-fc9f-54bd-82f5-213158075bca/5b5a6131-fc9f-54bd-82f5-213158075bca_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F86158acabfd84190801f97128bb97376%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/4.jpg saved to cache
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b5a6131-fc9f-54bd-82f5-213158075bca
2026-03-27 16:52:52 [ayvens.fr] INFO: Found listing with ID: 1988521
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988521%27 HTTP/1.1" 200 None
2026-03-27 16:52:52 [ayvens.fr] INFO: Scrape type for 1988521: 1
2026-03-27 16:52:52 [ayvens.fr] INFO: Extracting data for car ID: 1988521
2026-03-27 16:52:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 655d8099-7a04-51ba-a287-0fd5a39eb879 with identifier: 1988521
2026-03-27 16:52:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 655d8099-7a04-51ba-a287-0fd5a39eb879 with scrape type 1
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 655d8099-7a04-51ba-a287-0fd5a39eb879
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F78dd70e588464889bec3f9930d9b9c39%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/1.jpg not downloaded yet
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b6ab90>
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b5a6131-fc9f-54bd-82f5-213158075bca/5b5a6131-fc9f-54bd-82f5-213158075bca_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F86158acabfd84190801f97128bb97376%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/7.jpg saved to cache
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b5a6131-fc9f-54bd-82f5-213158075bca
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590db9910>
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b5a6131-fc9f-54bd-82f5-213158075bca/5b5a6131-fc9f-54bd-82f5-213158075bca_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F86158acabfd84190801f97128bb97376%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/8.jpg saved to cache
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b5a6131-fc9f-54bd-82f5-213158075bca
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d58a90>
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b5a6131-fc9f-54bd-82f5-213158075bca/5b5a6131-fc9f-54bd-82f5-213158075bca_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252F86158acabfd84190801f97128bb97376%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/5.jpg saved to cache
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b5a6131-fc9f-54bd-82f5-213158075bca
2026-03-27 16:52:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b5a6131-fc9f-54bd-82f5-213158075bca, skipping ID generation
2026-03-27 16:52:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b5a6131-fc9f-54bd-82f5-213158075bca with scrape type 1
2026-03-27 16:52:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b5a6131-fc9f-54bd-82f5-213158075bca sending to next pipeline
2026-03-27 16:52:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5b5a6131-fc9f-54bd-82f5-213158075bca, identifier: 1988519
2026-03-27 16:52:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59057ebd0>
2026-03-27 16:52:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52e23e56-d1e8-52fe-a140-6e54531672a2/52e23e56-d1e8-52fe-a140-6e54531672a2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F2b0e3ee87b074309934cfb6a4fef6fcf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/1.jpg saved to cache
2026-03-27 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52e23e56-d1e8-52fe-a140-6e54531672a2
2026-03-27 16:52:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5b5a6131-fc9f-54bd-82f5-213158075bca with identifier: 1988519
2026-03-27 16:52:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5b5a6131-fc9f-54bd-82f5-213158075bca with identifier: 1988519
2026-03-27 16:52:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5b5a6131-fc9f-54bd-82f5-213158075bca with identifier: 1988519 to the API
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 84,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '5b5a6131-fc9f-54bd-82f5-213158075bca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS HYBRID',
'odometer': 51110,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b5a6131-fc9f-54bd-82f5-213158075bca/5b5a6131-fc9f-54bd-82f5-213158075bca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402415,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b5a6131-fc9f-54bd-82f5-213158075bca/5b5a6131-fc9f-54bd-82f5-213158075bca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402415,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b5a6131-fc9f-54bd-82f5-213158075bca/5b5a6131-fc9f-54bd-82f5-213158075bca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 390866,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b5a6131-fc9f-54bd-82f5-213158075bca/5b5a6131-fc9f-54bd-82f5-213158075bca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328320,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b5a6131-fc9f-54bd-82f5-213158075bca/5b5a6131-fc9f-54bd-82f5-213158075bca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361669,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b5a6131-fc9f-54bd-82f5-213158075bca/5b5a6131-fc9f-54bd-82f5-213158075bca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319113,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b5a6131-fc9f-54bd-82f5-213158075bca/5b5a6131-fc9f-54bd-82f5-213158075bca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253984,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b5a6131-fc9f-54bd-82f5-213158075bca/5b5a6131-fc9f-54bd-82f5-213158075bca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228123,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/86158acabfd84190801f97128bb97376/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-01',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA YARIS HYBRID Yaris 100h France 5p',
'transmission': 'automatic',
'trim': 'Yaris 100h France 5p',
'vin': None,
'year': 2019}
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988519%27 HTTP/1.1" 200 None
2026-03-27 16:52:53 [ayvens.fr] INFO: Saving data for 1988519: {'created_time': 1774630373.573011, 'last_price_update_time': 1774630373.573022, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988519') HTTP/1.1" 204 0
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F78dd70e588464889bec3f9930d9b9c39%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/2.jpg not downloaded yet
2026-03-27 16:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F78dd70e588464889bec3f9930d9b9c39%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/3.jpg not downloaded yet
2026-03-27 16:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F78dd70e588464889bec3f9930d9b9c39%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/4.jpg not downloaded yet
2026-03-27 16:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F78dd70e588464889bec3f9930d9b9c39%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/5.jpg not downloaded yet
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F78dd70e588464889bec3f9930d9b9c39%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/6.jpg not downloaded yet
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F78dd70e588464889bec3f9930d9b9c39%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/7.jpg not downloaded yet
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F78dd70e588464889bec3f9930d9b9c39%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/8.jpg not downloaded yet
2026-03-27 16:52:53 [ayvens.fr] INFO: Found listing with ID: 1988522
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988522%27 HTTP/1.1" 200 None
2026-03-27 16:52:53 [ayvens.fr] INFO: Scrape type for 1988522: 1
2026-03-27 16:52:53 [ayvens.fr] INFO: Extracting data for car ID: 1988522
2026-03-27 16:52:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8081f6cc-771d-52ed-b76e-62e0e61c018b with identifier: 1988522
2026-03-27 16:52:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8081f6cc-771d-52ed-b76e-62e0e61c018b with scrape type 1
2026-03-27 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 8081f6cc-771d-52ed-b76e-62e0e61c018b
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ff54ce6bcb2564fcb8752cb9045a85b34%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/1.jpg not downloaded yet
2026-03-27 16:52:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590eff510>
2026-03-27 16:52:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52e23e56-d1e8-52fe-a140-6e54531672a2/52e23e56-d1e8-52fe-a140-6e54531672a2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F2b0e3ee87b074309934cfb6a4fef6fcf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/5.jpg saved to cache
2026-03-27 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 52e23e56-d1e8-52fe-a140-6e54531672a2
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ff54ce6bcb2564fcb8752cb9045a85b34%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/2.jpg not downloaded yet
2026-03-27 16:52:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dc6010>
2026-03-27 16:52:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52e23e56-d1e8-52fe-a140-6e54531672a2/52e23e56-d1e8-52fe-a140-6e54531672a2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F2b0e3ee87b074309934cfb6a4fef6fcf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/3.jpg saved to cache
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 52e23e56-d1e8-52fe-a140-6e54531672a2
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ac78d0>
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52e23e56-d1e8-52fe-a140-6e54531672a2/52e23e56-d1e8-52fe-a140-6e54531672a2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F2b0e3ee87b074309934cfb6a4fef6fcf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/4.jpg saved to cache
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 52e23e56-d1e8-52fe-a140-6e54531672a2
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd3450>
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52e23e56-d1e8-52fe-a140-6e54531672a2/52e23e56-d1e8-52fe-a140-6e54531672a2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F2b0e3ee87b074309934cfb6a4fef6fcf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/2.jpg saved to cache
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 52e23e56-d1e8-52fe-a140-6e54531672a2
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59067f950>
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52e23e56-d1e8-52fe-a140-6e54531672a2/52e23e56-d1e8-52fe-a140-6e54531672a2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F2b0e3ee87b074309934cfb6a4fef6fcf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/6.jpg saved to cache
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 52e23e56-d1e8-52fe-a140-6e54531672a2
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d1050>
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52e23e56-d1e8-52fe-a140-6e54531672a2/52e23e56-d1e8-52fe-a140-6e54531672a2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F2b0e3ee87b074309934cfb6a4fef6fcf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/7.jpg saved to cache
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 52e23e56-d1e8-52fe-a140-6e54531672a2
2026-03-27 16:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ff54ce6bcb2564fcb8752cb9045a85b34%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/3.jpg not downloaded yet
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ff54ce6bcb2564fcb8752cb9045a85b34%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/4.jpg not downloaded yet
2026-03-27 16:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ff54ce6bcb2564fcb8752cb9045a85b34%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/5.jpg not downloaded yet
2026-03-27 16:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ff54ce6bcb2564fcb8752cb9045a85b34%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/6.jpg not downloaded yet
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ff54ce6bcb2564fcb8752cb9045a85b34%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/7.jpg not downloaded yet
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ff54ce6bcb2564fcb8752cb9045a85b34%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/8.jpg not downloaded yet
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd0d90>
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_655d8099-7a04-51ba-a287-0fd5a39eb879/655d8099-7a04-51ba-a287-0fd5a39eb879_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F78dd70e588464889bec3f9930d9b9c39%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/1.jpg saved to cache
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 655d8099-7a04-51ba-a287-0fd5a39eb879
2026-03-27 16:52:54 [ayvens.fr] INFO: Found listing with ID: 1988523
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988523%27 HTTP/1.1" 200 None
2026-03-27 16:52:54 [ayvens.fr] INFO: Scrape type for 1988523: 1
2026-03-27 16:52:54 [ayvens.fr] INFO: Extracting data for car ID: 1988523
2026-03-27 16:52:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec520e4e-0a20-53df-aa66-92dc88e27cb1 with identifier: 1988523
2026-03-27 16:52:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec520e4e-0a20-53df-aa66-92dc88e27cb1 with scrape type 1
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ec520e4e-0a20-53df-aa66-92dc88e27cb1
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa41a100170d3412498089176ca390ae5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/1.jpg not downloaded yet
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa41a100170d3412498089176ca390ae5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/2.jpg not downloaded yet
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d50a90>
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_655d8099-7a04-51ba-a287-0fd5a39eb879/655d8099-7a04-51ba-a287-0fd5a39eb879_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F78dd70e588464889bec3f9930d9b9c39%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/4.jpg saved to cache
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 655d8099-7a04-51ba-a287-0fd5a39eb879
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590645550>
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_655d8099-7a04-51ba-a287-0fd5a39eb879/655d8099-7a04-51ba-a287-0fd5a39eb879_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F78dd70e588464889bec3f9930d9b9c39%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/3.jpg saved to cache
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 655d8099-7a04-51ba-a287-0fd5a39eb879
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910ec210>
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_655d8099-7a04-51ba-a287-0fd5a39eb879/655d8099-7a04-51ba-a287-0fd5a39eb879_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F78dd70e588464889bec3f9930d9b9c39%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/2.jpg saved to cache
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 655d8099-7a04-51ba-a287-0fd5a39eb879
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fcbb50>
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_655d8099-7a04-51ba-a287-0fd5a39eb879/655d8099-7a04-51ba-a287-0fd5a39eb879_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F78dd70e588464889bec3f9930d9b9c39%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/6.jpg saved to cache
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 655d8099-7a04-51ba-a287-0fd5a39eb879
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910ed8d0>
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_655d8099-7a04-51ba-a287-0fd5a39eb879/655d8099-7a04-51ba-a287-0fd5a39eb879_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F78dd70e588464889bec3f9930d9b9c39%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/7.jpg saved to cache
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 655d8099-7a04-51ba-a287-0fd5a39eb879
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590abae90>
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52e23e56-d1e8-52fe-a140-6e54531672a2/52e23e56-d1e8-52fe-a140-6e54531672a2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F2b0e3ee87b074309934cfb6a4fef6fcf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/8.jpg saved to cache
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 52e23e56-d1e8-52fe-a140-6e54531672a2
2026-03-27 16:52:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 52e23e56-d1e8-52fe-a140-6e54531672a2, skipping ID generation
2026-03-27 16:52:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52e23e56-d1e8-52fe-a140-6e54531672a2 with scrape type 1
2026-03-27 16:52:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52e23e56-d1e8-52fe-a140-6e54531672a2 sending to next pipeline
2026-03-27 16:52:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 52e23e56-d1e8-52fe-a140-6e54531672a2, identifier: 1988520
2026-03-27 16:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590eff2d0>
2026-03-27 16:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_655d8099-7a04-51ba-a287-0fd5a39eb879/655d8099-7a04-51ba-a287-0fd5a39eb879_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F78dd70e588464889bec3f9930d9b9c39%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/5.jpg saved to cache
2026-03-27 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 655d8099-7a04-51ba-a287-0fd5a39eb879
2026-03-27 16:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 52e23e56-d1e8-52fe-a140-6e54531672a2 with identifier: 1988520
2026-03-27 16:52:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 52e23e56-d1e8-52fe-a140-6e54531672a2 with identifier: 1988520
2026-03-27 16:52:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 52e23e56-d1e8-52fe-a140-6e54531672a2 with identifier: 1988520 to the API
2026-03-27 16:52:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 146,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '52e23e56-d1e8-52fe-a140-6e54531672a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'TIGUAN',
'odometer': 95296,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52e23e56-d1e8-52fe-a140-6e54531672a2/52e23e56-d1e8-52fe-a140-6e54531672a2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 463970,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52e23e56-d1e8-52fe-a140-6e54531672a2/52e23e56-d1e8-52fe-a140-6e54531672a2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 463970,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52e23e56-d1e8-52fe-a140-6e54531672a2/52e23e56-d1e8-52fe-a140-6e54531672a2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437683,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52e23e56-d1e8-52fe-a140-6e54531672a2/52e23e56-d1e8-52fe-a140-6e54531672a2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 413943,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52e23e56-d1e8-52fe-a140-6e54531672a2/52e23e56-d1e8-52fe-a140-6e54531672a2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306156,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52e23e56-d1e8-52fe-a140-6e54531672a2/52e23e56-d1e8-52fe-a140-6e54531672a2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321310,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52e23e56-d1e8-52fe-a140-6e54531672a2/52e23e56-d1e8-52fe-a140-6e54531672a2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328755,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52e23e56-d1e8-52fe-a140-6e54531672a2/52e23e56-d1e8-52fe-a140-6e54531672a2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 472983,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/2b0e3ee87b074309934cfb6a4fef6fcf/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-12',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN Tiguan 2.0 TDI 150ch Life Business DSG7',
'transmission': 'automatic',
'trim': 'Tiguan 2.0 TDI 150ch Life Business DSG7',
'vin': None,
'year': 2021}
2026-03-27 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988520%27 HTTP/1.1" 200 None
2026-03-27 16:52:55 [ayvens.fr] INFO: Saving data for 1988520: {'created_time': 1774630375.586212, 'last_price_update_time': 1774630375.586224, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988520') HTTP/1.1" 204 0
2026-03-27 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa41a100170d3412498089176ca390ae5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/3.jpg not downloaded yet
2026-03-27 16:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa41a100170d3412498089176ca390ae5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/4.jpg not downloaded yet
2026-03-27 16:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b42510>
2026-03-27 16:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_655d8099-7a04-51ba-a287-0fd5a39eb879/655d8099-7a04-51ba-a287-0fd5a39eb879_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F78dd70e588464889bec3f9930d9b9c39%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/8.jpg saved to cache
2026-03-27 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 655d8099-7a04-51ba-a287-0fd5a39eb879
2026-03-27 16:52:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 655d8099-7a04-51ba-a287-0fd5a39eb879, skipping ID generation
2026-03-27 16:52:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 655d8099-7a04-51ba-a287-0fd5a39eb879 with scrape type 1
2026-03-27 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 655d8099-7a04-51ba-a287-0fd5a39eb879 sending to next pipeline
2026-03-27 16:52:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 655d8099-7a04-51ba-a287-0fd5a39eb879, identifier: 1988521
2026-03-27 16:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa41a100170d3412498089176ca390ae5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/5.jpg not downloaded yet
2026-03-27 16:52:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 655d8099-7a04-51ba-a287-0fd5a39eb879 with identifier: 1988521
2026-03-27 16:52:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 655d8099-7a04-51ba-a287-0fd5a39eb879 with identifier: 1988521
2026-03-27 16:52:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 655d8099-7a04-51ba-a287-0fd5a39eb879 with identifier: 1988521 to the API
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '655d8099-7a04-51ba-a287-0fd5a39eb879',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'X1',
'odometer': 74357,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_655d8099-7a04-51ba-a287-0fd5a39eb879/655d8099-7a04-51ba-a287-0fd5a39eb879_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408046,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_655d8099-7a04-51ba-a287-0fd5a39eb879/655d8099-7a04-51ba-a287-0fd5a39eb879_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408046,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_655d8099-7a04-51ba-a287-0fd5a39eb879/655d8099-7a04-51ba-a287-0fd5a39eb879_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392288,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_655d8099-7a04-51ba-a287-0fd5a39eb879/655d8099-7a04-51ba-a287-0fd5a39eb879_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375498,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_655d8099-7a04-51ba-a287-0fd5a39eb879/655d8099-7a04-51ba-a287-0fd5a39eb879_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391752,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_655d8099-7a04-51ba-a287-0fd5a39eb879/655d8099-7a04-51ba-a287-0fd5a39eb879_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345652,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_655d8099-7a04-51ba-a287-0fd5a39eb879/655d8099-7a04-51ba-a287-0fd5a39eb879_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332721,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_655d8099-7a04-51ba-a287-0fd5a39eb879/655d8099-7a04-51ba-a287-0fd5a39eb879_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340287,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/78dd70e588464889bec3f9930d9b9c39/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 X1 sDrive18dA 150ch Business Design',
'transmission': 'automatic',
'trim': 'X1 sDrive18dA 150ch Business Design',
'vin': None,
'year': 2022}
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988521%27 HTTP/1.1" 200 None
2026-03-27 16:52:56 [ayvens.fr] INFO: Saving data for 1988521: {'created_time': 1774630376.353916, 'last_price_update_time': 1774630376.353925, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988521') HTTP/1.1" 204 0
2026-03-27 16:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa41a100170d3412498089176ca390ae5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/6.jpg not downloaded yet
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590af1150>
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8081f6cc-771d-52ed-b76e-62e0e61c018b/8081f6cc-771d-52ed-b76e-62e0e61c018b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ff54ce6bcb2564fcb8752cb9045a85b34%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/4.jpg saved to cache
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8081f6cc-771d-52ed-b76e-62e0e61c018b
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906179d0>
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8081f6cc-771d-52ed-b76e-62e0e61c018b/8081f6cc-771d-52ed-b76e-62e0e61c018b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ff54ce6bcb2564fcb8752cb9045a85b34%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/5.jpg saved to cache
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8081f6cc-771d-52ed-b76e-62e0e61c018b
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910edd10>
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8081f6cc-771d-52ed-b76e-62e0e61c018b/8081f6cc-771d-52ed-b76e-62e0e61c018b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ff54ce6bcb2564fcb8752cb9045a85b34%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/2.jpg saved to cache
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8081f6cc-771d-52ed-b76e-62e0e61c018b
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591050090>
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8081f6cc-771d-52ed-b76e-62e0e61c018b/8081f6cc-771d-52ed-b76e-62e0e61c018b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ff54ce6bcb2564fcb8752cb9045a85b34%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/3.jpg saved to cache
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8081f6cc-771d-52ed-b76e-62e0e61c018b
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590aea3d0>
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8081f6cc-771d-52ed-b76e-62e0e61c018b/8081f6cc-771d-52ed-b76e-62e0e61c018b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ff54ce6bcb2564fcb8752cb9045a85b34%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/6.jpg saved to cache
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8081f6cc-771d-52ed-b76e-62e0e61c018b
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905aba90>
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8081f6cc-771d-52ed-b76e-62e0e61c018b/8081f6cc-771d-52ed-b76e-62e0e61c018b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ff54ce6bcb2564fcb8752cb9045a85b34%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/7.jpg saved to cache
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8081f6cc-771d-52ed-b76e-62e0e61c018b
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa41a100170d3412498089176ca390ae5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/7.jpg not downloaded yet
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa41a100170d3412498089176ca390ae5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/8.jpg not downloaded yet
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c3fd0>
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8081f6cc-771d-52ed-b76e-62e0e61c018b/8081f6cc-771d-52ed-b76e-62e0e61c018b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ff54ce6bcb2564fcb8752cb9045a85b34%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/1.jpg saved to cache
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8081f6cc-771d-52ed-b76e-62e0e61c018b
2026-03-27 16:52:56 [ayvens.fr] INFO: Found listing with ID: 1988524
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988524%27 HTTP/1.1" 200 None
2026-03-27 16:52:56 [ayvens.fr] INFO: Scrape type for 1988524: 1
2026-03-27 16:52:56 [ayvens.fr] INFO: Extracting data for car ID: 1988524
2026-03-27 16:52:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5f8313b-cedb-5908-a93f-7ffde4d390db with identifier: 1988524
2026-03-27 16:52:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5f8313b-cedb-5908-a93f-7ffde4d390db with scrape type 1
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f5f8313b-cedb-5908-a93f-7ffde4d390db
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F77374aa091b94b9ab82c54ab673fd84b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/1.jpg not downloaded yet
2026-03-27 16:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F77374aa091b94b9ab82c54ab673fd84b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/2.jpg not downloaded yet
2026-03-27 16:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F77374aa091b94b9ab82c54ab673fd84b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/3.jpg not downloaded yet
2026-03-27 16:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F77374aa091b94b9ab82c54ab673fd84b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/4.jpg not downloaded yet
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F77374aa091b94b9ab82c54ab673fd84b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/5.jpg not downloaded yet
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F77374aa091b94b9ab82c54ab673fd84b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/6.jpg not downloaded yet
2026-03-27 16:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F77374aa091b94b9ab82c54ab673fd84b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/7.jpg not downloaded yet
2026-03-27 16:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F77374aa091b94b9ab82c54ab673fd84b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/8.jpg not downloaded yet
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910c6010>
2026-03-27 16:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8081f6cc-771d-52ed-b76e-62e0e61c018b/8081f6cc-771d-52ed-b76e-62e0e61c018b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ff54ce6bcb2564fcb8752cb9045a85b34%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/8.jpg saved to cache
2026-03-27 16:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8081f6cc-771d-52ed-b76e-62e0e61c018b
2026-03-27 16:52:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8081f6cc-771d-52ed-b76e-62e0e61c018b, skipping ID generation
2026-03-27 16:52:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8081f6cc-771d-52ed-b76e-62e0e61c018b with scrape type 1
2026-03-27 16:52:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8081f6cc-771d-52ed-b76e-62e0e61c018b sending to next pipeline
2026-03-27 16:52:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8081f6cc-771d-52ed-b76e-62e0e61c018b, identifier: 1988522
2026-03-27 16:52:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59307f7d0>
2026-03-27 16:52:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec520e4e-0a20-53df-aa66-92dc88e27cb1/ec520e4e-0a20-53df-aa66-92dc88e27cb1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa41a100170d3412498089176ca390ae5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/4.jpg saved to cache
2026-03-27 16:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec520e4e-0a20-53df-aa66-92dc88e27cb1
2026-03-27 16:52:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b0e990>
2026-03-27 16:52:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec520e4e-0a20-53df-aa66-92dc88e27cb1/ec520e4e-0a20-53df-aa66-92dc88e27cb1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa41a100170d3412498089176ca390ae5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/2.jpg saved to cache
2026-03-27 16:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec520e4e-0a20-53df-aa66-92dc88e27cb1
2026-03-27 16:52:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59063da90>
2026-03-27 16:52:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec520e4e-0a20-53df-aa66-92dc88e27cb1/ec520e4e-0a20-53df-aa66-92dc88e27cb1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa41a100170d3412498089176ca390ae5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/1.jpg saved to cache
2026-03-27 16:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec520e4e-0a20-53df-aa66-92dc88e27cb1
2026-03-27 16:52:57 [ayvens.fr] INFO: Found listing with ID: 1988525
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988525%27 HTTP/1.1" 200 None
2026-03-27 16:52:57 [ayvens.fr] INFO: Scrape type for 1988525: 1
2026-03-27 16:52:57 [ayvens.fr] INFO: Extracting data for car ID: 1988525
2026-03-27 16:52:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92497cc4-9c86-518d-8948-4762cf9d3aef with identifier: 1988525
2026-03-27 16:52:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92497cc4-9c86-518d-8948-4762cf9d3aef with scrape type 1
2026-03-27 16:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 92497cc4-9c86-518d-8948-4762cf9d3aef
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9567336e1fc847c38b7a65b387916f4b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/1.jpg not downloaded yet
2026-03-27 16:52:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8081f6cc-771d-52ed-b76e-62e0e61c018b with identifier: 1988522
2026-03-27 16:52:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8081f6cc-771d-52ed-b76e-62e0e61c018b with identifier: 1988522
2026-03-27 16:52:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8081f6cc-771d-52ed-b76e-62e0e61c018b with identifier: 1988522 to the API
2026-03-27 16:52:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': '8081f6cc-771d-52ed-b76e-62e0e61c018b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 106005,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8081f6cc-771d-52ed-b76e-62e0e61c018b/8081f6cc-771d-52ed-b76e-62e0e61c018b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464325,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8081f6cc-771d-52ed-b76e-62e0e61c018b/8081f6cc-771d-52ed-b76e-62e0e61c018b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464325,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8081f6cc-771d-52ed-b76e-62e0e61c018b/8081f6cc-771d-52ed-b76e-62e0e61c018b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 511573,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8081f6cc-771d-52ed-b76e-62e0e61c018b/8081f6cc-771d-52ed-b76e-62e0e61c018b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340383,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8081f6cc-771d-52ed-b76e-62e0e61c018b/8081f6cc-771d-52ed-b76e-62e0e61c018b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8081f6cc-771d-52ed-b76e-62e0e61c018b/8081f6cc-771d-52ed-b76e-62e0e61c018b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351846,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8081f6cc-771d-52ed-b76e-62e0e61c018b/8081f6cc-771d-52ed-b76e-62e0e61c018b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281639,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8081f6cc-771d-52ed-b76e-62e0e61c018b/8081f6cc-771d-52ed-b76e-62e0e61c018b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 533193,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/f54ce6bcb2564fcb8752cb9045a85b34/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-21',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.5 BlueHDi 100ch S&S Active Business',
'transmission': 'manual',
'trim': '208 1.5 BlueHDi 100ch S&S Active Business',
'vin': None,
'year': 2021}
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988522%27 HTTP/1.1" 200 None
2026-03-27 16:52:58 [ayvens.fr] INFO: Saving data for 1988522: {'created_time': 1774630378.243768, 'last_price_update_time': 1774630378.243784, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988522') HTTP/1.1" 204 0
2026-03-27 16:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df5cd0>
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec520e4e-0a20-53df-aa66-92dc88e27cb1/ec520e4e-0a20-53df-aa66-92dc88e27cb1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa41a100170d3412498089176ca390ae5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/3.jpg saved to cache
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec520e4e-0a20-53df-aa66-92dc88e27cb1
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9567336e1fc847c38b7a65b387916f4b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/2.jpg not downloaded yet
2026-03-27 16:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9567336e1fc847c38b7a65b387916f4b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/3.jpg not downloaded yet
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59317add0>
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec520e4e-0a20-53df-aa66-92dc88e27cb1/ec520e4e-0a20-53df-aa66-92dc88e27cb1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa41a100170d3412498089176ca390ae5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/5.jpg saved to cache
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec520e4e-0a20-53df-aa66-92dc88e27cb1
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906767d0>
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec520e4e-0a20-53df-aa66-92dc88e27cb1/ec520e4e-0a20-53df-aa66-92dc88e27cb1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa41a100170d3412498089176ca390ae5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/7.jpg saved to cache
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ec520e4e-0a20-53df-aa66-92dc88e27cb1
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b66ad0>
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f8313b-cedb-5908-a93f-7ffde4d390db/f5f8313b-cedb-5908-a93f-7ffde4d390db_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F77374aa091b94b9ab82c54ab673fd84b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/1.jpg saved to cache
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5f8313b-cedb-5908-a93f-7ffde4d390db
2026-03-27 16:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9567336e1fc847c38b7a65b387916f4b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/4.jpg not downloaded yet
2026-03-27 16:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b885d0>
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec520e4e-0a20-53df-aa66-92dc88e27cb1/ec520e4e-0a20-53df-aa66-92dc88e27cb1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa41a100170d3412498089176ca390ae5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/6.jpg saved to cache
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec520e4e-0a20-53df-aa66-92dc88e27cb1
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b49390>
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f8313b-cedb-5908-a93f-7ffde4d390db/f5f8313b-cedb-5908-a93f-7ffde4d390db_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F77374aa091b94b9ab82c54ab673fd84b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/2.jpg saved to cache
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5f8313b-cedb-5908-a93f-7ffde4d390db
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9567336e1fc847c38b7a65b387916f4b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/5.jpg not downloaded yet
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9567336e1fc847c38b7a65b387916f4b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/6.jpg not downloaded yet
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591002390>
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f8313b-cedb-5908-a93f-7ffde4d390db/f5f8313b-cedb-5908-a93f-7ffde4d390db_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F77374aa091b94b9ab82c54ab673fd84b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/4.jpg saved to cache
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5f8313b-cedb-5908-a93f-7ffde4d390db
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d0950>
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f8313b-cedb-5908-a93f-7ffde4d390db/f5f8313b-cedb-5908-a93f-7ffde4d390db_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F77374aa091b94b9ab82c54ab673fd84b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/6.jpg saved to cache
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5f8313b-cedb-5908-a93f-7ffde4d390db
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066e8d0>
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f8313b-cedb-5908-a93f-7ffde4d390db/f5f8313b-cedb-5908-a93f-7ffde4d390db_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F77374aa091b94b9ab82c54ab673fd84b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/3.jpg saved to cache
2026-03-27 16:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5f8313b-cedb-5908-a93f-7ffde4d390db
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d74910>
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f8313b-cedb-5908-a93f-7ffde4d390db/f5f8313b-cedb-5908-a93f-7ffde4d390db_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F77374aa091b94b9ab82c54ab673fd84b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/5.jpg saved to cache
2026-03-27 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5f8313b-cedb-5908-a93f-7ffde4d390db
2026-03-27 16:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b23ed0>
2026-03-27 16:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f8313b-cedb-5908-a93f-7ffde4d390db/f5f8313b-cedb-5908-a93f-7ffde4d390db_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F77374aa091b94b9ab82c54ab673fd84b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/7.jpg saved to cache
2026-03-27 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5f8313b-cedb-5908-a93f-7ffde4d390db
2026-03-27 16:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905a9410>
2026-03-27 16:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec520e4e-0a20-53df-aa66-92dc88e27cb1/ec520e4e-0a20-53df-aa66-92dc88e27cb1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fa41a100170d3412498089176ca390ae5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/8.jpg saved to cache
2026-03-27 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ec520e4e-0a20-53df-aa66-92dc88e27cb1
2026-03-27 16:52:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec520e4e-0a20-53df-aa66-92dc88e27cb1, skipping ID generation
2026-03-27 16:52:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec520e4e-0a20-53df-aa66-92dc88e27cb1 with scrape type 1
2026-03-27 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec520e4e-0a20-53df-aa66-92dc88e27cb1 sending to next pipeline
2026-03-27 16:52:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ec520e4e-0a20-53df-aa66-92dc88e27cb1, identifier: 1988523
2026-03-27 16:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ec520e4e-0a20-53df-aa66-92dc88e27cb1 with identifier: 1988523
2026-03-27 16:52:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ec520e4e-0a20-53df-aa66-92dc88e27cb1 with identifier: 1988523
2026-03-27 16:52:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ec520e4e-0a20-53df-aa66-92dc88e27cb1 with identifier: 1988523 to the API
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:52:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'ec520e4e-0a20-53df-aa66-92dc88e27cb1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 79783,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec520e4e-0a20-53df-aa66-92dc88e27cb1/ec520e4e-0a20-53df-aa66-92dc88e27cb1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527117,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec520e4e-0a20-53df-aa66-92dc88e27cb1/ec520e4e-0a20-53df-aa66-92dc88e27cb1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527117,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec520e4e-0a20-53df-aa66-92dc88e27cb1/ec520e4e-0a20-53df-aa66-92dc88e27cb1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410414,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec520e4e-0a20-53df-aa66-92dc88e27cb1/ec520e4e-0a20-53df-aa66-92dc88e27cb1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323444,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec520e4e-0a20-53df-aa66-92dc88e27cb1/ec520e4e-0a20-53df-aa66-92dc88e27cb1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316143,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec520e4e-0a20-53df-aa66-92dc88e27cb1/ec520e4e-0a20-53df-aa66-92dc88e27cb1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296823,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec520e4e-0a20-53df-aa66-92dc88e27cb1/ec520e4e-0a20-53df-aa66-92dc88e27cb1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257385,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec520e4e-0a20-53df-aa66-92dc88e27cb1/ec520e4e-0a20-53df-aa66-92dc88e27cb1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 396655,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/a41a100170d3412498089176ca390ae5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-10',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.2 PureTech 100ch S&S Active Business',
'transmission': 'manual',
'trim': '208 1.2 PureTech 100ch S&S Active Business',
'vin': None,
'year': 2021}
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988523%27 HTTP/1.1" 200 None
2026-03-27 16:52:59 [ayvens.fr] INFO: Saving data for 1988523: {'created_time': 1774630379.642472, 'last_price_update_time': 1774630379.642482, 'auction_closing_time': 1774969200.0}
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988523') HTTP/1.1" 204 0
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9567336e1fc847c38b7a65b387916f4b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/7.jpg not downloaded yet
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9567336e1fc847c38b7a65b387916f4b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/8.jpg not downloaded yet
2026-03-27 16:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f10790>
2026-03-27 16:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f8313b-cedb-5908-a93f-7ffde4d390db/f5f8313b-cedb-5908-a93f-7ffde4d390db_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgv-%252F77374aa091b94b9ab82c54ab673fd84b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/8.jpg saved to cache
2026-03-27 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5f8313b-cedb-5908-a93f-7ffde4d390db
2026-03-27 16:52:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5f8313b-cedb-5908-a93f-7ffde4d390db, skipping ID generation
2026-03-27 16:52:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5f8313b-cedb-5908-a93f-7ffde4d390db with scrape type 1
2026-03-27 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5f8313b-cedb-5908-a93f-7ffde4d390db sending to next pipeline
2026-03-27 16:52:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f5f8313b-cedb-5908-a93f-7ffde4d390db, identifier: 1988524
2026-03-27 16:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:52:59 [ayvens.fr] INFO: Found listing with ID: 1988526
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988526%27 HTTP/1.1" 200 None
2026-03-27 16:52:59 [ayvens.fr] INFO: Scrape type for 1988526: 1
2026-03-27 16:52:59 [ayvens.fr] INFO: Extracting data for car ID: 1988526
2026-03-27 16:52:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f84de44-b63a-55c7-9897-c9115c6dd915 with identifier: 1988526
2026-03-27 16:52:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f84de44-b63a-55c7-9897-c9115c6dd915 with scrape type 1
2026-03-27 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4f84de44-b63a-55c7-9897-c9115c6dd915
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fb123ca74dff240408362a9318bd2eb52%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/1.jpg not downloaded yet
2026-03-27 16:52:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f5f8313b-cedb-5908-a93f-7ffde4d390db with identifier: 1988524
2026-03-27 16:52:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f5f8313b-cedb-5908-a93f-7ffde4d390db with identifier: 1988524
2026-03-27 16:52:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f5f8313b-cedb-5908-a93f-7ffde4d390db with identifier: 1988524 to the API
2026-03-27 16:52:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:53:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'f5f8313b-cedb-5908-a93f-7ffde4d390db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'HONDA',
'model': 'ZR-V',
'odometer': 82845,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f8313b-cedb-5908-a93f-7ffde4d390db/f5f8313b-cedb-5908-a93f-7ffde4d390db_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286521,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f8313b-cedb-5908-a93f-7ffde4d390db/f5f8313b-cedb-5908-a93f-7ffde4d390db_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286521,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f8313b-cedb-5908-a93f-7ffde4d390db/f5f8313b-cedb-5908-a93f-7ffde4d390db_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330926,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f8313b-cedb-5908-a93f-7ffde4d390db/f5f8313b-cedb-5908-a93f-7ffde4d390db_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314186,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f8313b-cedb-5908-a93f-7ffde4d390db/f5f8313b-cedb-5908-a93f-7ffde4d390db_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354531,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f8313b-cedb-5908-a93f-7ffde4d390db/f5f8313b-cedb-5908-a93f-7ffde4d390db_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285402,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f8313b-cedb-5908-a93f-7ffde4d390db/f5f8313b-cedb-5908-a93f-7ffde4d390db_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276218,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f8313b-cedb-5908-a93f-7ffde4d390db/f5f8313b-cedb-5908-a93f-7ffde4d390db_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328717,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gv-/77374aa091b94b9ab82c54ab673fd84b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-19',
'seats_number': 5,
'seller_name': None,
'title': 'HONDA ZR-V ZR-V 2.0 i-MMD 184ch e:HEV Advance MY24',
'transmission': 'automatic',
'trim': 'ZR-V 2.0 i-MMD 184ch e:HEV Advance MY24',
'vin': None,
'year': 2024}
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988524%27 HTTP/1.1" 200 None
2026-03-27 16:53:00 [ayvens.fr] INFO: Saving data for 1988524: {'created_time': 1774630380.645296, 'last_price_update_time': 1774630380.64531, 'auction_closing_time': 1774969200.0}
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988524') HTTP/1.1" 204 0
2026-03-27 16:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fb123ca74dff240408362a9318bd2eb52%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/2.jpg not downloaded yet
2026-03-27 16:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59051a050>
2026-03-27 16:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92497cc4-9c86-518d-8948-4762cf9d3aef/92497cc4-9c86-518d-8948-4762cf9d3aef_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9567336e1fc847c38b7a65b387916f4b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/2.jpg saved to cache
2026-03-27 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92497cc4-9c86-518d-8948-4762cf9d3aef
2026-03-27 16:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d58b50>
2026-03-27 16:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92497cc4-9c86-518d-8948-4762cf9d3aef/92497cc4-9c86-518d-8948-4762cf9d3aef_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9567336e1fc847c38b7a65b387916f4b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/1.jpg saved to cache
2026-03-27 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92497cc4-9c86-518d-8948-4762cf9d3aef
2026-03-27 16:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5914831d0>
2026-03-27 16:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92497cc4-9c86-518d-8948-4762cf9d3aef/92497cc4-9c86-518d-8948-4762cf9d3aef_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9567336e1fc847c38b7a65b387916f4b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/4.jpg saved to cache
2026-03-27 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92497cc4-9c86-518d-8948-4762cf9d3aef
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fb123ca74dff240408362a9318bd2eb52%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/3.jpg not downloaded yet
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fb123ca74dff240408362a9318bd2eb52%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/4.jpg not downloaded yet
2026-03-27 16:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590fe1650>
2026-03-27 16:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92497cc4-9c86-518d-8948-4762cf9d3aef/92497cc4-9c86-518d-8948-4762cf9d3aef_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9567336e1fc847c38b7a65b387916f4b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/3.jpg saved to cache
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92497cc4-9c86-518d-8948-4762cf9d3aef
2026-03-27 16:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fb123ca74dff240408362a9318bd2eb52%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/5.jpg not downloaded yet
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fb123ca74dff240408362a9318bd2eb52%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/6.jpg not downloaded yet
2026-03-27 16:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fb123ca74dff240408362a9318bd2eb52%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/7.jpg not downloaded yet
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fb123ca74dff240408362a9318bd2eb52%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/8.jpg not downloaded yet
2026-03-27 16:53:01 [ayvens.fr] INFO: Found listing with ID: 1988527
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988527%27 HTTP/1.1" 200 None
2026-03-27 16:53:01 [ayvens.fr] INFO: Scrape type for 1988527: 1
2026-03-27 16:53:01 [ayvens.fr] INFO: Extracting data for car ID: 1988527
2026-03-27 16:53:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 551a646b-9bef-58ca-8178-dc859e987db9 with identifier: 1988527
2026-03-27 16:53:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 551a646b-9bef-58ca-8178-dc859e987db9 with scrape type 1
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 551a646b-9bef-58ca-8178-dc859e987db9
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1e5a100d7f0844ada153d46f894d7cd8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/1.jpg not downloaded yet
2026-03-27 16:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1e5a100d7f0844ada153d46f894d7cd8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/2.jpg not downloaded yet
2026-03-27 16:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590512990>
2026-03-27 16:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92497cc4-9c86-518d-8948-4762cf9d3aef/92497cc4-9c86-518d-8948-4762cf9d3aef_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9567336e1fc847c38b7a65b387916f4b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/5.jpg saved to cache
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92497cc4-9c86-518d-8948-4762cf9d3aef
2026-03-27 16:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b6b890>
2026-03-27 16:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92497cc4-9c86-518d-8948-4762cf9d3aef/92497cc4-9c86-518d-8948-4762cf9d3aef_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9567336e1fc847c38b7a65b387916f4b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/6.jpg saved to cache
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 92497cc4-9c86-518d-8948-4762cf9d3aef
2026-03-27 16:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591116c50>
2026-03-27 16:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92497cc4-9c86-518d-8948-4762cf9d3aef/92497cc4-9c86-518d-8948-4762cf9d3aef_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9567336e1fc847c38b7a65b387916f4b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/7.jpg saved to cache
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 92497cc4-9c86-518d-8948-4762cf9d3aef
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1e5a100d7f0844ada153d46f894d7cd8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/3.jpg not downloaded yet
2026-03-27 16:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b58dd0>
2026-03-27 16:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92497cc4-9c86-518d-8948-4762cf9d3aef/92497cc4-9c86-518d-8948-4762cf9d3aef_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F9567336e1fc847c38b7a65b387916f4b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/8.jpg saved to cache
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 92497cc4-9c86-518d-8948-4762cf9d3aef
2026-03-27 16:53:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92497cc4-9c86-518d-8948-4762cf9d3aef, skipping ID generation
2026-03-27 16:53:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92497cc4-9c86-518d-8948-4762cf9d3aef with scrape type 1
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92497cc4-9c86-518d-8948-4762cf9d3aef sending to next pipeline
2026-03-27 16:53:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 92497cc4-9c86-518d-8948-4762cf9d3aef, identifier: 1988525
2026-03-27 16:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592873110>
2026-03-27 16:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f84de44-b63a-55c7-9897-c9115c6dd915/4f84de44-b63a-55c7-9897-c9115c6dd915_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fb123ca74dff240408362a9318bd2eb52%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/2.jpg saved to cache
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f84de44-b63a-55c7-9897-c9115c6dd915
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1e5a100d7f0844ada153d46f894d7cd8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/4.jpg not downloaded yet
2026-03-27 16:53:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 92497cc4-9c86-518d-8948-4762cf9d3aef with identifier: 1988525
2026-03-27 16:53:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 92497cc4-9c86-518d-8948-4762cf9d3aef with identifier: 1988525
2026-03-27 16:53:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 92497cc4-9c86-518d-8948-4762cf9d3aef with identifier: 1988525 to the API
2026-03-27 16:53:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:53:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'BLANC NACR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '92497cc4-9c86-518d-8948-4762cf9d3aef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 107253,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92497cc4-9c86-518d-8948-4762cf9d3aef/92497cc4-9c86-518d-8948-4762cf9d3aef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423547,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92497cc4-9c86-518d-8948-4762cf9d3aef/92497cc4-9c86-518d-8948-4762cf9d3aef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423547,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92497cc4-9c86-518d-8948-4762cf9d3aef/92497cc4-9c86-518d-8948-4762cf9d3aef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369161,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92497cc4-9c86-518d-8948-4762cf9d3aef/92497cc4-9c86-518d-8948-4762cf9d3aef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295976,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92497cc4-9c86-518d-8948-4762cf9d3aef/92497cc4-9c86-518d-8948-4762cf9d3aef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364447,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92497cc4-9c86-518d-8948-4762cf9d3aef/92497cc4-9c86-518d-8948-4762cf9d3aef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328174,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92497cc4-9c86-518d-8948-4762cf9d3aef/92497cc4-9c86-518d-8948-4762cf9d3aef_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329440,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92497cc4-9c86-518d-8948-4762cf9d3aef/92497cc4-9c86-518d-8948-4762cf9d3aef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394245,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/9567336e1fc847c38b7a65b387916f4b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-10',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 100ch S&S Active Pack',
'transmission': 'manual',
'trim': '2008 1.2 PureTech 100ch S&S Active Pack',
'vin': None,
'year': 2022}
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988525%27 HTTP/1.1" 200 None
2026-03-27 16:53:02 [ayvens.fr] INFO: Saving data for 1988525: {'created_time': 1774630382.163601, 'last_price_update_time': 1774630382.163611, 'auction_closing_time': 1774969200.0}
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988525') HTTP/1.1" 204 0
2026-03-27 16:53:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1e5a100d7f0844ada153d46f894d7cd8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/5.jpg not downloaded yet
2026-03-27 16:53:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1e5a100d7f0844ada153d46f894d7cd8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/6.jpg not downloaded yet
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1e5a100d7f0844ada153d46f894d7cd8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/7.jpg not downloaded yet
2026-03-27 16:53:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1e5a100d7f0844ada153d46f894d7cd8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/8.jpg not downloaded yet
2026-03-27 16:53:02 [ayvens.fr] INFO: Found listing with ID: 1988528
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988528%27 HTTP/1.1" 200 None
2026-03-27 16:53:02 [ayvens.fr] INFO: Scrape type for 1988528: 1
2026-03-27 16:53:02 [ayvens.fr] INFO: Extracting data for car ID: 1988528
2026-03-27 16:53:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40424edb-6b45-5f22-a039-f24afb8db450 with identifier: 1988528
2026-03-27 16:53:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40424edb-6b45-5f22-a039-f24afb8db450 with scrape type 1
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 40424edb-6b45-5f22-a039-f24afb8db450
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Facd1084c234a4974baac32fce07f9202%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/1.jpg not downloaded yet
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Facd1084c234a4974baac32fce07f9202%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/2.jpg not downloaded yet
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfc410>
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f84de44-b63a-55c7-9897-c9115c6dd915/4f84de44-b63a-55c7-9897-c9115c6dd915_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fb123ca74dff240408362a9318bd2eb52%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/1.jpg saved to cache
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f84de44-b63a-55c7-9897-c9115c6dd915
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b69350>
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f84de44-b63a-55c7-9897-c9115c6dd915/4f84de44-b63a-55c7-9897-c9115c6dd915_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fb123ca74dff240408362a9318bd2eb52%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/7.jpg saved to cache
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f84de44-b63a-55c7-9897-c9115c6dd915
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d82390>
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f84de44-b63a-55c7-9897-c9115c6dd915/4f84de44-b63a-55c7-9897-c9115c6dd915_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fb123ca74dff240408362a9318bd2eb52%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/8.jpg saved to cache
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f84de44-b63a-55c7-9897-c9115c6dd915
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd3910>
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f84de44-b63a-55c7-9897-c9115c6dd915/4f84de44-b63a-55c7-9897-c9115c6dd915_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fb123ca74dff240408362a9318bd2eb52%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/4.jpg saved to cache
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f84de44-b63a-55c7-9897-c9115c6dd915
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590620610>
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f84de44-b63a-55c7-9897-c9115c6dd915/4f84de44-b63a-55c7-9897-c9115c6dd915_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fb123ca74dff240408362a9318bd2eb52%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/3.jpg saved to cache
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f84de44-b63a-55c7-9897-c9115c6dd915
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd0710>
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f84de44-b63a-55c7-9897-c9115c6dd915/4f84de44-b63a-55c7-9897-c9115c6dd915_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fb123ca74dff240408362a9318bd2eb52%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/6.jpg saved to cache
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f84de44-b63a-55c7-9897-c9115c6dd915
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d83c10>
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f84de44-b63a-55c7-9897-c9115c6dd915/4f84de44-b63a-55c7-9897-c9115c6dd915_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgw-%252Fb123ca74dff240408362a9318bd2eb52%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/5.jpg saved to cache
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f84de44-b63a-55c7-9897-c9115c6dd915
2026-03-27 16:53:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f84de44-b63a-55c7-9897-c9115c6dd915, skipping ID generation
2026-03-27 16:53:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f84de44-b63a-55c7-9897-c9115c6dd915 with scrape type 1
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f84de44-b63a-55c7-9897-c9115c6dd915 sending to next pipeline
2026-03-27 16:53:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4f84de44-b63a-55c7-9897-c9115c6dd915, identifier: 1988526
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Facd1084c234a4974baac32fce07f9202%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/3.jpg not downloaded yet
2026-03-27 16:53:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4f84de44-b63a-55c7-9897-c9115c6dd915 with identifier: 1988526
2026-03-27 16:53:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:53:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4f84de44-b63a-55c7-9897-c9115c6dd915 with identifier: 1988526
2026-03-27 16:53:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 4f84de44-b63a-55c7-9897-c9115c6dd915 with identifier: 1988526 to the API
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:53:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 141,
'color': 'PHYTONIC BLAU',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '4f84de44-b63a-55c7-9897-c9115c6dd915',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 2 ACTIVE TOURE',
'odometer': 38425,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f84de44-b63a-55c7-9897-c9115c6dd915/4f84de44-b63a-55c7-9897-c9115c6dd915_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353566,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f84de44-b63a-55c7-9897-c9115c6dd915/4f84de44-b63a-55c7-9897-c9115c6dd915_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353566,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f84de44-b63a-55c7-9897-c9115c6dd915/4f84de44-b63a-55c7-9897-c9115c6dd915_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337078,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f84de44-b63a-55c7-9897-c9115c6dd915/4f84de44-b63a-55c7-9897-c9115c6dd915_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349079,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f84de44-b63a-55c7-9897-c9115c6dd915/4f84de44-b63a-55c7-9897-c9115c6dd915_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329584,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f84de44-b63a-55c7-9897-c9115c6dd915/4f84de44-b63a-55c7-9897-c9115c6dd915_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333229,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f84de44-b63a-55c7-9897-c9115c6dd915/4f84de44-b63a-55c7-9897-c9115c6dd915_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312784,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f84de44-b63a-55c7-9897-c9115c6dd915/4f84de44-b63a-55c7-9897-c9115c6dd915_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233419,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gw-/b123ca74dff240408362a9318bd2eb52/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-29',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 2 ACTIVE TOURE Serie 2 ActiveTourer 218i 136ch Business '
'Design DKG7',
'transmission': 'automatic',
'trim': 'Serie 2 ActiveTourer 218i 136ch Business Design DKG7',
'vin': None,
'year': 2024}
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988526%27 HTTP/1.1" 200 None
2026-03-27 16:53:03 [ayvens.fr] INFO: Saving data for 1988526: {'created_time': 1774630383.276635, 'last_price_update_time': 1774630383.276647, 'auction_closing_time': 1774969200.0}
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988526') HTTP/1.1" 204 0
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Facd1084c234a4974baac32fce07f9202%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/4.jpg not downloaded yet
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d80290>
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_551a646b-9bef-58ca-8178-dc859e987db9/551a646b-9bef-58ca-8178-dc859e987db9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1e5a100d7f0844ada153d46f894d7cd8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/1.jpg saved to cache
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 551a646b-9bef-58ca-8178-dc859e987db9
2026-03-27 16:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Facd1084c234a4974baac32fce07f9202%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/5.jpg not downloaded yet
2026-03-27 16:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Facd1084c234a4974baac32fce07f9202%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/6.jpg not downloaded yet
2026-03-27 16:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Facd1084c234a4974baac32fce07f9202%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/7.jpg not downloaded yet
2026-03-27 16:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Facd1084c234a4974baac32fce07f9202%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/8.jpg not downloaded yet
2026-03-27 16:53:03 [ayvens.fr] INFO: Found listing with ID: 1988529
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988529%27 HTTP/1.1" 200 None
2026-03-27 16:53:03 [ayvens.fr] INFO: Scrape type for 1988529: 1
2026-03-27 16:53:03 [ayvens.fr] INFO: Extracting data for car ID: 1988529
2026-03-27 16:53:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5350ad2-402a-5e4a-98c4-95c4562a54f2 with identifier: 1988529
2026-03-27 16:53:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5350ad2-402a-5e4a-98c4-95c4562a54f2 with scrape type 1
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b5350ad2-402a-5e4a-98c4-95c4562a54f2
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F22ffe88a990a453d9ccd76961f38c5fb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/1.jpg not downloaded yet
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F22ffe88a990a453d9ccd76961f38c5fb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/2.jpg not downloaded yet
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065dad0>
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_551a646b-9bef-58ca-8178-dc859e987db9/551a646b-9bef-58ca-8178-dc859e987db9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1e5a100d7f0844ada153d46f894d7cd8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/7.jpg saved to cache
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 551a646b-9bef-58ca-8178-dc859e987db9
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590e0dfd0>
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_551a646b-9bef-58ca-8178-dc859e987db9/551a646b-9bef-58ca-8178-dc859e987db9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1e5a100d7f0844ada153d46f894d7cd8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/4.jpg saved to cache
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 551a646b-9bef-58ca-8178-dc859e987db9
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9e810>
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_551a646b-9bef-58ca-8178-dc859e987db9/551a646b-9bef-58ca-8178-dc859e987db9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1e5a100d7f0844ada153d46f894d7cd8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/6.jpg saved to cache
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 551a646b-9bef-58ca-8178-dc859e987db9
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d60290>
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_551a646b-9bef-58ca-8178-dc859e987db9/551a646b-9bef-58ca-8178-dc859e987db9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1e5a100d7f0844ada153d46f894d7cd8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/2.jpg saved to cache
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 551a646b-9bef-58ca-8178-dc859e987db9
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910c47d0>
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_551a646b-9bef-58ca-8178-dc859e987db9/551a646b-9bef-58ca-8178-dc859e987db9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1e5a100d7f0844ada153d46f894d7cd8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/5.jpg saved to cache
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 551a646b-9bef-58ca-8178-dc859e987db9
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F22ffe88a990a453d9ccd76961f38c5fb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/3.jpg not downloaded yet
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F22ffe88a990a453d9ccd76961f38c5fb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/4.jpg not downloaded yet
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066fa50>
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_551a646b-9bef-58ca-8178-dc859e987db9/551a646b-9bef-58ca-8178-dc859e987db9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1e5a100d7f0844ada153d46f894d7cd8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/3.jpg saved to cache
2026-03-27 16:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 551a646b-9bef-58ca-8178-dc859e987db9
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f31e90>
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_551a646b-9bef-58ca-8178-dc859e987db9/551a646b-9bef-58ca-8178-dc859e987db9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F1e5a100d7f0844ada153d46f894d7cd8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/8.jpg saved to cache
2026-03-27 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 551a646b-9bef-58ca-8178-dc859e987db9
2026-03-27 16:53:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 551a646b-9bef-58ca-8178-dc859e987db9, skipping ID generation
2026-03-27 16:53:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 551a646b-9bef-58ca-8178-dc859e987db9 with scrape type 1
2026-03-27 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 551a646b-9bef-58ca-8178-dc859e987db9 sending to next pipeline
2026-03-27 16:53:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 551a646b-9bef-58ca-8178-dc859e987db9, identifier: 1988527
2026-03-27 16:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590afc590>
2026-03-27 16:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40424edb-6b45-5f22-a039-f24afb8db450/40424edb-6b45-5f22-a039-f24afb8db450_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Facd1084c234a4974baac32fce07f9202%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/1.jpg saved to cache
2026-03-27 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40424edb-6b45-5f22-a039-f24afb8db450
2026-03-27 16:53:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 551a646b-9bef-58ca-8178-dc859e987db9 with identifier: 1988527
2026-03-27 16:53:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 551a646b-9bef-58ca-8178-dc859e987db9 with identifier: 1988527
2026-03-27 16:53:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 551a646b-9bef-58ca-8178-dc859e987db9 with identifier: 1988527 to the API
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:53:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '551a646b-9bef-58ca-8178-dc859e987db9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 79415,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_551a646b-9bef-58ca-8178-dc859e987db9/551a646b-9bef-58ca-8178-dc859e987db9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496299,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_551a646b-9bef-58ca-8178-dc859e987db9/551a646b-9bef-58ca-8178-dc859e987db9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496299,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_551a646b-9bef-58ca-8178-dc859e987db9/551a646b-9bef-58ca-8178-dc859e987db9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 500610,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_551a646b-9bef-58ca-8178-dc859e987db9/551a646b-9bef-58ca-8178-dc859e987db9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_551a646b-9bef-58ca-8178-dc859e987db9/551a646b-9bef-58ca-8178-dc859e987db9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363635,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_551a646b-9bef-58ca-8178-dc859e987db9/551a646b-9bef-58ca-8178-dc859e987db9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305302,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_551a646b-9bef-58ca-8178-dc859e987db9/551a646b-9bef-58ca-8178-dc859e987db9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 235695,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_551a646b-9bef-58ca-8178-dc859e987db9/551a646b-9bef-58ca-8178-dc859e987db9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417067,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/1e5a100d7f0844ada153d46f894d7cd8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-03',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.2 PureTech 100ch S&S Active Business',
'transmission': 'manual',
'trim': '208 1.2 PureTech 100ch S&S Active Business',
'vin': None,
'year': 2021}
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988527%27 HTTP/1.1" 200 None
2026-03-27 16:53:04 [ayvens.fr] INFO: Saving data for 1988527: {'created_time': 1774630384.584257, 'last_price_update_time': 1774630384.58427, 'auction_closing_time': 1774969200.0}
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988527') HTTP/1.1" 204 0
2026-03-27 16:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F22ffe88a990a453d9ccd76961f38c5fb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/5.jpg not downloaded yet
2026-03-27 16:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F22ffe88a990a453d9ccd76961f38c5fb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/6.jpg not downloaded yet
2026-03-27 16:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F22ffe88a990a453d9ccd76961f38c5fb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/7.jpg not downloaded yet
2026-03-27 16:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F22ffe88a990a453d9ccd76961f38c5fb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/8.jpg not downloaded yet
2026-03-27 16:53:04 [ayvens.fr] INFO: Found listing with ID: 1988530
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988530%27 HTTP/1.1" 200 None
2026-03-27 16:53:04 [ayvens.fr] INFO: Scrape type for 1988530: 1
2026-03-27 16:53:04 [ayvens.fr] INFO: Extracting data for car ID: 1988530
2026-03-27 16:53:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b9be777-f4fa-5d5e-8e66-f00f2739f4e3 with identifier: 1988530
2026-03-27 16:53:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b9be777-f4fa-5d5e-8e66-f00f2739f4e3 with scrape type 1
2026-03-27 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7b9be777-f4fa-5d5e-8e66-f00f2739f4e3
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F45ce7bcbb43e4e0faa80c8eaebed332a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/1.jpg not downloaded yet
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F45ce7bcbb43e4e0faa80c8eaebed332a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/2.jpg not downloaded yet
2026-03-27 16:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d60050>
2026-03-27 16:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40424edb-6b45-5f22-a039-f24afb8db450/40424edb-6b45-5f22-a039-f24afb8db450_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Facd1084c234a4974baac32fce07f9202%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/2.jpg saved to cache
2026-03-27 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40424edb-6b45-5f22-a039-f24afb8db450
2026-03-27 16:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590afc090>
2026-03-27 16:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40424edb-6b45-5f22-a039-f24afb8db450/40424edb-6b45-5f22-a039-f24afb8db450_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Facd1084c234a4974baac32fce07f9202%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/6.jpg saved to cache
2026-03-27 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40424edb-6b45-5f22-a039-f24afb8db450
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F45ce7bcbb43e4e0faa80c8eaebed332a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/3.jpg not downloaded yet
2026-03-27 16:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3c3d0>
2026-03-27 16:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40424edb-6b45-5f22-a039-f24afb8db450/40424edb-6b45-5f22-a039-f24afb8db450_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Facd1084c234a4974baac32fce07f9202%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/5.jpg saved to cache
2026-03-27 16:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40424edb-6b45-5f22-a039-f24afb8db450
2026-03-27 16:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2ff50>
2026-03-27 16:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40424edb-6b45-5f22-a039-f24afb8db450/40424edb-6b45-5f22-a039-f24afb8db450_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Facd1084c234a4974baac32fce07f9202%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/4.jpg saved to cache
2026-03-27 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40424edb-6b45-5f22-a039-f24afb8db450
2026-03-27 16:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911a5150>
2026-03-27 16:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40424edb-6b45-5f22-a039-f24afb8db450/40424edb-6b45-5f22-a039-f24afb8db450_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Facd1084c234a4974baac32fce07f9202%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/7.jpg saved to cache
2026-03-27 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40424edb-6b45-5f22-a039-f24afb8db450
2026-03-27 16:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b59510>
2026-03-27 16:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40424edb-6b45-5f22-a039-f24afb8db450/40424edb-6b45-5f22-a039-f24afb8db450_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Facd1084c234a4974baac32fce07f9202%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/8.jpg saved to cache
2026-03-27 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40424edb-6b45-5f22-a039-f24afb8db450
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F45ce7bcbb43e4e0faa80c8eaebed332a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/4.jpg not downloaded yet
2026-03-27 16:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F45ce7bcbb43e4e0faa80c8eaebed332a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/5.jpg not downloaded yet
2026-03-27 16:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590655610>
2026-03-27 16:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40424edb-6b45-5f22-a039-f24afb8db450/40424edb-6b45-5f22-a039-f24afb8db450_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Facd1084c234a4974baac32fce07f9202%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/3.jpg saved to cache
2026-03-27 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40424edb-6b45-5f22-a039-f24afb8db450
2026-03-27 16:53:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40424edb-6b45-5f22-a039-f24afb8db450, skipping ID generation
2026-03-27 16:53:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40424edb-6b45-5f22-a039-f24afb8db450 with scrape type 1
2026-03-27 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40424edb-6b45-5f22-a039-f24afb8db450 sending to next pipeline
2026-03-27 16:53:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 40424edb-6b45-5f22-a039-f24afb8db450, identifier: 1988528
2026-03-27 16:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dff290>
2026-03-27 16:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5350ad2-402a-5e4a-98c4-95c4562a54f2/b5350ad2-402a-5e4a-98c4-95c4562a54f2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F22ffe88a990a453d9ccd76961f38c5fb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/1.jpg saved to cache
2026-03-27 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5350ad2-402a-5e4a-98c4-95c4562a54f2
2026-03-27 16:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 40424edb-6b45-5f22-a039-f24afb8db450 with identifier: 1988528
2026-03-27 16:53:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 40424edb-6b45-5f22-a039-f24afb8db450 with identifier: 1988528
2026-03-27 16:53:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 40424edb-6b45-5f22-a039-f24afb8db450 with identifier: 1988528 to the API
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:53:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 148,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '40424edb-6b45-5f22-a039-f24afb8db450',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'PROACE CITY VERSO',
'odometer': 24868,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40424edb-6b45-5f22-a039-f24afb8db450/40424edb-6b45-5f22-a039-f24afb8db450_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408713,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40424edb-6b45-5f22-a039-f24afb8db450/40424edb-6b45-5f22-a039-f24afb8db450_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408713,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40424edb-6b45-5f22-a039-f24afb8db450/40424edb-6b45-5f22-a039-f24afb8db450_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431990,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40424edb-6b45-5f22-a039-f24afb8db450/40424edb-6b45-5f22-a039-f24afb8db450_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414917,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40424edb-6b45-5f22-a039-f24afb8db450/40424edb-6b45-5f22-a039-f24afb8db450_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305772,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40424edb-6b45-5f22-a039-f24afb8db450/40424edb-6b45-5f22-a039-f24afb8db450_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347418,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40424edb-6b45-5f22-a039-f24afb8db450/40424edb-6b45-5f22-a039-f24afb8db450_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352963,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40424edb-6b45-5f22-a039-f24afb8db450/40424edb-6b45-5f22-a039-f24afb8db450_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356261,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/acd1084c234a4974baac32fce07f9202/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-11',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA PROACE CITY VERSO PROACE CITY Verso Medium 1.2 110 VVT-i '
'Executive',
'transmission': 'manual',
'trim': 'PROACE CITY Verso Medium 1.2 110 VVT-i Executive',
'vin': None,
'year': 2022}
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988528%27 HTTP/1.1" 200 None
2026-03-27 16:53:05 [ayvens.fr] INFO: Saving data for 1988528: {'created_time': 1774630385.90977, 'last_price_update_time': 1774630385.909782, 'auction_closing_time': 1774969200.0}
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988528') HTTP/1.1" 204 0
2026-03-27 16:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F45ce7bcbb43e4e0faa80c8eaebed332a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/6.jpg not downloaded yet
2026-03-27 16:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F45ce7bcbb43e4e0faa80c8eaebed332a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/7.jpg not downloaded yet
2026-03-27 16:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590eda810>
2026-03-27 16:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5350ad2-402a-5e4a-98c4-95c4562a54f2/b5350ad2-402a-5e4a-98c4-95c4562a54f2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F22ffe88a990a453d9ccd76961f38c5fb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/4.jpg saved to cache
2026-03-27 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b5350ad2-402a-5e4a-98c4-95c4562a54f2
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b5b8d0>
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5350ad2-402a-5e4a-98c4-95c4562a54f2/b5350ad2-402a-5e4a-98c4-95c4562a54f2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F22ffe88a990a453d9ccd76961f38c5fb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/3.jpg saved to cache
2026-03-27 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b5350ad2-402a-5e4a-98c4-95c4562a54f2
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4d890>
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5350ad2-402a-5e4a-98c4-95c4562a54f2/b5350ad2-402a-5e4a-98c4-95c4562a54f2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F22ffe88a990a453d9ccd76961f38c5fb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/2.jpg saved to cache
2026-03-27 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b5350ad2-402a-5e4a-98c4-95c4562a54f2
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d46810>
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5350ad2-402a-5e4a-98c4-95c4562a54f2/b5350ad2-402a-5e4a-98c4-95c4562a54f2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F22ffe88a990a453d9ccd76961f38c5fb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/6.jpg saved to cache
2026-03-27 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5350ad2-402a-5e4a-98c4-95c4562a54f2
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066d9d0>
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5350ad2-402a-5e4a-98c4-95c4562a54f2/b5350ad2-402a-5e4a-98c4-95c4562a54f2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F22ffe88a990a453d9ccd76961f38c5fb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/7.jpg saved to cache
2026-03-27 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b5350ad2-402a-5e4a-98c4-95c4562a54f2
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F45ce7bcbb43e4e0faa80c8eaebed332a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/8.jpg not downloaded yet
2026-03-27 16:53:06 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 3 pages/min), scraped 331 items (at 43 items/min)
2026-03-27 16:53:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-27 16:53:06 [ayvens.fr] INFO: Found listing with ID: 1988531
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988531%27 HTTP/1.1" 200 None
2026-03-27 16:53:06 [ayvens.fr] INFO: Scrape type for 1988531: 1
2026-03-27 16:53:06 [ayvens.fr] INFO: Extracting data for car ID: 1988531
2026-03-27 16:53:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d07e8213-fbe9-5ceb-a692-822f42953dec with identifier: 1988531
2026-03-27 16:53:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d07e8213-fbe9-5ceb-a692-822f42953dec with scrape type 1
2026-03-27 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d07e8213-fbe9-5ceb-a692-822f42953dec
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F528a52fbadf9416ba01f55234a76a0b5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/1.jpg not downloaded yet
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59063d810>
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5350ad2-402a-5e4a-98c4-95c4562a54f2/b5350ad2-402a-5e4a-98c4-95c4562a54f2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F22ffe88a990a453d9ccd76961f38c5fb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/5.jpg saved to cache
2026-03-27 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b5350ad2-402a-5e4a-98c4-95c4562a54f2
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b2c10>
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5350ad2-402a-5e4a-98c4-95c4562a54f2/b5350ad2-402a-5e4a-98c4-95c4562a54f2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252F22ffe88a990a453d9ccd76961f38c5fb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/8.jpg saved to cache
2026-03-27 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b5350ad2-402a-5e4a-98c4-95c4562a54f2
2026-03-27 16:53:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5350ad2-402a-5e4a-98c4-95c4562a54f2, skipping ID generation
2026-03-27 16:53:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5350ad2-402a-5e4a-98c4-95c4562a54f2 with scrape type 1
2026-03-27 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5350ad2-402a-5e4a-98c4-95c4562a54f2 sending to next pipeline
2026-03-27 16:53:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b5350ad2-402a-5e4a-98c4-95c4562a54f2, identifier: 1988529
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911efad0>
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9be777-f4fa-5d5e-8e66-f00f2739f4e3/7b9be777-f4fa-5d5e-8e66-f00f2739f4e3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F45ce7bcbb43e4e0faa80c8eaebed332a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/1.jpg saved to cache
2026-03-27 16:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b9be777-f4fa-5d5e-8e66-f00f2739f4e3
2026-03-27 16:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b5350ad2-402a-5e4a-98c4-95c4562a54f2 with identifier: 1988529
2026-03-27 16:53:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b5350ad2-402a-5e4a-98c4-95c4562a54f2 with identifier: 1988529
2026-03-27 16:53:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b5350ad2-402a-5e4a-98c4-95c4562a54f2 with identifier: 1988529 to the API
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:53:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'e85',
'id': 'b5350ad2-402a-5e4a-98c4-95c4562a54f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FOCUS',
'odometer': 84159,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5350ad2-402a-5e4a-98c4-95c4562a54f2/b5350ad2-402a-5e4a-98c4-95c4562a54f2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382702,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5350ad2-402a-5e4a-98c4-95c4562a54f2/b5350ad2-402a-5e4a-98c4-95c4562a54f2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382702,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5350ad2-402a-5e4a-98c4-95c4562a54f2/b5350ad2-402a-5e4a-98c4-95c4562a54f2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361294,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5350ad2-402a-5e4a-98c4-95c4562a54f2/b5350ad2-402a-5e4a-98c4-95c4562a54f2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263932,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5350ad2-402a-5e4a-98c4-95c4562a54f2/b5350ad2-402a-5e4a-98c4-95c4562a54f2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327298,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5350ad2-402a-5e4a-98c4-95c4562a54f2/b5350ad2-402a-5e4a-98c4-95c4562a54f2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308814,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5350ad2-402a-5e4a-98c4-95c4562a54f2/b5350ad2-402a-5e4a-98c4-95c4562a54f2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318549,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5350ad2-402a-5e4a-98c4-95c4562a54f2/b5350ad2-402a-5e4a-98c4-95c4562a54f2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331052,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/22ffe88a990a453d9ccd76961f38c5fb/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-18',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FOCUS Focus 1.0 Flexifuel mHEV 125ch Titanium X Business',
'transmission': 'manual',
'trim': 'Focus 1.0 Flexifuel mHEV 125ch Titanium X Business',
'vin': None,
'year': 2022}
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988529%27 HTTP/1.1" 200 None
2026-03-27 16:53:07 [ayvens.fr] INFO: Saving data for 1988529: {'created_time': 1774630387.433031, 'last_price_update_time': 1774630387.433048, 'auction_closing_time': 1774969200.0}
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988529') HTTP/1.1" 204 0
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F528a52fbadf9416ba01f55234a76a0b5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/2.jpg not downloaded yet
2026-03-27 16:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F528a52fbadf9416ba01f55234a76a0b5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/3.jpg not downloaded yet
2026-03-27 16:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df7390>
2026-03-27 16:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9be777-f4fa-5d5e-8e66-f00f2739f4e3/7b9be777-f4fa-5d5e-8e66-f00f2739f4e3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F45ce7bcbb43e4e0faa80c8eaebed332a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/2.jpg saved to cache
2026-03-27 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b9be777-f4fa-5d5e-8e66-f00f2739f4e3
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F528a52fbadf9416ba01f55234a76a0b5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/4.jpg not downloaded yet
2026-03-27 16:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F528a52fbadf9416ba01f55234a76a0b5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/5.jpg not downloaded yet
2026-03-27 16:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df41d0>
2026-03-27 16:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9be777-f4fa-5d5e-8e66-f00f2739f4e3/7b9be777-f4fa-5d5e-8e66-f00f2739f4e3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F45ce7bcbb43e4e0faa80c8eaebed332a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/4.jpg saved to cache
2026-03-27 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b9be777-f4fa-5d5e-8e66-f00f2739f4e3
2026-03-27 16:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ac6a50>
2026-03-27 16:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9be777-f4fa-5d5e-8e66-f00f2739f4e3/7b9be777-f4fa-5d5e-8e66-f00f2739f4e3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F45ce7bcbb43e4e0faa80c8eaebed332a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/5.jpg saved to cache
2026-03-27 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b9be777-f4fa-5d5e-8e66-f00f2739f4e3
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F528a52fbadf9416ba01f55234a76a0b5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/6.jpg not downloaded yet
2026-03-27 16:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591432010>
2026-03-27 16:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9be777-f4fa-5d5e-8e66-f00f2739f4e3/7b9be777-f4fa-5d5e-8e66-f00f2739f4e3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F45ce7bcbb43e4e0faa80c8eaebed332a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/3.jpg saved to cache
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b9be777-f4fa-5d5e-8e66-f00f2739f4e3
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfc750>
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9be777-f4fa-5d5e-8e66-f00f2739f4e3/7b9be777-f4fa-5d5e-8e66-f00f2739f4e3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F45ce7bcbb43e4e0faa80c8eaebed332a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/7.jpg saved to cache
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7b9be777-f4fa-5d5e-8e66-f00f2739f4e3
2026-03-27 16:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F528a52fbadf9416ba01f55234a76a0b5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/7.jpg not downloaded yet
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59052a290>
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9be777-f4fa-5d5e-8e66-f00f2739f4e3/7b9be777-f4fa-5d5e-8e66-f00f2739f4e3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F45ce7bcbb43e4e0faa80c8eaebed332a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/6.jpg saved to cache
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b9be777-f4fa-5d5e-8e66-f00f2739f4e3
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F528a52fbadf9416ba01f55234a76a0b5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/8.jpg not downloaded yet
2026-03-27 16:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:08 [ayvens.fr] INFO: Found listing with ID: 1988532
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988532%27 HTTP/1.1" 200 None
2026-03-27 16:53:08 [ayvens.fr] INFO: Scrape type for 1988532: 1
2026-03-27 16:53:08 [ayvens.fr] INFO: Extracting data for car ID: 1988532
2026-03-27 16:53:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba19c2f6-5bd0-56df-a193-16f816fbfee7 with identifier: 1988532
2026-03-27 16:53:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba19c2f6-5bd0-56df-a193-16f816fbfee7 with scrape type 1
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ba19c2f6-5bd0-56df-a193-16f816fbfee7
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Feafad3aa3ced476089976350a9f71a2d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/1.jpg not downloaded yet
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ee3d10>
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9be777-f4fa-5d5e-8e66-f00f2739f4e3/7b9be777-f4fa-5d5e-8e66-f00f2739f4e3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F45ce7bcbb43e4e0faa80c8eaebed332a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/8.jpg saved to cache
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b9be777-f4fa-5d5e-8e66-f00f2739f4e3
2026-03-27 16:53:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b9be777-f4fa-5d5e-8e66-f00f2739f4e3, skipping ID generation
2026-03-27 16:53:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b9be777-f4fa-5d5e-8e66-f00f2739f4e3 with scrape type 1
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b9be777-f4fa-5d5e-8e66-f00f2739f4e3 sending to next pipeline
2026-03-27 16:53:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7b9be777-f4fa-5d5e-8e66-f00f2739f4e3, identifier: 1988530
2026-03-27 16:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Feafad3aa3ced476089976350a9f71a2d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/2.jpg not downloaded yet
2026-03-27 16:53:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7b9be777-f4fa-5d5e-8e66-f00f2739f4e3 with identifier: 1988530
2026-03-27 16:53:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7b9be777-f4fa-5d5e-8e66-f00f2739f4e3 with identifier: 1988530
2026-03-27 16:53:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7b9be777-f4fa-5d5e-8e66-f00f2739f4e3 with identifier: 1988530 to the API
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:53:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'BLEU C',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '7b9be777-f4fa-5d5e-8e66-f00f2739f4e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 122351,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9be777-f4fa-5d5e-8e66-f00f2739f4e3/7b9be777-f4fa-5d5e-8e66-f00f2739f4e3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433183,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9be777-f4fa-5d5e-8e66-f00f2739f4e3/7b9be777-f4fa-5d5e-8e66-f00f2739f4e3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433183,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9be777-f4fa-5d5e-8e66-f00f2739f4e3/7b9be777-f4fa-5d5e-8e66-f00f2739f4e3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412913,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9be777-f4fa-5d5e-8e66-f00f2739f4e3/7b9be777-f4fa-5d5e-8e66-f00f2739f4e3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376597,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9be777-f4fa-5d5e-8e66-f00f2739f4e3/7b9be777-f4fa-5d5e-8e66-f00f2739f4e3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9be777-f4fa-5d5e-8e66-f00f2739f4e3/7b9be777-f4fa-5d5e-8e66-f00f2739f4e3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368885,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9be777-f4fa-5d5e-8e66-f00f2739f4e3/7b9be777-f4fa-5d5e-8e66-f00f2739f4e3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240228,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9be777-f4fa-5d5e-8e66-f00f2739f4e3/7b9be777-f4fa-5d5e-8e66-f00f2739f4e3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256098,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/45ce7bcbb43e4e0faa80c8eaebed332a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-10',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Active Pack EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch S&S Active Pack EAT8',
'vin': None,
'year': 2023}
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988530%27 HTTP/1.1" 200 None
2026-03-27 16:53:08 [ayvens.fr] INFO: Saving data for 1988530: {'created_time': 1774630388.70859, 'last_price_update_time': 1774630388.708601, 'auction_closing_time': 1774969200.0}
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988530') HTTP/1.1" 204 0
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Feafad3aa3ced476089976350a9f71a2d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/3.jpg not downloaded yet
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903d14d0>
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07e8213-fbe9-5ceb-a692-822f42953dec/d07e8213-fbe9-5ceb-a692-822f42953dec_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F528a52fbadf9416ba01f55234a76a0b5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/1.jpg saved to cache
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d07e8213-fbe9-5ceb-a692-822f42953dec
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd9590>
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07e8213-fbe9-5ceb-a692-822f42953dec/d07e8213-fbe9-5ceb-a692-822f42953dec_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F528a52fbadf9416ba01f55234a76a0b5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/3.jpg saved to cache
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d07e8213-fbe9-5ceb-a692-822f42953dec
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904fe090>
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07e8213-fbe9-5ceb-a692-822f42953dec/d07e8213-fbe9-5ceb-a692-822f42953dec_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F528a52fbadf9416ba01f55234a76a0b5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/2.jpg saved to cache
2026-03-27 16:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d07e8213-fbe9-5ceb-a692-822f42953dec
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590ddb310>
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07e8213-fbe9-5ceb-a692-822f42953dec/d07e8213-fbe9-5ceb-a692-822f42953dec_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F528a52fbadf9416ba01f55234a76a0b5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/4.jpg saved to cache
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d07e8213-fbe9-5ceb-a692-822f42953dec
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Feafad3aa3ced476089976350a9f71a2d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/4.jpg not downloaded yet
2026-03-27 16:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Feafad3aa3ced476089976350a9f71a2d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/5.jpg not downloaded yet
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Feafad3aa3ced476089976350a9f71a2d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/6.jpg not downloaded yet
2026-03-27 16:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Feafad3aa3ced476089976350a9f71a2d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/7.jpg not downloaded yet
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Feafad3aa3ced476089976350a9f71a2d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/8.jpg not downloaded yet
2026-03-27 16:53:09 [ayvens.fr] INFO: Found listing with ID: 1988533
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988533%27 HTTP/1.1" 200 None
2026-03-27 16:53:09 [ayvens.fr] INFO: Scrape type for 1988533: 1
2026-03-27 16:53:09 [ayvens.fr] INFO: Extracting data for car ID: 1988533
2026-03-27 16:53:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 163bf354-9cf2-52a5-bbfe-90e025b8f235 with identifier: 1988533
2026-03-27 16:53:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 163bf354-9cf2-52a5-bbfe-90e025b8f235 with scrape type 1
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 163bf354-9cf2-52a5-bbfe-90e025b8f235
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fcdc470bf5b7342fea0074c47270f805c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/1.jpg not downloaded yet
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fcdc470bf5b7342fea0074c47270f805c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/2.jpg not downloaded yet
2026-03-27 16:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d2e6d0>
2026-03-27 16:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07e8213-fbe9-5ceb-a692-822f42953dec/d07e8213-fbe9-5ceb-a692-822f42953dec_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F528a52fbadf9416ba01f55234a76a0b5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/5.jpg saved to cache
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d07e8213-fbe9-5ceb-a692-822f42953dec
2026-03-27 16:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d42810>
2026-03-27 16:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07e8213-fbe9-5ceb-a692-822f42953dec/d07e8213-fbe9-5ceb-a692-822f42953dec_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F528a52fbadf9416ba01f55234a76a0b5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/6.jpg saved to cache
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d07e8213-fbe9-5ceb-a692-822f42953dec
2026-03-27 16:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f32610>
2026-03-27 16:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07e8213-fbe9-5ceb-a692-822f42953dec/d07e8213-fbe9-5ceb-a692-822f42953dec_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F528a52fbadf9416ba01f55234a76a0b5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/7.jpg saved to cache
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d07e8213-fbe9-5ceb-a692-822f42953dec
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fcdc470bf5b7342fea0074c47270f805c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/3.jpg not downloaded yet
2026-03-27 16:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fcdc470bf5b7342fea0074c47270f805c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/4.jpg not downloaded yet
2026-03-27 16:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fcdc470bf5b7342fea0074c47270f805c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/5.jpg not downloaded yet
2026-03-27 16:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d8f550>
2026-03-27 16:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba19c2f6-5bd0-56df-a193-16f816fbfee7/ba19c2f6-5bd0-56df-a193-16f816fbfee7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Feafad3aa3ced476089976350a9f71a2d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/1.jpg saved to cache
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ba19c2f6-5bd0-56df-a193-16f816fbfee7
2026-03-27 16:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b2990>
2026-03-27 16:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07e8213-fbe9-5ceb-a692-822f42953dec/d07e8213-fbe9-5ceb-a692-822f42953dec_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F528a52fbadf9416ba01f55234a76a0b5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/8.jpg saved to cache
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d07e8213-fbe9-5ceb-a692-822f42953dec
2026-03-27 16:53:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d07e8213-fbe9-5ceb-a692-822f42953dec, skipping ID generation
2026-03-27 16:53:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d07e8213-fbe9-5ceb-a692-822f42953dec with scrape type 1
2026-03-27 16:53:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d07e8213-fbe9-5ceb-a692-822f42953dec sending to next pipeline
2026-03-27 16:53:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d07e8213-fbe9-5ceb-a692-822f42953dec, identifier: 1988531
2026-03-27 16:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d07e8213-fbe9-5ceb-a692-822f42953dec with identifier: 1988531
2026-03-27 16:53:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d07e8213-fbe9-5ceb-a692-822f42953dec with identifier: 1988531
2026-03-27 16:53:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d07e8213-fbe9-5ceb-a692-822f42953dec with identifier: 1988531 to the API
2026-03-27 16:53:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:53:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:53:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'd07e8213-fbe9-5ceb-a692-822f42953dec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 48042,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07e8213-fbe9-5ceb-a692-822f42953dec/d07e8213-fbe9-5ceb-a692-822f42953dec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380651,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07e8213-fbe9-5ceb-a692-822f42953dec/d07e8213-fbe9-5ceb-a692-822f42953dec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380651,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07e8213-fbe9-5ceb-a692-822f42953dec/d07e8213-fbe9-5ceb-a692-822f42953dec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360033,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07e8213-fbe9-5ceb-a692-822f42953dec/d07e8213-fbe9-5ceb-a692-822f42953dec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361848,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07e8213-fbe9-5ceb-a692-822f42953dec/d07e8213-fbe9-5ceb-a692-822f42953dec_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360759,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07e8213-fbe9-5ceb-a692-822f42953dec/d07e8213-fbe9-5ceb-a692-822f42953dec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298815,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07e8213-fbe9-5ceb-a692-822f42953dec/d07e8213-fbe9-5ceb-a692-822f42953dec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307891,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07e8213-fbe9-5ceb-a692-822f42953dec/d07e8213-fbe9-5ceb-a692-822f42953dec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367871,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/528a52fbadf9416ba01f55234a76a0b5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-09',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Active Pack EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch S&S Active Pack EAT8',
'vin': None,
'year': 2023}
2026-03-27 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988531%27 HTTP/1.1" 200 None
2026-03-27 16:53:10 [ayvens.fr] INFO: Saving data for 1988531: {'created_time': 1774630390.755191, 'last_price_update_time': 1774630390.755202, 'auction_closing_time': 1774969200.0}
2026-03-27 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988531') HTTP/1.1" 204 0
2026-03-27 16:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fcdc470bf5b7342fea0074c47270f805c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/6.jpg not downloaded yet
2026-03-27 16:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d42810>
2026-03-27 16:53:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba19c2f6-5bd0-56df-a193-16f816fbfee7/ba19c2f6-5bd0-56df-a193-16f816fbfee7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Feafad3aa3ced476089976350a9f71a2d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/2.jpg saved to cache
2026-03-27 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ba19c2f6-5bd0-56df-a193-16f816fbfee7
2026-03-27 16:53:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591431dd0>
2026-03-27 16:53:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba19c2f6-5bd0-56df-a193-16f816fbfee7/ba19c2f6-5bd0-56df-a193-16f816fbfee7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Feafad3aa3ced476089976350a9f71a2d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/3.jpg saved to cache
2026-03-27 16:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ba19c2f6-5bd0-56df-a193-16f816fbfee7
2026-03-27 16:53:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904e3550>
2026-03-27 16:53:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba19c2f6-5bd0-56df-a193-16f816fbfee7/ba19c2f6-5bd0-56df-a193-16f816fbfee7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Feafad3aa3ced476089976350a9f71a2d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/7.jpg saved to cache
2026-03-27 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ba19c2f6-5bd0-56df-a193-16f816fbfee7
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fcdc470bf5b7342fea0074c47270f805c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/7.jpg not downloaded yet
2026-03-27 16:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911a6690>
2026-03-27 16:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba19c2f6-5bd0-56df-a193-16f816fbfee7/ba19c2f6-5bd0-56df-a193-16f816fbfee7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Feafad3aa3ced476089976350a9f71a2d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/8.jpg saved to cache
2026-03-27 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ba19c2f6-5bd0-56df-a193-16f816fbfee7
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fcdc470bf5b7342fea0074c47270f805c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/8.jpg not downloaded yet
2026-03-27 16:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9de10>
2026-03-27 16:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba19c2f6-5bd0-56df-a193-16f816fbfee7/ba19c2f6-5bd0-56df-a193-16f816fbfee7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Feafad3aa3ced476089976350a9f71a2d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/5.jpg saved to cache
2026-03-27 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ba19c2f6-5bd0-56df-a193-16f816fbfee7
2026-03-27 16:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59066ebd0>
2026-03-27 16:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba19c2f6-5bd0-56df-a193-16f816fbfee7/ba19c2f6-5bd0-56df-a193-16f816fbfee7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Feafad3aa3ced476089976350a9f71a2d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/4.jpg saved to cache
2026-03-27 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ba19c2f6-5bd0-56df-a193-16f816fbfee7
2026-03-27 16:53:11 [ayvens.fr] INFO: Found listing with ID: 1988534
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988534%27 HTTP/1.1" 200 None
2026-03-27 16:53:11 [ayvens.fr] INFO: Scrape type for 1988534: 1
2026-03-27 16:53:11 [ayvens.fr] INFO: Extracting data for car ID: 1988534
2026-03-27 16:53:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f97d17f-a37f-59fe-ab48-0836920d0b37 with identifier: 1988534
2026-03-27 16:53:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f97d17f-a37f-59fe-ab48-0836920d0b37 with scrape type 1
2026-03-27 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7f97d17f-a37f-59fe-ab48-0836920d0b37
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F3376d4158d5d43a8903c23b5088a0270%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/1.jpg not downloaded yet
2026-03-27 16:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5905abb50>
2026-03-27 16:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba19c2f6-5bd0-56df-a193-16f816fbfee7/ba19c2f6-5bd0-56df-a193-16f816fbfee7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Feafad3aa3ced476089976350a9f71a2d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/6.jpg saved to cache
2026-03-27 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ba19c2f6-5bd0-56df-a193-16f816fbfee7
2026-03-27 16:53:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ba19c2f6-5bd0-56df-a193-16f816fbfee7, skipping ID generation
2026-03-27 16:53:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba19c2f6-5bd0-56df-a193-16f816fbfee7 with scrape type 1
2026-03-27 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ba19c2f6-5bd0-56df-a193-16f816fbfee7 sending to next pipeline
2026-03-27 16:53:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ba19c2f6-5bd0-56df-a193-16f816fbfee7, identifier: 1988532
2026-03-27 16:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F3376d4158d5d43a8903c23b5088a0270%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/2.jpg not downloaded yet
2026-03-27 16:53:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ba19c2f6-5bd0-56df-a193-16f816fbfee7 with identifier: 1988532
2026-03-27 16:53:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ba19c2f6-5bd0-56df-a193-16f816fbfee7 with identifier: 1988532
2026-03-27 16:53:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ba19c2f6-5bd0-56df-a193-16f816fbfee7 with identifier: 1988532 to the API
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:53:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': 'ba19c2f6-5bd0-56df-a193-16f816fbfee7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 120214,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba19c2f6-5bd0-56df-a193-16f816fbfee7/ba19c2f6-5bd0-56df-a193-16f816fbfee7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317056,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba19c2f6-5bd0-56df-a193-16f816fbfee7/ba19c2f6-5bd0-56df-a193-16f816fbfee7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317056,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba19c2f6-5bd0-56df-a193-16f816fbfee7/ba19c2f6-5bd0-56df-a193-16f816fbfee7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326448,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba19c2f6-5bd0-56df-a193-16f816fbfee7/ba19c2f6-5bd0-56df-a193-16f816fbfee7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318379,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba19c2f6-5bd0-56df-a193-16f816fbfee7/ba19c2f6-5bd0-56df-a193-16f816fbfee7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337461,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba19c2f6-5bd0-56df-a193-16f816fbfee7/ba19c2f6-5bd0-56df-a193-16f816fbfee7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300413,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba19c2f6-5bd0-56df-a193-16f816fbfee7/ba19c2f6-5bd0-56df-a193-16f816fbfee7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 259710,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba19c2f6-5bd0-56df-a193-16f816fbfee7/ba19c2f6-5bd0-56df-a193-16f816fbfee7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323840,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/eafad3aa3ced476089976350a9f71a2d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-21',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 SW 308 SW 1.2 PureTech 130ch S&S Allure EAT8',
'transmission': 'automatic',
'trim': '308 SW 1.2 PureTech 130ch S&S Allure EAT8',
'vin': None,
'year': 2020}
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988532%27 HTTP/1.1" 200 None
2026-03-27 16:53:11 [ayvens.fr] INFO: Saving data for 1988532: {'created_time': 1774630391.867306, 'last_price_update_time': 1774630391.867318, 'auction_closing_time': 1774969200.0}
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988532') HTTP/1.1" 204 0
2026-03-27 16:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F3376d4158d5d43a8903c23b5088a0270%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/3.jpg not downloaded yet
2026-03-27 16:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de46d0>
2026-03-27 16:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_163bf354-9cf2-52a5-bbfe-90e025b8f235/163bf354-9cf2-52a5-bbfe-90e025b8f235_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fcdc470bf5b7342fea0074c47270f805c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/2.jpg saved to cache
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 163bf354-9cf2-52a5-bbfe-90e025b8f235
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911970d0>
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_163bf354-9cf2-52a5-bbfe-90e025b8f235/163bf354-9cf2-52a5-bbfe-90e025b8f235_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fcdc470bf5b7342fea0074c47270f805c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/1.jpg saved to cache
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 163bf354-9cf2-52a5-bbfe-90e025b8f235
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b0690>
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_163bf354-9cf2-52a5-bbfe-90e025b8f235/163bf354-9cf2-52a5-bbfe-90e025b8f235_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fcdc470bf5b7342fea0074c47270f805c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/4.jpg saved to cache
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 163bf354-9cf2-52a5-bbfe-90e025b8f235
2026-03-27 16:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F3376d4158d5d43a8903c23b5088a0270%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/4.jpg not downloaded yet
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F3376d4158d5d43a8903c23b5088a0270%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/5.jpg not downloaded yet
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591194cd0>
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_163bf354-9cf2-52a5-bbfe-90e025b8f235/163bf354-9cf2-52a5-bbfe-90e025b8f235_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fcdc470bf5b7342fea0074c47270f805c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/3.jpg saved to cache
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 163bf354-9cf2-52a5-bbfe-90e025b8f235
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efde90>
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_163bf354-9cf2-52a5-bbfe-90e025b8f235/163bf354-9cf2-52a5-bbfe-90e025b8f235_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fcdc470bf5b7342fea0074c47270f805c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/5.jpg saved to cache
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 163bf354-9cf2-52a5-bbfe-90e025b8f235
2026-03-27 16:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F3376d4158d5d43a8903c23b5088a0270%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/6.jpg not downloaded yet
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d9c210>
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_163bf354-9cf2-52a5-bbfe-90e025b8f235/163bf354-9cf2-52a5-bbfe-90e025b8f235_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fcdc470bf5b7342fea0074c47270f805c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/6.jpg saved to cache
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 163bf354-9cf2-52a5-bbfe-90e025b8f235
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5904feb90>
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_163bf354-9cf2-52a5-bbfe-90e025b8f235/163bf354-9cf2-52a5-bbfe-90e025b8f235_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fcdc470bf5b7342fea0074c47270f805c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/7.jpg saved to cache
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 163bf354-9cf2-52a5-bbfe-90e025b8f235
2026-03-27 16:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F3376d4158d5d43a8903c23b5088a0270%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/7.jpg not downloaded yet
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F3376d4158d5d43a8903c23b5088a0270%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/8.jpg not downloaded yet
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906a07d0>
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_163bf354-9cf2-52a5-bbfe-90e025b8f235/163bf354-9cf2-52a5-bbfe-90e025b8f235_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhc-%252Fcdc470bf5b7342fea0074c47270f805c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/8.jpg saved to cache
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 163bf354-9cf2-52a5-bbfe-90e025b8f235
2026-03-27 16:53:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 163bf354-9cf2-52a5-bbfe-90e025b8f235, skipping ID generation
2026-03-27 16:53:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 163bf354-9cf2-52a5-bbfe-90e025b8f235 with scrape type 1
2026-03-27 16:53:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 163bf354-9cf2-52a5-bbfe-90e025b8f235 sending to next pipeline
2026-03-27 16:53:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 163bf354-9cf2-52a5-bbfe-90e025b8f235, identifier: 1988533
2026-03-27 16:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 163bf354-9cf2-52a5-bbfe-90e025b8f235 with identifier: 1988533
2026-03-27 16:53:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 163bf354-9cf2-52a5-bbfe-90e025b8f235 with identifier: 1988533
2026-03-27 16:53:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 163bf354-9cf2-52a5-bbfe-90e025b8f235 with identifier: 1988533 to the API
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:53:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid',
'id': '163bf354-9cf2-52a5-bbfe-90e025b8f235',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'KUGA',
'odometer': 32169,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_163bf354-9cf2-52a5-bbfe-90e025b8f235/163bf354-9cf2-52a5-bbfe-90e025b8f235_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 508999,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_163bf354-9cf2-52a5-bbfe-90e025b8f235/163bf354-9cf2-52a5-bbfe-90e025b8f235_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 508999,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_163bf354-9cf2-52a5-bbfe-90e025b8f235/163bf354-9cf2-52a5-bbfe-90e025b8f235_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543507,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_163bf354-9cf2-52a5-bbfe-90e025b8f235/163bf354-9cf2-52a5-bbfe-90e025b8f235_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360565,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_163bf354-9cf2-52a5-bbfe-90e025b8f235/163bf354-9cf2-52a5-bbfe-90e025b8f235_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295234,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_163bf354-9cf2-52a5-bbfe-90e025b8f235/163bf354-9cf2-52a5-bbfe-90e025b8f235_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406465,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_163bf354-9cf2-52a5-bbfe-90e025b8f235/163bf354-9cf2-52a5-bbfe-90e025b8f235_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214236,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_163bf354-9cf2-52a5-bbfe-90e025b8f235/163bf354-9cf2-52a5-bbfe-90e025b8f235_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331195,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hc-/cdc470bf5b7342fea0074c47270f805c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-03-13',
'seats_number': 5,
'seller_name': None,
'title': 'FORD KUGA Kuga 2.5 Duratec 180ch Hybrid FlexiFuel Titanium Business '
'Powershift',
'transmission': 'automatic',
'trim': 'Kuga 2.5 Duratec 180ch Hybrid FlexiFuel Titanium Business Powershift',
'vin': None,
'year': 2025}
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988533%27 HTTP/1.1" 200 None
2026-03-27 16:53:13 [ayvens.fr] INFO: Saving data for 1988533: {'created_time': 1774630393.469409, 'last_price_update_time': 1774630393.469421, 'auction_closing_time': 1774969200.0}
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988533') HTTP/1.1" 204 0
2026-03-27 16:53:13 [ayvens.fr] INFO: Found listing with ID: 1988535
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988535%27 HTTP/1.1" 200 None
2026-03-27 16:53:13 [ayvens.fr] INFO: Scrape type for 1988535: 1
2026-03-27 16:53:13 [ayvens.fr] INFO: Extracting data for car ID: 1988535
2026-03-27 16:53:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0606a411-f483-565c-bc59-c5e9d0a11e2f with identifier: 1988535
2026-03-27 16:53:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0606a411-f483-565c-bc59-c5e9d0a11e2f with scrape type 1
2026-03-27 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0606a411-f483-565c-bc59-c5e9d0a11e2f
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F97bf328759284d5c812a7d5f223b8851%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/1.jpg not downloaded yet
2026-03-27 16:53:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590de4f10>
2026-03-27 16:53:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f97d17f-a37f-59fe-ab48-0836920d0b37/7f97d17f-a37f-59fe-ab48-0836920d0b37_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F3376d4158d5d43a8903c23b5088a0270%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/1.jpg saved to cache
2026-03-27 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f97d17f-a37f-59fe-ab48-0836920d0b37
2026-03-27 16:53:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F97bf328759284d5c812a7d5f223b8851%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/2.jpg not downloaded yet
2026-03-27 16:53:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc591195d50>
2026-03-27 16:53:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f97d17f-a37f-59fe-ab48-0836920d0b37/7f97d17f-a37f-59fe-ab48-0836920d0b37_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F3376d4158d5d43a8903c23b5088a0270%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/2.jpg saved to cache
2026-03-27 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f97d17f-a37f-59fe-ab48-0836920d0b37
2026-03-27 16:53:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f11190>
2026-03-27 16:53:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f97d17f-a37f-59fe-ab48-0836920d0b37/7f97d17f-a37f-59fe-ab48-0836920d0b37_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F3376d4158d5d43a8903c23b5088a0270%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/3.jpg saved to cache
2026-03-27 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f97d17f-a37f-59fe-ab48-0836920d0b37
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F97bf328759284d5c812a7d5f223b8851%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/3.jpg not downloaded yet
2026-03-27 16:53:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F97bf328759284d5c812a7d5f223b8851%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/4.jpg not downloaded yet
2026-03-27 16:53:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590efe410>
2026-03-27 16:53:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f97d17f-a37f-59fe-ab48-0836920d0b37/7f97d17f-a37f-59fe-ab48-0836920d0b37_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F3376d4158d5d43a8903c23b5088a0270%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/4.jpg saved to cache
2026-03-27 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f97d17f-a37f-59fe-ab48-0836920d0b37
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F97bf328759284d5c812a7d5f223b8851%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/5.jpg not downloaded yet
2026-03-27 16:53:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F97bf328759284d5c812a7d5f223b8851%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/6.jpg not downloaded yet
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F97bf328759284d5c812a7d5f223b8851%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/7.jpg not downloaded yet
2026-03-27 16:53:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906b2e90>
2026-03-27 16:53:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f97d17f-a37f-59fe-ab48-0836920d0b37/7f97d17f-a37f-59fe-ab48-0836920d0b37_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F3376d4158d5d43a8903c23b5088a0270%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/6.jpg saved to cache
2026-03-27 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f97d17f-a37f-59fe-ab48-0836920d0b37
2026-03-27 16:53:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b6aa50>
2026-03-27 16:53:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f97d17f-a37f-59fe-ab48-0836920d0b37/7f97d17f-a37f-59fe-ab48-0836920d0b37_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F3376d4158d5d43a8903c23b5088a0270%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/5.jpg saved to cache
2026-03-27 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f97d17f-a37f-59fe-ab48-0836920d0b37
2026-03-27 16:53:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b41dd0>
2026-03-27 16:53:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f97d17f-a37f-59fe-ab48-0836920d0b37/7f97d17f-a37f-59fe-ab48-0836920d0b37_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F3376d4158d5d43a8903c23b5088a0270%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/7.jpg saved to cache
2026-03-27 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f97d17f-a37f-59fe-ab48-0836920d0b37
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F97bf328759284d5c812a7d5f223b8851%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/8.jpg not downloaded yet
2026-03-27 16:53:14 [ayvens.fr] INFO: Found listing with ID: 1988536
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988536%27 HTTP/1.1" 200 None
2026-03-27 16:53:14 [ayvens.fr] INFO: Scrape type for 1988536: 1
2026-03-27 16:53:14 [ayvens.fr] INFO: Extracting data for car ID: 1988536
2026-03-27 16:53:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de37887f-6e16-5887-b749-6b753d9b1610 with identifier: 1988536
2026-03-27 16:53:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de37887f-6e16-5887-b749-6b753d9b1610 with scrape type 1
2026-03-27 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item de37887f-6e16-5887-b749-6b753d9b1610
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F96298632d20d4a42b5d51ee0633e2371%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/1.jpg not downloaded yet
2026-03-27 16:53:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590df6390>
2026-03-27 16:53:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f97d17f-a37f-59fe-ab48-0836920d0b37/7f97d17f-a37f-59fe-ab48-0836920d0b37_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fex-%252F3376d4158d5d43a8903c23b5088a0270%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/8.jpg saved to cache
2026-03-27 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f97d17f-a37f-59fe-ab48-0836920d0b37
2026-03-27 16:53:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f97d17f-a37f-59fe-ab48-0836920d0b37, skipping ID generation
2026-03-27 16:53:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f97d17f-a37f-59fe-ab48-0836920d0b37 with scrape type 1
2026-03-27 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f97d17f-a37f-59fe-ab48-0836920d0b37 sending to next pipeline
2026-03-27 16:53:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7f97d17f-a37f-59fe-ab48-0836920d0b37, identifier: 1988534
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F96298632d20d4a42b5d51ee0633e2371%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/2.jpg not downloaded yet
2026-03-27 16:53:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7f97d17f-a37f-59fe-ab48-0836920d0b37 with identifier: 1988534
2026-03-27 16:53:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7f97d17f-a37f-59fe-ab48-0836920d0b37 with identifier: 1988534
2026-03-27 16:53:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 7f97d17f-a37f-59fe-ab48-0836920d0b37 with identifier: 1988534 to the API
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:53:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '7f97d17f-a37f-59fe-ab48-0836920d0b37',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 89202,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f97d17f-a37f-59fe-ab48-0836920d0b37/7f97d17f-a37f-59fe-ab48-0836920d0b37_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338153,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f97d17f-a37f-59fe-ab48-0836920d0b37/7f97d17f-a37f-59fe-ab48-0836920d0b37_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338153,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f97d17f-a37f-59fe-ab48-0836920d0b37/7f97d17f-a37f-59fe-ab48-0836920d0b37_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338501,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f97d17f-a37f-59fe-ab48-0836920d0b37/7f97d17f-a37f-59fe-ab48-0836920d0b37_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352831,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f97d17f-a37f-59fe-ab48-0836920d0b37/7f97d17f-a37f-59fe-ab48-0836920d0b37_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345665,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f97d17f-a37f-59fe-ab48-0836920d0b37/7f97d17f-a37f-59fe-ab48-0836920d0b37_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339248,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f97d17f-a37f-59fe-ab48-0836920d0b37/7f97d17f-a37f-59fe-ab48-0836920d0b37_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240431,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f97d17f-a37f-59fe-ab48-0836920d0b37/7f97d17f-a37f-59fe-ab48-0836920d0b37_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288786,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ex-/3376d4158d5d43a8903c23b5088a0270/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-24',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.6 THP 165ch GT Line S&S EAT6',
'transmission': 'automatic',
'trim': '5008 1.6 THP 165ch GT Line S&S EAT6',
'vin': None,
'year': 2018}
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988534%27 HTTP/1.1" 200 None
2026-03-27 16:53:14 [ayvens.fr] INFO: Saving data for 1988534: {'created_time': 1774630394.822351, 'last_price_update_time': 1774630394.82237, 'auction_closing_time': 1774969200.0}
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988534') HTTP/1.1" 204 0
2026-03-27 16:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F96298632d20d4a42b5d51ee0633e2371%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/3.jpg not downloaded yet
2026-03-27 16:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F96298632d20d4a42b5d51ee0633e2371%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/4.jpg not downloaded yet
2026-03-27 16:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F96298632d20d4a42b5d51ee0633e2371%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/5.jpg not downloaded yet
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F96298632d20d4a42b5d51ee0633e2371%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/6.jpg not downloaded yet
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F96298632d20d4a42b5d51ee0633e2371%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/7.jpg not downloaded yet
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F96298632d20d4a42b5d51ee0633e2371%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/8.jpg not downloaded yet
2026-03-27 16:53:14 [ayvens.fr] INFO: Found listing with ID: 1988537
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988537%27 HTTP/1.1" 200 None
2026-03-27 16:53:14 [ayvens.fr] INFO: Scrape type for 1988537: 1
2026-03-27 16:53:14 [ayvens.fr] INFO: Extracting data for car ID: 1988537
2026-03-27 16:53:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d863b8a-bef3-5b68-b58e-1985d1ca4759 with identifier: 1988537
2026-03-27 16:53:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d863b8a-bef3-5b68-b58e-1985d1ca4759 with scrape type 1
2026-03-27 16:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0d863b8a-bef3-5b68-b58e-1985d1ca4759
2026-03-27 16:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff9ea5560ff3743e08b8687b032ef25d5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/1.jpg not downloaded yet
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b68c50>
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0606a411-f483-565c-bc59-c5e9d0a11e2f/0606a411-f483-565c-bc59-c5e9d0a11e2f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F97bf328759284d5c812a7d5f223b8851%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/5.jpg saved to cache
2026-03-27 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0606a411-f483-565c-bc59-c5e9d0a11e2f
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910c0a10>
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0606a411-f483-565c-bc59-c5e9d0a11e2f/0606a411-f483-565c-bc59-c5e9d0a11e2f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F97bf328759284d5c812a7d5f223b8851%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/4.jpg saved to cache
2026-03-27 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0606a411-f483-565c-bc59-c5e9d0a11e2f
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f31390>
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0606a411-f483-565c-bc59-c5e9d0a11e2f/0606a411-f483-565c-bc59-c5e9d0a11e2f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F97bf328759284d5c812a7d5f223b8851%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/2.jpg saved to cache
2026-03-27 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0606a411-f483-565c-bc59-c5e9d0a11e2f
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910ef3d0>
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0606a411-f483-565c-bc59-c5e9d0a11e2f/0606a411-f483-565c-bc59-c5e9d0a11e2f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F97bf328759284d5c812a7d5f223b8851%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/1.jpg saved to cache
2026-03-27 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0606a411-f483-565c-bc59-c5e9d0a11e2f
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590615c50>
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0606a411-f483-565c-bc59-c5e9d0a11e2f/0606a411-f483-565c-bc59-c5e9d0a11e2f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F97bf328759284d5c812a7d5f223b8851%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/3.jpg saved to cache
2026-03-27 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0606a411-f483-565c-bc59-c5e9d0a11e2f
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff9ea5560ff3743e08b8687b032ef25d5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/2.jpg not downloaded yet
2026-03-27 16:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff9ea5560ff3743e08b8687b032ef25d5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/3.jpg not downloaded yet
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590529e10>
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0606a411-f483-565c-bc59-c5e9d0a11e2f/0606a411-f483-565c-bc59-c5e9d0a11e2f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F97bf328759284d5c812a7d5f223b8851%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/7.jpg saved to cache
2026-03-27 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0606a411-f483-565c-bc59-c5e9d0a11e2f
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5903c3a50>
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0606a411-f483-565c-bc59-c5e9d0a11e2f/0606a411-f483-565c-bc59-c5e9d0a11e2f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F97bf328759284d5c812a7d5f223b8851%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/8.jpg saved to cache
2026-03-27 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0606a411-f483-565c-bc59-c5e9d0a11e2f
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910b0d50>
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0606a411-f483-565c-bc59-c5e9d0a11e2f/0606a411-f483-565c-bc59-c5e9d0a11e2f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F97bf328759284d5c812a7d5f223b8851%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/6.jpg saved to cache
2026-03-27 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0606a411-f483-565c-bc59-c5e9d0a11e2f
2026-03-27 16:53:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0606a411-f483-565c-bc59-c5e9d0a11e2f, skipping ID generation
2026-03-27 16:53:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0606a411-f483-565c-bc59-c5e9d0a11e2f with scrape type 1
2026-03-27 16:53:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0606a411-f483-565c-bc59-c5e9d0a11e2f sending to next pipeline
2026-03-27 16:53:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0606a411-f483-565c-bc59-c5e9d0a11e2f, identifier: 1988535
2026-03-27 16:53:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0606a411-f483-565c-bc59-c5e9d0a11e2f with identifier: 1988535
2026-03-27 16:53:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 16:53:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0606a411-f483-565c-bc59-c5e9d0a11e2f with identifier: 1988535
2026-03-27 16:53:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0606a411-f483-565c-bc59-c5e9d0a11e2f with identifier: 1988535 to the API
2026-03-27 16:53:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:53:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 145,
'color': 'MINERAL WEISS',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '0606a411-f483-565c-bc59-c5e9d0a11e2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'X1',
'odometer': 69877,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0606a411-f483-565c-bc59-c5e9d0a11e2f/0606a411-f483-565c-bc59-c5e9d0a11e2f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398954,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0606a411-f483-565c-bc59-c5e9d0a11e2f/0606a411-f483-565c-bc59-c5e9d0a11e2f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398954,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0606a411-f483-565c-bc59-c5e9d0a11e2f/0606a411-f483-565c-bc59-c5e9d0a11e2f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369310,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0606a411-f483-565c-bc59-c5e9d0a11e2f/0606a411-f483-565c-bc59-c5e9d0a11e2f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352140,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0606a411-f483-565c-bc59-c5e9d0a11e2f/0606a411-f483-565c-bc59-c5e9d0a11e2f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384796,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0606a411-f483-565c-bc59-c5e9d0a11e2f/0606a411-f483-565c-bc59-c5e9d0a11e2f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356772,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0606a411-f483-565c-bc59-c5e9d0a11e2f/0606a411-f483-565c-bc59-c5e9d0a11e2f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272019,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0606a411-f483-565c-bc59-c5e9d0a11e2f/0606a411-f483-565c-bc59-c5e9d0a11e2f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231394,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/97bf328759284d5c812a7d5f223b8851/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-03',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 X1 sDrive18i 136ch xLine',
'transmission': 'automatic',
'trim': 'X1 sDrive18i 136ch xLine',
'vin': None,
'year': 2023}
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988535%27 HTTP/1.1" 200 None
2026-03-27 16:53:16 [ayvens.fr] INFO: Saving data for 1988535: {'created_time': 1774630396.126799, 'last_price_update_time': 1774630396.126809, 'auction_closing_time': 1774969200.0}
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988535') HTTP/1.1" 204 0
2026-03-27 16:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff9ea5560ff3743e08b8687b032ef25d5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/4.jpg not downloaded yet
2026-03-27 16:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff9ea5560ff3743e08b8687b032ef25d5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/5.jpg not downloaded yet
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f4db50>
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de37887f-6e16-5887-b749-6b753d9b1610/de37887f-6e16-5887-b749-6b753d9b1610_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F96298632d20d4a42b5d51ee0633e2371%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/1.jpg saved to cache
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de37887f-6e16-5887-b749-6b753d9b1610
2026-03-27 16:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff9ea5560ff3743e08b8687b032ef25d5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/6.jpg not downloaded yet
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff9ea5560ff3743e08b8687b032ef25d5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/7.jpg not downloaded yet
2026-03-27 16:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59065d410>
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de37887f-6e16-5887-b749-6b753d9b1610/de37887f-6e16-5887-b749-6b753d9b1610_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F96298632d20d4a42b5d51ee0633e2371%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/4.jpg saved to cache
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de37887f-6e16-5887-b749-6b753d9b1610
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff9ea5560ff3743e08b8687b032ef25d5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/8.jpg not downloaded yet
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d83110>
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de37887f-6e16-5887-b749-6b753d9b1610/de37887f-6e16-5887-b749-6b753d9b1610_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F96298632d20d4a42b5d51ee0633e2371%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/2.jpg saved to cache
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de37887f-6e16-5887-b749-6b753d9b1610
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590593310>
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de37887f-6e16-5887-b749-6b753d9b1610/de37887f-6e16-5887-b749-6b753d9b1610_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F96298632d20d4a42b5d51ee0633e2371%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/7.jpg saved to cache
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de37887f-6e16-5887-b749-6b753d9b1610
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5914440d0>
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de37887f-6e16-5887-b749-6b753d9b1610/de37887f-6e16-5887-b749-6b753d9b1610_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F96298632d20d4a42b5d51ee0633e2371%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/6.jpg saved to cache
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de37887f-6e16-5887-b749-6b753d9b1610
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f836d0>
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de37887f-6e16-5887-b749-6b753d9b1610/de37887f-6e16-5887-b749-6b753d9b1610_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F96298632d20d4a42b5d51ee0633e2371%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/3.jpg saved to cache
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de37887f-6e16-5887-b749-6b753d9b1610
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590621650>
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de37887f-6e16-5887-b749-6b753d9b1610/de37887f-6e16-5887-b749-6b753d9b1610_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F96298632d20d4a42b5d51ee0633e2371%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/5.jpg saved to cache
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de37887f-6e16-5887-b749-6b753d9b1610
2026-03-27 16:53:16 [ayvens.fr] INFO: Found listing with ID: 1988538
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988538%27 HTTP/1.1" 200 None
2026-03-27 16:53:16 [ayvens.fr] INFO: Scrape type for 1988538: 1
2026-03-27 16:53:16 [ayvens.fr] INFO: Extracting data for car ID: 1988538
2026-03-27 16:53:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc997e4d-9e6f-5a4f-a24c-396a85e218de with identifier: 1988538
2026-03-27 16:53:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc997e4d-9e6f-5a4f-a24c-396a85e218de with scrape type 1
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item cc997e4d-9e6f-5a4f-a24c-396a85e218de
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa2ee30710f0434e9fdf9628780b7cca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/1.jpg not downloaded yet
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59050e6d0>
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de37887f-6e16-5887-b749-6b753d9b1610/de37887f-6e16-5887-b749-6b753d9b1610_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F96298632d20d4a42b5d51ee0633e2371%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/8.jpg saved to cache
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de37887f-6e16-5887-b749-6b753d9b1610
2026-03-27 16:53:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de37887f-6e16-5887-b749-6b753d9b1610, skipping ID generation
2026-03-27 16:53:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de37887f-6e16-5887-b749-6b753d9b1610 with scrape type 1
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de37887f-6e16-5887-b749-6b753d9b1610 sending to next pipeline
2026-03-27 16:53:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: de37887f-6e16-5887-b749-6b753d9b1610, identifier: 1988536
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa2ee30710f0434e9fdf9628780b7cca%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/2.jpg not downloaded yet
2026-03-27 16:53:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: de37887f-6e16-5887-b749-6b753d9b1610 with identifier: 1988536
2026-03-27 16:53:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: de37887f-6e16-5887-b749-6b753d9b1610 with identifier: 1988536
2026-03-27 16:53:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: de37887f-6e16-5887-b749-6b753d9b1610 with identifier: 1988536 to the API
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:53:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 141,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'diesel',
'id': 'de37887f-6e16-5887-b749-6b753d9b1610',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'DS AUTOMOBILES',
'model': 'DS7',
'odometer': 61654,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de37887f-6e16-5887-b749-6b753d9b1610/de37887f-6e16-5887-b749-6b753d9b1610_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304609,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de37887f-6e16-5887-b749-6b753d9b1610/de37887f-6e16-5887-b749-6b753d9b1610_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304609,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de37887f-6e16-5887-b749-6b753d9b1610/de37887f-6e16-5887-b749-6b753d9b1610_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350915,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de37887f-6e16-5887-b749-6b753d9b1610/de37887f-6e16-5887-b749-6b753d9b1610_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304280,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de37887f-6e16-5887-b749-6b753d9b1610/de37887f-6e16-5887-b749-6b753d9b1610_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350332,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de37887f-6e16-5887-b749-6b753d9b1610/de37887f-6e16-5887-b749-6b753d9b1610_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295227,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de37887f-6e16-5887-b749-6b753d9b1610/de37887f-6e16-5887-b749-6b753d9b1610_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 278308,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de37887f-6e16-5887-b749-6b753d9b1610/de37887f-6e16-5887-b749-6b753d9b1610_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293211,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/96298632d20d4a42b5d51ee0633e2371/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-28',
'seats_number': 5,
'seller_name': None,
'title': 'DS AUTOMOBILES DS7 DS 7 Crossback BlueHDi 130ch So Chic '
'Automatique',
'transmission': 'automatic',
'trim': 'DS 7 Crossback BlueHDi 130ch So Chic Automatique',
'vin': None,
'year': 2021}
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988536%27 HTTP/1.1" 200 None
2026-03-27 16:53:17 [ayvens.fr] INFO: Saving data for 1988536: {'created_time': 1774630397.34098, 'last_price_update_time': 1774630397.340991, 'auction_closing_time': 1774969200.0}
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988536') HTTP/1.1" 204 0
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590511ad0>
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d863b8a-bef3-5b68-b58e-1985d1ca4759/0d863b8a-bef3-5b68-b58e-1985d1ca4759_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff9ea5560ff3743e08b8687b032ef25d5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/1.jpg saved to cache
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d863b8a-bef3-5b68-b58e-1985d1ca4759
2026-03-27 16:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa2ee30710f0434e9fdf9628780b7cca%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/3.jpg not downloaded yet
2026-03-27 16:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa2ee30710f0434e9fdf9628780b7cca%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/4.jpg not downloaded yet
2026-03-27 16:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa2ee30710f0434e9fdf9628780b7cca%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/5.jpg not downloaded yet
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa2ee30710f0434e9fdf9628780b7cca%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/6.jpg not downloaded yet
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa2ee30710f0434e9fdf9628780b7cca%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/7.jpg not downloaded yet
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa2ee30710f0434e9fdf9628780b7cca%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/8.jpg not downloaded yet
2026-03-27 16:53:17 [ayvens.fr] INFO: Found listing with ID: 1988539
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988539%27 HTTP/1.1" 200 None
2026-03-27 16:53:17 [ayvens.fr] INFO: Scrape type for 1988539: 1
2026-03-27 16:53:17 [ayvens.fr] INFO: Extracting data for car ID: 1988539
2026-03-27 16:53:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23c93241-9f4f-5a46-a06a-af85a2e7b5ab with identifier: 1988539
2026-03-27 16:53:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23c93241-9f4f-5a46-a06a-af85a2e7b5ab with scrape type 1
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 23c93241-9f4f-5a46-a06a-af85a2e7b5ab
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a138aee2dc647ccacdb20a455120586%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/1.jpg not downloaded yet
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a138aee2dc647ccacdb20a455120586%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/2.jpg not downloaded yet
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a138aee2dc647ccacdb20a455120586%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/3.jpg not downloaded yet
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b2bc50>
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d863b8a-bef3-5b68-b58e-1985d1ca4759/0d863b8a-bef3-5b68-b58e-1985d1ca4759_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff9ea5560ff3743e08b8687b032ef25d5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/5.jpg saved to cache
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d863b8a-bef3-5b68-b58e-1985d1ca4759
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5906239d0>
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d863b8a-bef3-5b68-b58e-1985d1ca4759/0d863b8a-bef3-5b68-b58e-1985d1ca4759_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff9ea5560ff3743e08b8687b032ef25d5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/2.jpg saved to cache
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d863b8a-bef3-5b68-b58e-1985d1ca4759
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590617410>
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d863b8a-bef3-5b68-b58e-1985d1ca4759/0d863b8a-bef3-5b68-b58e-1985d1ca4759_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff9ea5560ff3743e08b8687b032ef25d5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/4.jpg saved to cache
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d863b8a-bef3-5b68-b58e-1985d1ca4759
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b22b10>
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d863b8a-bef3-5b68-b58e-1985d1ca4759/0d863b8a-bef3-5b68-b58e-1985d1ca4759_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff9ea5560ff3743e08b8687b032ef25d5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/3.jpg saved to cache
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d863b8a-bef3-5b68-b58e-1985d1ca4759
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b2a190>
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d863b8a-bef3-5b68-b58e-1985d1ca4759/0d863b8a-bef3-5b68-b58e-1985d1ca4759_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff9ea5560ff3743e08b8687b032ef25d5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/6.jpg saved to cache
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d863b8a-bef3-5b68-b58e-1985d1ca4759
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a138aee2dc647ccacdb20a455120586%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/4.jpg not downloaded yet
2026-03-27 16:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59068d8d0>
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d863b8a-bef3-5b68-b58e-1985d1ca4759/0d863b8a-bef3-5b68-b58e-1985d1ca4759_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff9ea5560ff3743e08b8687b032ef25d5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/7.jpg saved to cache
2026-03-27 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d863b8a-bef3-5b68-b58e-1985d1ca4759
2026-03-27 16:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590aff610>
2026-03-27 16:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d863b8a-bef3-5b68-b58e-1985d1ca4759/0d863b8a-bef3-5b68-b58e-1985d1ca4759_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Ff9ea5560ff3743e08b8687b032ef25d5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/8.jpg saved to cache
2026-03-27 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d863b8a-bef3-5b68-b58e-1985d1ca4759
2026-03-27 16:53:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d863b8a-bef3-5b68-b58e-1985d1ca4759, skipping ID generation
2026-03-27 16:53:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d863b8a-bef3-5b68-b58e-1985d1ca4759 with scrape type 1
2026-03-27 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d863b8a-bef3-5b68-b58e-1985d1ca4759 sending to next pipeline
2026-03-27 16:53:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0d863b8a-bef3-5b68-b58e-1985d1ca4759, identifier: 1988537
2026-03-27 16:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a138aee2dc647ccacdb20a455120586%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/5.jpg not downloaded yet
2026-03-27 16:53:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0d863b8a-bef3-5b68-b58e-1985d1ca4759 with identifier: 1988537
2026-03-27 16:53:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0d863b8a-bef3-5b68-b58e-1985d1ca4759 with identifier: 1988537
2026-03-27 16:53:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 0d863b8a-bef3-5b68-b58e-1985d1ca4759 with identifier: 1988537 to the API
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:53:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'BLANCHE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'petrol',
'id': '0d863b8a-bef3-5b68-b58e-1985d1ca4759',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 42576,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d863b8a-bef3-5b68-b58e-1985d1ca4759/0d863b8a-bef3-5b68-b58e-1985d1ca4759_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 445076,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d863b8a-bef3-5b68-b58e-1985d1ca4759/0d863b8a-bef3-5b68-b58e-1985d1ca4759_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 445076,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d863b8a-bef3-5b68-b58e-1985d1ca4759/0d863b8a-bef3-5b68-b58e-1985d1ca4759_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450310,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d863b8a-bef3-5b68-b58e-1985d1ca4759/0d863b8a-bef3-5b68-b58e-1985d1ca4759_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290433,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d863b8a-bef3-5b68-b58e-1985d1ca4759/0d863b8a-bef3-5b68-b58e-1985d1ca4759_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279301,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d863b8a-bef3-5b68-b58e-1985d1ca4759/0d863b8a-bef3-5b68-b58e-1985d1ca4759_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342023,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d863b8a-bef3-5b68-b58e-1985d1ca4759/0d863b8a-bef3-5b68-b58e-1985d1ca4759_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284720,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d863b8a-bef3-5b68-b58e-1985d1ca4759/0d863b8a-bef3-5b68-b58e-1985d1ca4759_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309849,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/f9ea5560ff3743e08b8687b032ef25d5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-17',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.0 TCe 90ch Business',
'transmission': 'manual',
'trim': 'Clio 1.0 TCe 90ch Business',
'vin': None,
'year': 2021}
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988537%27 HTTP/1.1" 200 None
2026-03-27 16:53:18 [ayvens.fr] INFO: Saving data for 1988537: {'created_time': 1774630398.649432, 'last_price_update_time': 1774630398.649443, 'auction_closing_time': 1774969200.0}
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988537') HTTP/1.1" 204 0
2026-03-27 16:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a138aee2dc647ccacdb20a455120586%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/6.jpg not downloaded yet
2026-03-27 16:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f813d0>
2026-03-27 16:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc997e4d-9e6f-5a4f-a24c-396a85e218de/cc997e4d-9e6f-5a4f-a24c-396a85e218de_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa2ee30710f0434e9fdf9628780b7cca%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/2.jpg saved to cache
2026-03-27 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc997e4d-9e6f-5a4f-a24c-396a85e218de
2026-03-27 16:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a138aee2dc647ccacdb20a455120586%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/7.jpg not downloaded yet
2026-03-27 16:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59067c190>
2026-03-27 16:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc997e4d-9e6f-5a4f-a24c-396a85e218de/cc997e4d-9e6f-5a4f-a24c-396a85e218de_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa2ee30710f0434e9fdf9628780b7cca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/1.jpg saved to cache
2026-03-27 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc997e4d-9e6f-5a4f-a24c-396a85e218de
2026-03-27 16:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dd0110>
2026-03-27 16:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc997e4d-9e6f-5a4f-a24c-396a85e218de/cc997e4d-9e6f-5a4f-a24c-396a85e218de_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa2ee30710f0434e9fdf9628780b7cca%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/3.jpg saved to cache
2026-03-27 16:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc997e4d-9e6f-5a4f-a24c-396a85e218de
2026-03-27 16:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590dfcb10>
2026-03-27 16:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc997e4d-9e6f-5a4f-a24c-396a85e218de/cc997e4d-9e6f-5a4f-a24c-396a85e218de_image_7.jpg HTTP/1.1" 201 0
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa2ee30710f0434e9fdf9628780b7cca%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/8.jpg saved to cache
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc997e4d-9e6f-5a4f-a24c-396a85e218de
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc59067ec50>
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc997e4d-9e6f-5a4f-a24c-396a85e218de/cc997e4d-9e6f-5a4f-a24c-396a85e218de_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa2ee30710f0434e9fdf9628780b7cca%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/7.jpg saved to cache
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc997e4d-9e6f-5a4f-a24c-396a85e218de
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a138aee2dc647ccacdb20a455120586%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/8.jpg not downloaded yet
2026-03-27 16:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:19 [ayvens.fr] INFO: Found listing with ID: 1988540
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988540%27 HTTP/1.1" 200 None
2026-03-27 16:53:19 [ayvens.fr] INFO: Scrape type for 1988540: 1
2026-03-27 16:53:19 [ayvens.fr] INFO: Extracting data for car ID: 1988540
2026-03-27 16:53:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc0cac56-fb69-5213-8b24-f1ad61f086a3 with identifier: 1988540
2026-03-27 16:53:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc0cac56-fb69-5213-8b24-f1ad61f086a3 with scrape type 1
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item dc0cac56-fb69-5213-8b24-f1ad61f086a3
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff0d6705e2e7148a089155abc5664c185%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f0d6705e2e7148a089155abc5664c185/images/large/1.jpg not downloaded yet
2026-03-27 16:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4a090>
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc997e4d-9e6f-5a4f-a24c-396a85e218de/cc997e4d-9e6f-5a4f-a24c-396a85e218de_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa2ee30710f0434e9fdf9628780b7cca%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/5.jpg saved to cache
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc997e4d-9e6f-5a4f-a24c-396a85e218de
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590b88690>
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc997e4d-9e6f-5a4f-a24c-396a85e218de/cc997e4d-9e6f-5a4f-a24c-396a85e218de_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa2ee30710f0434e9fdf9628780b7cca%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/4.jpg saved to cache
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc997e4d-9e6f-5a4f-a24c-396a85e218de
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5910ec590>
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc997e4d-9e6f-5a4f-a24c-396a85e218de/cc997e4d-9e6f-5a4f-a24c-396a85e218de_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Faa2ee30710f0434e9fdf9628780b7cca%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/6.jpg saved to cache
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc997e4d-9e6f-5a4f-a24c-396a85e218de
2026-03-27 16:53:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc997e4d-9e6f-5a4f-a24c-396a85e218de, skipping ID generation
2026-03-27 16:53:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc997e4d-9e6f-5a4f-a24c-396a85e218de with scrape type 1
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc997e4d-9e6f-5a4f-a24c-396a85e218de sending to next pipeline
2026-03-27 16:53:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: cc997e4d-9e6f-5a4f-a24c-396a85e218de, identifier: 1988538
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff0d6705e2e7148a089155abc5664c185%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f0d6705e2e7148a089155abc5664c185/images/large/2.jpg not downloaded yet
2026-03-27 16:53:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: cc997e4d-9e6f-5a4f-a24c-396a85e218de with identifier: 1988538
2026-03-27 16:53:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: cc997e4d-9e6f-5a4f-a24c-396a85e218de with identifier: 1988538
2026-03-27 16:53:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: cc997e4d-9e6f-5a4f-a24c-396a85e218de with identifier: 1988538 to the API
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 16:53:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'NOIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-03-31T15:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'cc997e4d-9e6f-5a4f-a24c-396a85e218de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41118',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 44260,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc997e4d-9e6f-5a4f-a24c-396a85e218de/cc997e4d-9e6f-5a4f-a24c-396a85e218de_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293928,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc997e4d-9e6f-5a4f-a24c-396a85e218de/cc997e4d-9e6f-5a4f-a24c-396a85e218de_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293928,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc997e4d-9e6f-5a4f-a24c-396a85e218de/cc997e4d-9e6f-5a4f-a24c-396a85e218de_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329247,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc997e4d-9e6f-5a4f-a24c-396a85e218de/cc997e4d-9e6f-5a4f-a24c-396a85e218de_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352247,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc997e4d-9e6f-5a4f-a24c-396a85e218de/cc997e4d-9e6f-5a4f-a24c-396a85e218de_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331895,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc997e4d-9e6f-5a4f-a24c-396a85e218de/cc997e4d-9e6f-5a4f-a24c-396a85e218de_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364510,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc997e4d-9e6f-5a4f-a24c-396a85e218de/cc997e4d-9e6f-5a4f-a24c-396a85e218de_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297610,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc997e4d-9e6f-5a4f-a24c-396a85e218de/cc997e4d-9e6f-5a4f-a24c-396a85e218de_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271628,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/aa2ee30710f0434e9fdf9628780b7cca/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 230ch HEV Active Business BVA6 4x2',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 230ch HEV Active Business BVA6 4x2',
'vin': None,
'year': 2022}
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271988538%27 HTTP/1.1" 200 None
2026-03-27 16:53:19 [ayvens.fr] INFO: Saving data for 1988538: {'created_time': 1774630399.755759, 'last_price_update_time': 1774630399.755771, 'auction_closing_time': 1774969200.0}
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1988538') HTTP/1.1" 204 0
2026-03-27 16:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff0d6705e2e7148a089155abc5664c185%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f0d6705e2e7148a089155abc5664c185/images/large/3.jpg not downloaded yet
2026-03-27 16:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b69dd0>
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23c93241-9f4f-5a46-a06a-af85a2e7b5ab/23c93241-9f4f-5a46-a06a-af85a2e7b5ab_image_0.jpg HTTP/1.1" 201 0
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a138aee2dc647ccacdb20a455120586%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/1.jpg saved to cache
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23c93241-9f4f-5a46-a06a-af85a2e7b5ab
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590aff910>
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23c93241-9f4f-5a46-a06a-af85a2e7b5ab/23c93241-9f4f-5a46-a06a-af85a2e7b5ab_image_1.jpg HTTP/1.1" 201 0
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a138aee2dc647ccacdb20a455120586%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/2.jpg saved to cache
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 23c93241-9f4f-5a46-a06a-af85a2e7b5ab
2026-03-27 16:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff0d6705e2e7148a089155abc5664c185%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f0d6705e2e7148a089155abc5664c185/images/large/4.jpg not downloaded yet
2026-03-27 16:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff0d6705e2e7148a089155abc5664c185%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f0d6705e2e7148a089155abc5664c185/images/large/5.jpg not downloaded yet
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc5911970d0>
2026-03-27 16:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23c93241-9f4f-5a46-a06a-af85a2e7b5ab/23c93241-9f4f-5a46-a06a-af85a2e7b5ab_image_4.jpg HTTP/1.1" 201 0
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a138aee2dc647ccacdb20a455120586%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/5.jpg saved to cache
2026-03-27 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 23c93241-9f4f-5a46-a06a-af85a2e7b5ab
2026-03-27 16:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d3a6d0>
2026-03-27 16:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23c93241-9f4f-5a46-a06a-af85a2e7b5ab/23c93241-9f4f-5a46-a06a-af85a2e7b5ab_image_2.jpg HTTP/1.1" 201 0
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a138aee2dc647ccacdb20a455120586%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/3.jpg saved to cache
2026-03-27 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23c93241-9f4f-5a46-a06a-af85a2e7b5ab
2026-03-27 16:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590f60b50>
2026-03-27 16:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23c93241-9f4f-5a46-a06a-af85a2e7b5ab/23c93241-9f4f-5a46-a06a-af85a2e7b5ab_image_3.jpg HTTP/1.1" 201 0
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a138aee2dc647ccacdb20a455120586%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/4.jpg saved to cache
2026-03-27 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 23c93241-9f4f-5a46-a06a-af85a2e7b5ab
2026-03-27 16:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff0d6705e2e7148a089155abc5664c185%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f0d6705e2e7148a089155abc5664c185/images/large/6.jpg not downloaded yet
2026-03-27 16:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc590d4e290>
2026-03-27 16:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23c93241-9f4f-5a46-a06a-af85a2e7b5ab/23c93241-9f4f-5a46-a06a-af85a2e7b5ab_image_6.jpg HTTP/1.1" 201 0
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a138aee2dc647ccacdb20a455120586%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/7.jpg saved to cache
2026-03-27 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 23c93241-9f4f-5a46-a06a-af85a2e7b5ab
2026-03-27 16:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 16:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc592b587d0>
2026-03-27 16:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 16:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23c93241-9f4f-5a46-a06a-af85a2e7b5ab/23c93241-9f4f-5a46-a06a-af85a2e7b5ab_image_5.jpg HTTP/1.1" 201 0
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F3a138aee2dc647ccacdb20a455120586%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/3a138aee2dc647ccacdb20a455120586/images/large/6.jpg saved to cache
2026-03-27 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 23c93241-9f4f-5a46-a06a-af85a2e7b5ab
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Ff0d6705e2e7148a089155abc5664c185%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 16:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/f0d6705e2e7148a089155abc5664c185/images/large/7.jpg not downloaded yet
2026-03-27 16:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/f0d6705e2e7148a089155abc5664c185/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 16:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1"